A simpler answer might be llamafile if you're using Mac or Linux.

If you're on windows you're limited to some smaller LLMs without some work. In my experience the smaller LLMs are still pretty good as chat bots so they might translate well.