Its locally hosted including the model and the runtime. You can have your program open up a server and bind ports locally if you want to run your own server and not just a desktop GUI.
Comment on [deleted]
But_Class_War@midwest.social 1 year ago
Wouldn’t the api hit the cloud, isn’t it just a different interface?
Gnubyte@lemdit.com 1 year ago
xchino@programming.dev 1 year ago
No, it provides an API as an interface, it is not consuming an API.
Alto@kbin.social 1 year ago
Just to expand, you can also use ChatGPT using your own key now, which will send your logs to OpenAI. There's plenty of models available that don't however, and I've found them plenty good enough for my usecases.