I dont have the hardware so I’m using “open web ui” to run queries on models accessible via huggingface API.

Works really well. I haven’t invested the time to understand how to use workspaces, which allow you to tune models, but aparently its doable.