bandwidthcrisis
@bandwidthcrisis@lemmy.world
This is a remote user, information on this page may be incomplete. View at Source ↗
- Comment on I built a local AI movie recommender for Radarr using Ollama 2 months ago:
I had to look up embeddings: so this is comparing the encoding of movies as a similarity test?
Which can work because the encoding methods can indicate closeness of meaning.
And that’s why this isn’t running an llm in any way.
- Comment on What type of computer setup would one need to run ai locally? 3 months ago:
I’ve run koboldcpp on a steam deck. You have to stick to small model files, of course, like maybe 4Gb, but you can get decent speed if you do.