Comment on Please suggest some good self-hostable RAG for my LLM.
brucethemoose@lemmy.world 5 weeks agoText-generation-webui is cool, but also kinda crufty. Honestly a lot of the stuff is holdovers from what’s now ancient history in LLM land, and it has (for me) major performance issues at longer context.
scrubbles@poptalk.scrubbles.tech 5 weeks ago
Anything better you know of? Most of my usage now with it is through its api
brucethemoose@lemmy.world 5 weeks ago
Uh, depends on your hardware and model, but probably TabbyAPI?
scrubbles@poptalk.scrubbles.tech 5 weeks ago
Neat! I’ll check it out!