Comment on What's up, selfhosters? It's self hosting Sunday!

<- View Parent
Bluefruit@lemmy.world ⁨2⁩ ⁨days⁩ ago

Thats why i was considering training my own model if possible. Ive been toying around with kobold.CPP and gpt4all which both have RAG implementations.

My idea is to essentially chat with documentation and as a separate use case, have it potentially be a AI search engine but locally hosted. I do still prefer to search myself, but fuck man, searches have gotten so bad, and the kobold.CPP web lookup feature was pretty neat IMO.

So yea you’re not wrong, I’m just hoping that if in train it and or give it documentation it can reference when answering, it will be suitable. Mostly AI has been good for me as kind of a rubber ducky when troubleshooting and helping me search for things when I have some specific question and in don’t want “top 5 things vaguely related to your question” results.

source
Sort:hotnewtop