Comment on Have you tried LocalGPT PrivateGPT or other similar alternatives to ChatGPT?
amzd@kbin.social 10 months agoYou should make sure you are running a model that fits in your vram, for me it runs faster than any online LLM I’ve tried.
Comment on Have you tried LocalGPT PrivateGPT or other similar alternatives to ChatGPT?
amzd@kbin.social 10 months agoYou should make sure you are running a model that fits in your vram, for me it runs faster than any online LLM I’ve tried.