Comment on ChatGPT's new AI store is struggling to keep a lid on all the AI girlfriends

<- View Parent
Killer_Tree@sh.itjust.works ⁨5⁩ ⁨months⁩ ago

Exactly! If you only want to use a Large Language Model (LLM) to run your own local chatbot, then using a quantized version will dramatically improve speed and performance. It also allows consumer hardware to run larger models which would otherwise be prohibitively resource intensive.

source
Sort:hotnewtop