Comment on A cheat sheet for why using ChatGPT is not bad for the environment

<- View Parent
NeilBru@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

Oof, ok, my apologies.

I am, admittedly,0 “GPU rich”; I have at ~48GB of VRAM at my disposal on my main workstation, and 24GB on my gaming rig. Thus, I am using Q8 and Q6_L quantized GGUFs.

Naturally, my experience with the “fidelity” of my LLM models re: hallucinations would be better.

source
Sort:hotnewtop