Comment on A cheat sheet for why using ChatGPT is not bad for the environment

NeilBru@lemmy.world ⁨1⁩ ⁨month⁩ ago

• AcesFullOfKings@feddit.uk ⁨1⁩ ⁨month⁩ ago

  [deleted]

  source

  • NeilBru@lemmy.world ⁨1⁩ ⁨month⁩ ago

    Oof, ok, my apologies.

    I am, admittedly,0 “GPU rich”; I have at ~48GB of VRAM at my disposal on my main workstation, and 24GB on my gaming rig. Thus, I am using Q8 and Q6_L quantized GGUFs.

    Naturally, my experience with the “fidelity” of my LLM models re: hallucinations would be better.

    source
• anus@lemmy.world ⁨1⁩ ⁨month⁩ ago

  I actually think that (presently) self hosted LLMs are much worse for hallucination

  source