Comment on OpenAI Says It's Scanning Users' ChatGPT Conversations and Reporting Content to the Police

• brucethemoose@lemmy.world ⁨2⁩ ⁨days⁩ ago

  I am on mobile and can be more detailed later, but the jist is to sign up (with a credit card) to some API service. There are many. Some neat ones include:

  • Openrouter (a gateway to many, many models)
  • Cerebras API (which is faster than anything and has a generous free tier)
  • Google Gemini, which is free to just try this out on with no credit card.

  Most (in exchanges for charging pennies for each request) do not log your prompts. If you are really, really concerned, you can even rent your own GPU instance on demand.

  Anyway, they will give you a key, which is basically a password.

  Paste that key into the LLM frontend of your choice, like Open Web UI, LM Studio, or even web apps like:

  • lite.koboldai.net

  • agnai.chat

  source

  • ArmchairAce1944@discuss.online ⁨2⁩ ⁨days⁩ ago

    Damn! That is good shit! I’ll definitely look into it.

    source

    • brucethemoose@lemmy.world ⁨2⁩ ⁨days⁩ ago

      Also, I’m going to plug the AI Horde, which is basically the Fediverse for AI self hosting: aihorde.net

      Ping me, and I can host a medium-sized model to try for free on my humble 3090 (via those linked web UIs), if you want. The options are limitless, from something STEM-focused like Nemotrom 49B, to dungeonmaster finetunes, to horny as heck roleplaying models, lol.

      source