Comment on Judge orders Anna’s Archive to delete scraped data; no one thinks it will comply

• tempest@lemmy.ca ⁨1⁩ ⁨day⁩ ago

  It would make me laugh if they could train an LLM that could only regurgitate content verbatim

  source

  • ilinamorato@lemmy.world ⁨1⁩ ⁨day⁩ ago

    Well, it’s not an LLM, but “AI” doesn’t have a defined meaning, so from that perspective they kind of already did.

    source
  • Dran_Arcana@lemmy.world ⁨1⁩ ⁨day⁩ ago

    en.wikipedia.org/wiki/Markov_chain

    Before the advent of AI, I wrote a slack bot called slackbutt that made Markov chains of random lengths between 2 and 4 out of the chat history of the channel. It was surprisingly coherent. Making an “llm” like that would be trivial.

    source

    • SlurpingPus@lemmy.world ⁨1⁩ ⁨day⁩ ago

      Reddit has at least one sub where the posts and the comments are generated by Markov-chain bots. More than a few times I’ve gotten a post from there in my feed, and read through it confusedly for several minutes before realizing. Iirc it’s called subreddit_simulator.

      source

      • Meron35@lemmy.world ⁨1⁩ ⁨day⁩ ago

        The original subreddit simulator ran on simple Markov chains.

        Subreddit simulator GPT2 used GPT2, and was already so spookily accurate that IIRC its creators specifically said they wouldn’t create one based on GPT3 out of fear that people wouldn’t be able to tell the difference between real and not generated content

        source
  • Natanael@infosec.pub ⁨1⁩ ⁨day⁩ ago

    It’s actually kinda easy. Neural networks are just weirder than usual logic gate circuits. You can program them just the same and insert explicit controlled logic and deterministic behavior.

    The reason that doesn’t work well with a traditional LLM despite the node properties being well known is because of how intricately interwoven and mutually dependent all the different parts of the network is. You can’t just arbitrarily edit anything or insert more nodes or replace logic, you don’t know what you might break. It’s easier to place inserted logic outside of the LLM network and train the model to interact with it (“tool use”).

    source
• panda_abyss@lemmy.ca ⁨1⁩ ⁨day⁩ ago

  We’ve created a state of the art model in recall and training data idempotency!

  source
• UnderpantsWeevil@lemmy.world ⁨1⁩ ⁨day⁩ ago

  If they want to beat the charges, they need to announce their own AI trained on the data several billion in Series A investment funding.

  source
• db2@lemmy.world ⁨2⁩ ⁨days⁩ ago

  I hope they call it FUAI.

  source