Comment on AI chatbots tend to choose violence and nuclear strikes in wargames

• MNByChoice@midwest.social ⁨4⁩ ⁨months⁩ ago

  I will read those, but I bet “accidentally good enough to convince many people.” still applies.

  A lot of things from LLM look good to nonexperts, but are full of crap.

  source

  • MNByChoice@midwest.social ⁨4⁩ ⁨months⁩ ago

    …aimodels.fyi/self-rag-improving-the-factual-accu…

    A cool paper. Using the LLM to judge value of new inputs.
    I am always skeptical of summaries of journal articles. Even well meaning people can accidentally distort the conclusions.

    Still LLM is a bullshit generator that can check bullshit level of inputs.

    source
  • MNByChoice@midwest.social ⁨4⁩ ⁨months⁩ ago

    arxiv.org/abs/2310.02207

    2 author paper with interesting evidence. Again, evidence not proof. Wait for the papers that cite this one.

    source
  • MNByChoice@midwest.social ⁨4⁩ ⁨months⁩ ago

    poke-llm-on.github.io

    Reinforcement learning. Cool project. Still no need to “know” anything. I usually play this type of have with short rules and monitoring the current state.

    source
  • MNByChoice@midwest.social ⁨4⁩ ⁨months⁩ ago

    adamkarvonen.github.io/…/chess-world-models.html

    However, this only worked for a model trained on a synthetic dataset of games uniformly sampled from the Othello game tree. They tried the same techniques on a model trained using games played by humans and had poor results. To me, this seemed like a major caveat to the findings of the paper which may limit its real world applicability. We cannot, for example, generate code by uniformly sampling from a code tree.

    source
  • MNByChoice@midwest.social ⁨4⁩ ⁨months⁩ ago

    …aimodels.fyi/researchers-discover-emergent-linea…

    References a 2 author paper. I am not an expert in the field, but it is important to read the papers that reference this one. Those papers will have criticisms that are thought out. In general, fewer authors means less debate between the authors and easier to miss details.

    source
• SlopppyEngineer@lemmy.world ⁨4⁩ ⁨months⁩ ago

  Yes. There is self organization and possibility to self reflection going on in something that wasn’t designed for it. That’s going to spawn a lot more research.

  source