Comment on Barack Obama: “For elevator music, AI is going to work fine. Music like Bob Dylan or Stevie Wonder, that's different”

• kromem@lemmy.world ⁨1⁩ ⁨year⁩ ago

  At this point I want a calendar of at what date people say “AI could never” - like “AI could never explain why a joke it’s never seen before is funny” (such as March 2019) - and at what date it happens (in that case April 2022).

  (That “explaining the joke” bit is actually what prompted Hinton to quit and switch to worrying about AGI sooner than expected.)

  I’d be wary of betting against neural networks, especially if you only have a casual understanding of them.

  source

  • rambaroo@lemmy.world ⁨1⁩ ⁨year⁩ ago

    I mean the limitations of LLMs are very well documented, they aren’t going to advance a whole lot more without huge leaps in computing technology. There are limits on how much context they can store for example, so you aren’t going to have AIs writing long epic stories without human intervention. And they’re fundamentally incapable of originality.

    General AI is another thing altogether that we’re still very far away from.

    source

    • kromem@lemmy.world ⁨11⁩ ⁨months⁩ ago

      Nearly everything you wrote is incorrect.

      As an example, rolling context windows paired with RAG would easily allow for building an implementation of LLMs capable of writing long stories.

      And I’m not sure where you got the idea that they were fundamentally incapable of originality. This part in particular tells me you really don’t know how the tech is working.

      source