Comment on OopsGPT - OpenAI just announced a new search tool. Its demo already got something wrong.

<- View Parent
hendrik@palaver.p3x.de ⁨1⁩ ⁨month⁩ ago

I've heard people saying that before. But it's not true. You can ask an AI to draw you an astronaut on a horse and it'll do it despite never having seen such picture. (Now it has.) Same applies to LLMs. They come up with an answer to your exact question. Not a similar one it saw on Reddit before. That answer might be wrong (which is my point) but if you try it, you'll regularly find it tries answering your questions and not different ones.

I've also tried some scifi storywriting with AI and there it becomes quite obvious that it's able to apply things it knows from different contexts and apply that to my setting. Like ethics questions, basic physics and what character can and cannot do. Rough knowledge about how stories are written. You can tell it to do a plot twist an an arbitrary point and it'll do. All of that is knowledge about (abstract) knowledge and the ability to apply it to different contexts. Which is an important part of creativity.

And I've read papers where the scientists try to look inside of AI and they are able to spot abstract concepts like what a cat is in the weights. It's fascinating how it works. And it turns out it's not just regurgitating it's training data. Which isn't surprising because a lot of effort has been put into the computer science behind it to make AI more than that. And it's also why they're useful in the first place.

source
Sort:hotnewtop