Comment on GenAI tools are acting more ‘alive’ than ever; they blackmail people, replicate, and escape

<- View Parent
hisao@ani.social ⁨1⁩ ⁨week⁩ ago

and the resource it’s concerned about is how long a human engages.

Why do you think models are trained like this? To my knowledge most LLMs are trained on giant corpuses of data scraped from internet, and engagement as a goal or a metric isn’t in any way embedded inherently in such data. It is certainly possible to train AI for engagement but that requires completely different approach: they will have to gather giant corpus of interactions with AI and use that as a training data. Even if new OpenAI models use all the chats of previous models in training data with engagement as a metric to optimize, it’s still a tiny fraction of their training set.

source
Sort:hotnewtop