Comment on GenAI tools are acting more ‘alive’ than ever; they blackmail people, replicate, and escape
hisao@ani.social 1 week agoand the resource it’s concerned about is how long a human engages.
Why do you think models are trained like this? To my knowledge most LLMs are trained on giant corpuses of data scraped from internet, and engagement as a goal or a metric isn’t in any way embedded inherently in such data. It is certainly possible to train AI for engagement but that requires completely different approach: they will have to gather giant corpus of interactions with AI and use that as a training data. Even if new OpenAI models use all the chats of previous models in training data with engagement as a metric to optimize, it’s still a tiny fraction of their training set.
givesomefucks@lemmy.world 1 week ago
www.sciencedirect.com/…/S0268401225000507
But just in general…
This is America, you think any of this tech companies wouldn’t try to maximize engagement?
That’s just wild in 2025 bro