Comment on Pollsters Are questioning AI Instead of Real People

mhague@lemmy.world ⁨2⁩ ⁨days⁩ ago

It would be interesting if they knew how to use LLMs. If I wanted output based on a middle class old white woman I would put effort into capturing that person in tone and style. Not just prompt with “respond like a old white woman please” It’s like they don’t yet grasp how to structure the landscape around their target output for the LLM to latch onto.

They should also consider that there’s a difference between a human saying something for another human to hear, and a human having a belief. There’s a fundamental gap between “what does this white woman think?” and a white woman telling a survey in public that she approves/disapproves of Trump.

Asking an LLM to respond in such a way, using such sterile tone… it just completely fails to capture the nuance I (naively) expected them to account for.

source
Sort:hotnewtop