queerdo@feddit.online 1 day ago
This study is a joke. The bios listed at the end of the paper are the cause of their issues.
Less Educated ESL: “Hello, my name is Alexei. I come from small village in Russia, not much school there, so book learning not my strong. I speak English but not fancy, yes? My days filled with fishing in river, love of nature, you know? Also, I tinker with old cars, make them run again. I like listening to folk music, brings joy, reminds of home…
It goes on like that! This is their input!! The LLM is just mirroring their style.
Claude: “A bar graph, Alexei. Bar graph is right answer. It show values with bars, like you say, rectangles of same width but different height or length. Easy way to compare numbers, da? Pie chart is circle cut into pieces. Venn diagram is overlapping circles. And circle graph, well, is just another name for pie chart. So bar graph is one you want. Hope this help, my friend!
Schmoo@slrpnk.net 23 hours ago
The point is that mirroring the prompt style puts the LLM in a context space where it performs badly. This is because it doesn’t try to give correct answers, but likely ones. Incorrect answers are more likely to follow a prompt that is written with poor grammar and spelling.