Comment on Bill Gates feels Generative AI has plateaued, says GPT-5 will not be any better
HiggsBroson@lemmy.world 9 months agoYou can finetune LLMs using smaller datasets, or with RLHF (reinforcement learning from human feedback) wherein people can give ratings to responses and the model can be either “rewarded” or “penalized” based off of the ratings for a given output. This retrains the LLM to produce outputs that people prefer.
niisyth@lemmy.ca 9 months ago
Active Learning Models. Though public exposure can eaily fuck it up, without adult supervision. With proper supervision though, there’s promise.
BearOfaTime@lemm.ee 9 months ago
So it will always have the biases of the supervisors
niisyth@lemmy.ca 9 months ago
Bias is inevitable. Whether it is AI or any other knowledge based system. We just have to be cognizant of it and try to remedy it.