Toronto is Canadian New York. It wants to be the capital and probably should be but it doesn’t speak enough French.
Comment on Bill Gates feels Generative AI has plateaued, says GPT-5 will not be any better
grabyourmotherskeys@lemmy.world 6 months agoAnother way to think of this is feedback from humans will refine results. If enough people tell it that Toronto is not the capital of Canada it will start biasing toward Ottawa, for example. I have a feeling this is behind the search engine roll out.
Toes@ani.social 6 months ago
raptir@lemdro.id 6 months ago
ChatGPT doesn’t learn like that though, does it? I thought it was “static” with its training data.
grabyourmotherskeys@lemmy.world 6 months ago
I was speculating about how you can overcome hallucinations, etc., by supplying additional training data. Not specific to ChatGPT or even LLMs…
HiggsBroson@lemmy.world 6 months ago
You can finetune LLMs using smaller datasets, or with RLHF (reinforcement learning from human feedback) wherein people can give ratings to responses and the model can be either “rewarded” or “penalized” based off of the ratings for a given output. This retrains the LLM to produce outputs that people prefer.
niisyth@lemmy.ca 6 months ago
Active Learning Models. Though public exposure can eaily fuck it up, without adult supervision. With proper supervision though, there’s promise.
BearOfaTime@lemm.ee 6 months ago
So it will always have the biases of the supervisors