Thatās not true for the commercial aiās. We donāt know what they are doing
Comment on AGI achieved š¤
The_Decryptor@aussie.zone āØ1ā© āØweekā© agoIām not convinced LLMs as they exist today donāt prioritize sources ā if trained naively, sure, but these days they can, for instance, integrate search results, and can update on new information.
Well, it includes the text from the search results in the prompt, itās not actually updating any internal state (the network weights), a new āconversationā starts from scratch.
KeenFlame@feddit.nu āØ1ā© āØweekā© ago
jsomae@lemmy.ml āØ1ā© āØweekā© ago
Yes thatās right, LLMs are context-free. They donāt have internal state. When I say āupdate on new informationā I really mean āwhen new information is available in its context window, its response takes that into account.ā