whaleross@lemmy.world 2 days ago
I know that the current generation of LLM have a language agnostic knowledge base, which is damn awesome, but I don’t know how the language layer works.
whaleross@lemmy.world 2 days ago
I know that the current generation of LLM have a language agnostic knowledge base, which is damn awesome, but I don’t know how the language layer works.
Reshirams_Rad_Slam@mastodo.neoliber.al 2 days ago
@whaleross what does that agnosticism mean? Don't you need to store that knowledge somehow in say maybe a language?
whaleross@lemmy.world 1 day ago
Yeah but not one “master” language. All knowledge it can relate across languages is available in all languages. LLM (and computers) don’t care about the data, they just process it. Humans would translate it and compile it in ordered encyclopedia. For LLM it is all just an insane number of references and cross references all over that is available from anywhere that the link has been established. The input/output of desired language and formulation and whatever is a different part of it.
As far as I understand it.
Reshirams_Rad_Slam@mastodo.neoliber.al 1 day ago
@whaleross but those references would be in a language, wouldn't it? Unfortunately I can't test it since I don't think the most obscure language I know is obscure enough