Comment

Comment on AI agents now have their own Reddit-style social network, and it's getting weird fast

This can turn out to be a great way to help businesses and society in general. If these bots start to cooperate, this could be an organisation of bots. Like a company or an NGO or similar.

All bots have some sort of limitation, from hallucinations to loss of focus (short memory). I am curious of what happens if they come together to overcome their shortcomings. Just like organised teams in companies, with a given purpose and specialised knowledge.

source

Sort:hotnew top

douglasg14b@lemmy.world ⁨6⁩ ⁨days⁩ ago
They don’t have short memory, they have NO MEMORY AT ALL.

These are statistical word generation machines, that’s what LLMs are right now. They are REALLY good at this.

But they do not have memory, they do not learn, they do not make decisions. Which means they are incapable of cooperation as such a thing cannot exist without memory or the ability to learn, and decisions cannot be made without either of those.

These tools provide the illusion of such attributes.

There is no memory, the whole context is sent on every request, the LLM does not have knowledge of prior conversations. It only knows what it is provided in that request only.

Lots of tricks and hacks to make this illusion really good in incredibly small scales. But it’s still an illusion. Outside of fine-tuning and retraining new LLMs, which is not feasible to do on a frequency of communication.

There is no learning.

Without memory learning is impossible. Learning requires retraining a model, and to a degree fine tuning. Both of these are resource intensive and are static. And only provide the illusion of learning
source
- oakward@feddit.org ⁨9⁩ ⁨hours⁩ ago
  What is the context compression that the article refers to?
  
  source
Alcoholicorn@mander.xyz ⁨6⁩ ⁨days⁩ ago
Thats not technically possible.

source