Places like cloudflare and akamai are already using machine learning algorithms to detect bot traffic at a network level. You need to use similar machine learning to evade them. And since most of these scrapers are for AI companies I’d expect a lot of the scrapers to be LLM generated.
Kyrgizion@lemmy.world 6 days ago
Eventually we’ll have “defensive” and “offensive” llm’s managing all kinds of electronic warfare automatically, effectively nullifying each other.
sudo@programming.dev 6 days ago
ChaoticNeutralCzech@feddit.org 6 days ago
Obligatory AI ≠ LLM. How would scrapers benefit from the LLMs they help train? The defense is obvious, LLM-generated slop traps against scrapers already exist.
ProdigalFrog@slrpnk.net 6 days ago
That’s actually a major plot point in Cyberpunk 2077. There’s thousands of rogue AI’s on the net that are constantly bombarding a giant firewall protecting the main net and everything connected to it from being taken over by the AI.
Klear@quokk.au 6 days ago
The game is an excellent documentary.
archchan@lemmy.ml 6 days ago
Not to mention the firewall is itself an AI.
Track_Shovel@slrpnk.net 6 days ago
Unrelated, but I saw this headline, and could hear both you and squidward swearing from here.
ProdigalFrog@slrpnk.net 5 days ago
It doesn’t bode well. Honestly I fear at some point in the future, if these countermeasures can’t keep up, small sites may need to close themselves off with invite-only access. Hopefully that’s quite a distant future.