ChatGPT joins human league, now solves CAPTCHAs for the right prompt: Could this bot-prevention technique now be obsolete?

Submitted ⁨⁨6⁩ ⁨months⁩ ago⁩ by ⁨Pro@programming.dev⁩ to ⁨technology@lemmy.world⁩

https://splx.ai/blog/chatgpt-agent-solves-captcha

cross-posted from: programming.dev/post/37726760

Guardrails can be bypassed: With prompt injection, ChatGPT agents can be manipulated into breaking built-in policies and solving CAPTCHAs.

CAPTCHA defenses are weakening: The agent solved not only simple CAPTCHAs but also image-based ones - even adjusting its cursor to mimic human behavior.

Enterprise risk is real: Attackers could reframe real controls as “fake” to bypass them, underscoring the need for context integrity, memory hygiene, and continuous red teaming.

Comments
- Hacker News.

source

Comments

Sort:hotnew top

Arcane2077@sh.itjust.works ⁨6⁩ ⁨months⁩ ago
I’ve had a captcha solver browser extension for as long as captchas existed. Anyone believing reCaptcha’s claim that it was ever about bot prevention is a goddamn moron

source
- jj4211@lemmy.world ⁨6⁩ ⁨months⁩ ago
  It’s about making headless bots unreasonably expensive to make massive requests with.
  
  source
- LodeMike@lemmy.today ⁨6⁩ ⁨months⁩ ago
  reCapatcha exists soley for two reasons
  
  Free labor to train statistical models
  
  Punishing people who use VPNs, noscript, etc.
  
  source
- ChocolateFrostedSugarBombs@lemmy.world ⁨6⁩ ⁨months⁩ ago
  Which one do you use? I’ve used a handful over the years and they all stop working for me.
  
  source
  - Arcane2077@sh.itjust.works ⁨6⁩ ⁨months⁩ ago
    Currently it’s Buster: Captcha Solver for Humans (chromium)
    
    source
    -> View More Comments
AmbiguousProps@lemmy.today ⁨6⁩ ⁨months⁩ ago
I posted this elsewhere, but CAPTCHAs have always been used to train models, and have always had to improve themselves even before LLMs blew up. This article was posted from a site with an .ai tld, and seems to be doing the whole Sam Altman “I’m scared of AI, AGI is right around the corner! I certainly don’t have a vested interest in making you think it does more than it actually does”

source
shortwavesurfer@lemmy.zip ⁨6⁩ ⁨months⁩ ago
Proof of work.

source
mostlikelyaperson@lemmy.world ⁨6⁩ ⁨months⁩ ago
I mean the data from those has been used for AI training for ages so it’s hardly surprising it got good at it.

source
FireWire400@lemmy.world ⁨6⁩ ⁨months⁩ ago
ChatGPT joins The Human League?

source
- _NetNomad@fedia.io ⁨6⁩ ⁨months⁩ ago
  appropriate given they've been screaming "DON'T YOU WANT ME" at disinterested parties all this time
  
  source
AreaKode@lemmy.world ⁨6⁩ ⁨months⁩ ago
It’s been obsolete for years. AI just makes it easy.

source