Comment on OpenAI has built a text watermarking method to detect chatgpt written content
deadcade@lemmy.deadca.de 5 weeks agoResearch on this topic exists, and it is possible to alter the output of an LLM in minor ways, that statistically “watermark” the results without drastically changing the quality of the output. OpenAI has probably implemented this into ChatGPT.
www.youtube.com/watch?v=2Kx9jbSMZqA
I think the tool exists, and is (at least close to) as good as they claim it is. They can’t release it, because once the public can tell with high accuracy whether ChatGPT wrote some text, another AI can be developed to circumvent detection from this method, making the tool useless.
CameronDev@programming.dev 5 weeks ago
That is a long video, is the paper published somewhere?
Im willing to accept that you can statistically “watermark” the text, but I’m not convinced that it would be tamper resistant, which is a large part of what makes a watermark useful. If it can’t survive an idiot with a thesaurus, its probably not gonna be terribly useful.
Womble@lemmy.world 5 weeks ago
It can likely also be defeated by adding “In the style of X” to a prompt, changing the distribution and pattern of the responses.
JackbyDev@programming.dev 5 weeks ago
…but that output is also from the AI so it would still be watermarked lol
archomrade@midwest.social 5 weeks ago
You could feed it through a different, smaller model that could even be self-hosted. It isn’t difficult to make a model that rephrases an input in another style.