This is a most excellent place for technology news and articles.
Although this looks like a clever approach, a kind of stochastic key, I do not see how this guarantees to distinguish text written by big babble machines versus humans. Humans also have a certain pattern of writing, a given distribution of how some words are more likely to appear than others. How can one tell them really apart?
As an indicator, yeah, might be usable. But I wouldn't read too much into it before seeing results of a study that runs actual tests.
Interesting stuff. My own far less scientific reading of the article itself seems to fittingly suggest it too is largely if not entirely AI generated, which I guess would make sense.
I'm not convinced that they even know 100% how Anthropic is doing it. I can think of an easier way that doesn't corrupt the text: just find a bunch of tokens where there is a good spread of token possibilities, and the more often the most likely one is chosen, the more likely it's AI.
That being said, it doesn't seem much different from what any of us do to identify AI text — it has lots of tells anyway.
do to identify AI text — it has lots of tells anyway
I see what you did there.
That's how AI testers work and its why they don't. Most forms of formal writing are predictable by design. If the AI can predict predictable formulaic writing, it doesn't mean its AI, its probably just any form of professional writing other than fiction.
Famous public domain works will always be considered AI by those tests, because of course your LLM knows the american national constitution. It was in the training data, so it can predict it with 100% accuracy, therefore your test wrongly calls it AI.
Testing for AI writing that way does not work.
The difference between what you describe and what I describe, is that a 100% match isn't a hit. Nor is a 90/7/2/1. You need something with meaningful variability. Even within formal papers there are places where word choice is arbitrary as the article explains.
Of course, you're lacking the context of the full prompt and just feeding in the raw text. Again it gets way more reliable the more text you have.
But it's moot because the more text you have the more tells will sneak in and you probably don't even need an AI checker. Those phrases that AI loves but humans use comparatively rarely. It's not a tell — it's the whole game!
Well shit, that was fuckin’ interesting.
Yes, AI is evil. So is facebook. But the engineering is still interesting.
That's one of the things that frustrates me most about this whole AI thing. I fucking hate it and I want it to die, I wish it were never created in the first place. But from a tech enthusiast and a maths nerd point of view, it is super interesting.
Like the performance of these models is shit compared to a real person doing actual work. But if we think about what we are doing on a basic level, the performance is way beyond what I would expect it to be. I wouldn't expect it to be able to form a coherent sentence or scale as well as it does (even though the resources required to run these is still very high).
It could have been really cool shit people did studies on and played around with to explore the math. Cool little play models we could let go on a bunch of data and see what it did and how. Something for a small group of nerds and experts who are into that kind of thing, for the sake of learning and nothing else.
But no, somehow it got transmorphed into "AI". And marketed like this actual learning almost sentient computer system that can replace all workers. You can ask it anything and it will give PhD level expert answers. Oh and it's run by a handful of the most vile men imaginable who pour all of the world's money and resources into it, all so they get to be god emperor of the world. Fucking terrible.
AI isn't evil. Generative AI isn't evil. AI has existed for 20+ years now, I studied it back in my uni days.
Corporations, how they trained it, how they use it now, how they are willing to pave the planet to force it down our throats is evil.
This is one of those things as tech people we have to come to terms with and understand. No technology is inherently good or evil, it's what people do with it.
Well, yes. You just said AI is evil because capitalism made it evil.
That’s a weird way to agree, but ok.
I’m not saying binary computing is the tool of the devil. Well, maybe Windows.
- Only the key-holder can check. Your teacher, editor, or favourite "AI detector" website cannot run this test; a genuine check needs the provider's secret key, or a checking service the provider runs. Google runs an early-access detector portal for SynthID; Anthropic says detection tooling is forthcoming.
I am not so sure about that. The amounts of words is finite and with enough text, you will see that certain words are used more often, especially in certain combinations. I believe people will brute force this and then create a way to destroy the watermark again.
with enough text, you will see that certain words are used more often
Which is also a thing humans do.
Yeah, they can't easily rotate keys, because the text can't tell you which key was used.
They could switch to a new key e.g. every month and then just check every previous key during detection. But that would slowly increase the likelihood of false positives, so no idea if that's a good idea either.
Assuming a checker tool is public it's enough for a teacher to verify classwork, but AI providers having the sole ability to identify generated content with no way to independently verify is not a real solution.
Plus this site advertises a tool to remove this watermarking, so it can't be that hard to scrub out if you're aware of it.
The goal is to ensure that they don’t inbreed their models, not fix the problems they’ve caused.
This won't fix the inbreeding issue, anyway. The bias is extremely slight, but random, and orthogonal to Claude's own "slop patterns" and tendencies. And theres tons of other LLM content that will end up in their dataset outside their control.
Besides, as much as Claude accusess others of it, everyone's training on everyone else's output and they know it.
I thought declaude would be like degoogle.
Nope, turns out what they do is precisely the opposite. They try to remove those described markers. Real scummy.
Ah, that explains why the article smells like an LLM wrote it.
I think the thing that frustrates me most about AI is that so many people seem to have forgotten that writers exist and wrote huge amounts of text - books, news articles, magazines - for centuries. But now, anytime someone writes a few cogent paragraphs, you get people screaming "AI!!! IT'S AI!!!!!!!".
I know, because it has happened to me.
The article, to me, sounds like a competent author wrote it. Which is representative of a lot of the text LLMs were trained on.
I can't tell you about the text, but the whole site is vibe coded. The CSS, the js, everything. Which doesn't really inspire much confidence on the text, especially as it's explaining how to bypass the claude detector.
Great article. I wonder if the same markers can be used to detect AI generated code (if you suppressed comments).
As, code requires a much more rigid syntax, compared to free flowing docs.
You still have choices.
Variable names are pretty free form.
A switch statement or if/else might be a choice that achieves the same thing. Waffling between them would be highly suspect, since a person isn't going to be so wishy washy. So you could use structural choices too.
AI code tends to look more obviously AI than prose anyway.
And the lower used one might actually be for the “posh” kind.
But it doesn't work. It looks like only the owner of the text generator is able to check if some text is written with this concrete generator (with some probability). I see no use of this technique.
It works for them not scraping their own slop back into training data. I assume that is actually the real purpose of the system. They don't want to share the key with the public. But they probably will with other llm companies in exchange for theirs.
At least copy the work. Even when you had someone else do your homework, you still had to copy what they put down so you don't get caught.
Chortle my balls, #nannythropic
I was not sure how any of this worked, and those interactive demos along with the explanation are quite helpful.
Also a very important point made about this not being a generic AI detector at all, and only being available to the model creator.
