Technology

The watermark is in the word choice, it's not in hidden characters or Unicode characters.

Sell access to Turnitin and the likes for a small fortune. They are all but required to pay whatever the price is.

I thought the article explained that pretty reasonably on a scale of probability and weight. The longer the text, the more reliable the scoring.

95% AI text agree. It reeks.

do to identify AI text — it has lots of tells anyway

I see what you did there.

That's how AI testers work and its why they don't. Most forms of formal writing are predictable by design. If the AI can predict predictable formulaic writing, it doesn't mean its AI, its probably just any form of professional writing other than fiction.

Famous public domain works will always be considered AI by those tests, because of course your LLM knows the american national constitution. It was in the training data, so it can predict it with 100% accuracy, therefore your test wrongly calls it AI.

Testing for AI writing that way does not work.

That's one of the things that frustrates me most about this whole AI thing. I fucking hate it and I want it to die, I wish it were never created in the first place. But from a tech enthusiast and a maths nerd point of view, it is super interesting.

Like the performance of these models is shit compared to a real person doing actual work. But if we think about what we are doing on a basic level, the performance is way beyond what I would expect it to be. I wouldn't expect it to be able to form a coherent sentence or scale as well as it does (even though the resources required to run these is still very high).

It could have been really cool shit people did studies on and played around with to explore the math. Cool little play models we could let go on a bunch of data and see what it did and how. Something for a small group of nerds and experts who are into that kind of thing, for the sake of learning and nothing else.

But no, somehow it got transmorphed into "AI". And marketed like this actual learning almost sentient computer system that can replace all workers. You can ask it anything and it will give PhD level expert answers. Oh and it's run by a handful of the most vile men imaginable who pour all of the world's money and resources into it, all so they get to be god emperor of the world. Fucking terrible.

AI isn't evil. Generative AI isn't evil. AI has existed for 20+ years now, I studied it back in my uni days.

Corporations, how they trained it, how they use it now, how they are willing to pave the planet to force it down our throats is evil.

This is one of those things as tech people we have to come to terms with and understand. No technology is inherently good or evil, it's what people do with it.

The goal is to ensure that they don’t inbreed their models, not fix the problems they’ve caused.

with enough text, you will see that certain words are used more often

Which is also a thing humans do.

Yeah, they can't easily rotate keys, because the text can't tell you which key was used.

They could switch to a new key e.g. every month and then just check every previous key during detection. But that would slowly increase the likelihood of false positives, so no idea if that's a good idea either.

It works for them not scraping their own slop back into training data. I assume that is actually the real purpose of the system. They don't want to share the key with the public. But they probably will with other llm companies in exchange for theirs.