this post was submitted on 23 Apr 2026
176 points (94.9% liked)

Technology

84143 readers
2434 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
176
Anthropic Mythos shaping up as nothingburger (www.theregister.com)
submitted 3 days ago by HaraldvonBlauzahn@feddit.org to c/technology@lemmy.world
38 comments fedilink hide all child comments
 

cross-posted from: https://feddit.org/post/28915273

[...]

That marketing may have outstripped reality. Early reports from Mythos preview users including AWS and Mozilla indicate that while the model is very good and very fast at finding vulnerabilities, and requires less hands-on guidance from security engineers - making it a welcome time-saver for the human teams - it has yet to eclipse human security researchers.

"So far we've found no category or complexity of vulnerability that humans can find that this model can't," Mozilla CTO Bobby Holley said, after revealing that Mythos found 271 vulnerabilities in Firefox 150. Then he added: "We also haven't seen any bugs that couldn't have been found by an elite human researcher." In other words, it's like adding an automated security researcher to your team. Not a zero-day machine that's too dangerous for the world.

you are viewing a single comment's thread
view the rest of the comments
[–] jj4211@lemmy.world 2 points 2 days ago (1 children)

LLMs can be useful in this context, but Anthropic blew Mythos way way out of proportion. It absolutely was overly hyped.

Their own demonstrator had to work with a downlevel firefox so it would still have vulnerabilities that were already fixed before they even started.

It seems that their narrative is that other tools, some LLM and some not may be as good or better than Mythos at finding issues, but there were a couple of issues where Mythos was able to actually create a demonstrator, which the other models did not do. Which is relatively less interesting, as a human going from finding to demonstrator is generally not a huge part of the tedium, the tedium usually is in the finding.

They pitched it as "it is dangerous, it will escape confinement", etc etc. But instead they had to explicitly start with a downlevel firefox with known vulnerabilities unpatched and they further had to disable all the security mitigations that in practice had already made the two "vulnerabilities" impossible to exploit.

It's a matter of degree and exaggeration.

[–] General_Effort@lemmy.world 1 points 2 days ago

Their own demonstrator had to work with a downlevel firefox so it would still have vulnerabilities that were already fixed before they even started.

Or as they put it, they turned Firefox 147 in an evaluation.

They pitched it as “it is dangerous, it will escape confinement”, etc etc.

I admit that I didn't study their marketing materials, but that sounds kinda off. Maybe something got garbled?