: Hackpocalypse deferred

[…]

That marketing may have outstripped reality. Early reports from Mythos preview users including AWS and Mozilla indicate that while the model is very good and very fast at finding vulnerabilities, and requires less hands-on guidance from security engineers - making it a welcome time-saver for the human teams - it has yet to eclipse human security researchers.

“So far we’ve found no category or complexity of vulnerability that humans can find that this model can’t,” Mozilla CTO Bobby Holley said, after revealing that Mythos found 271 vulnerabilities in Firefox 150. Then he added: “We also haven’t seen any bugs that couldn’t have been found by an elite human researcher.” In other words, it’s like adding an automated security researcher to your team. Not a zero-day machine that’s too dangerous for the world.

  • theunknownmuncher@lemmy.world
    243·
    3 days ago

    Most all of the reporting about this is purely misinformation. If you actually read the papers that Anthropic published instead of the marketing material, you’ll find that:

    • it was actually claude opus that discovered many of the vulnerabilities, not mythos, which undermines the “MyThOs Is ToO dAnGeRoUs” narrative. All of these capabilities are already out there for anyone to use
    • the researchers guided mythos to the vulnerabilities, not the other way around
    • Quicky@piefed.socialEnglish
      5·
      3 days ago

      That’s actually mentioned in this article tbf.

      Additionally, the “‘thousands of severe vulnerabilities’ extrapolates from 198 manually reviewed reports. The Linux kernel bug was found by Opus 4.6, the public model, not Mythos,” Devansh said.