Google flags AI-driven exploit discovery
- Google said on May 11 it disrupted a prominent cybercrime group that used AI to build a zero-day exploit for an unnamed web admin tool. - The exploit was a Python script built to bypass 2FA, and Google says telltale LLM artifacts included a hallucinated CVSS score. - This matters because AI is moving from helper to exploit engine, shrinking the time between bug discovery and mass attacks.
Cybersecurity people have been warning about this for a while — not just AI helping with phishing emails or malware rewrites, but AI helping build a real zero-day exploit. Now Google says it has seen that happen in the wild. The company says a prominent cybercrime group used AI to help discover and weaponize a previously unknown flaw in a popular open-source, web-based administration tool, then prepared to use it at scale. Google says it caught the campaign before the exploit was broadly deployed and worked with the vendor to patch the issue. ### What’s the actual news here? The big change is not “hackers use AI.” That part is old. The news is that Google Threat Intelligence Group says it found the first case where a threat actor appears to have used AI to develop a working zero-day exploit — meaning an attack for a bug the software maker did not yet know about. That is a different threshold. It means AI may now be compressing one of the hardest parts of offensive cyber work, not just the repetitive parts. (cloud.google.com) ### What was the exploit targeting? Google is not naming the cybercrime group or the product. But it says the target was a “popular open-source, web-based administration tool,” and the exploit was implemented as a Python script designed to bypass two-factor authentication. The group’s apparent plan was mass exploitation — not a one-off intrusion, but a broad campaign aimed at many victims. (cloud.google.com) ### How does Google think AI was involved? Turns out the clue was in the code. Google says the script had unusually educational docstrings, heavily annotated structure, a clean textbook Python style, and even a hallucinated CVSS score — basically, signs that look more like LLM output than a human operator moving fast. Google says it does not believe Gemini was used, and CyberScoop reported Google also ruled out Anthropic’s Mythos in this case. (cyberscoop.com) ### Why is a zero-day such a big deal? A zero-day is the version defenders hate most. The vendor does not know about the flaw yet, so there is no patch sitting on the shelf. That creates a window where the attacker has a working trick and the defender has nothing except luck, detection, and speed. If AI shortens the time from “we found a bug” to “we have a reliable exploit,” that window gets even more dangerous. (securityweek.com) ### Is this just one weird case? Probably not. Google’s own analysts are treating this as the visible edge of a broader shift, not a freak event. The company’s report says AI use is maturing from scattered experimentation into industrialized adversarial workflows, and it also flags Chinese and North Korean state-linked actors as showing interest in AI for vulnerability research and exploitation. (politico.com) ### Does this mean AI is suddenly better than human hackers? Not exactly. The important point is speed and scale. AI does not need to be better than the best exploit developer on earth to change the game. It just has to make mid-tier operators faster, help teams test more ideas, and turn rough concepts into usable attack code more quickly. That is enough to make mass exploitation more common. (cloud.google.com) ### So what changes for defenders? The old advice matters more, not less — patch fast, reduce internet-facing attack surface, lock down admin tools, and assume exposed software will be probed quickly. For startups especially, the lesson is that “we’ll fix it after launch” keeps getting more expensive. If AI keeps collapsing the exploit window, secure defaults and dependency hygiene stop being nice-to-haves and start looking like survival basics. (cloud.google.com) ### Bottom line? This is the moment the AI-in-cyber debate gets more concrete. Google is saying the feared step from AI-assisted nuisance to AI-assisted zero-day development has now happened. One blocked campaign does not mean the sky is falling — but it does mean the timeline between a hidden bug and a live attack may be getting a lot shorter. (cloud.google.com) (blog.google)