feature

Scammers Built AI's Political Playbook

# Scammers Built AI's Political Playbook A detailed warning post appeared in Reddit's r/Scams this week describing what its author called a "sophisticated Catfish/Bot Farm operation" flooding gaming and anime communities with AI-generated deepfakes. Multiple accounts work together, establishing themselves as authentic community members before funneling victims toward fraudulent OnlyFans accounts. The operation requires no state resources, no advanced technical capabilities—just entrepreneurial fraud exploiting poor detection. If Reddit can't catch cosplay scams in January, it has no chance against political disinformation in November. Detection is collapsing faster than most realize. Botometer, the most widely-used tool for identifying automated accounts, produces between 41% and 76% false positives according to MIT researchers—flagging real humans while missing actual bots. Research from the University of Washington found that LLM-based bots reduced detector performance by 30%. "There's always been an arms race between bot operators and the researchers trying to stop them," lead researcher Shangbin Feng observed. The race is no longer close. Users have reported AI-generated videos of political figures on YouTube escaping platform detection entirely. More than 40 countries representing 1.6 billion people will hold national elections in 2026. The U.S. midterms—which we outlined yesterday as a fight over immigration, the economy, and Trump's second term—will serve as a referendum on Trump's second term. The regulatory response is mismatched to the threat. Nevada's AB 73 requiring deepfake disclosure took effect January 1st. Roughly 20 states have passed similar laws, part of 38 states now regulating AI in various contexts. These mandates assume detection works—that someone will catch manipulated content and trigger enforcement. The cosplay scam reveals the flaw: if platforms can't identify coordinated AI networks in low-stakes environments, political enforcement will be harder, not easier. The DOJ's AI Litigation Task Force faces its establishment deadline January 10th, with Colorado's algorithmic-discrimination statute already flagged for preemption challenges as part of an administration effort to contest state AI laws through the courts. Tomorrow at CES 2026, Trump's science adviser Michael Kratsios will headline the fireside chat on "America's AI Future" we highlighted yesterday—policy ambitions discussed while enforcement reality crumbles in anime forums. The scammers have solved a problem that will serve political operatives well: establishing credibility before deploying malicious content. The cosplay accounts don't immediately push links. They post, comment, build karma, become community members—then pivot to monetization. A political operation would follow the same playbook: months of organic-seeming engagement, then coordinated messaging when it matters most. Geoffrey Hinton recently warned that AI capabilities are doubling roughly every seven months and estimated a 10-20% chance AI becomes an existential threat. The bots targeting anime fans today will look primitive by summer. Some will argue political content receives more scrutiny than cosplay photos. This misunderstands both scale and incentives. Platforms profit from engagement; removing coordinated inauthentic behavior reduces it. The anime scammers generate clicks, comments, traffic—exactly what algorithms reward. Political manipulation will do the same. China's recent introduction of AI emotional manipulation laws—the first to specifically regulate chatbots forming emotional attachments—suggests some governments recognize the threat. But China's approach depends on centralized control Western democracies lack. What should alarm observers is that this infrastructure is being stress-tested at scale with no consequences. Every scam that evades detection teaches operators what works. Every successful conversion validates tactics that will be repurposed for voter suppression and manufactured consensus. The question isn't whether AI-enabled political manipulation is possible—the scammers have already proven it is. The question is whether anyone can stop it. As of January 2026, no one even knows it's happening until victims post warnings on forums most voters will never see.

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.