US Government Bans AI Firm Anthropic

The standoff escalated over Anthropic's refusal to remove safeguards preventing its AI, Claude, from being used for domestic mass surveillance and fully autonomous weapons. The company stated it "cannot in good conscience accede" to the Pentagon's demands for unrestricted use of its technology for all "lawful purposes." Anthropic argued that current AI is not reliable enough for fully autonomous lethal decisions and that mass surveillance of Americans poses "serious, novel risks to fundamental liberties." The "supply risk" designation is a significant move, typically reserved for companies from adversarial nations like China. Anthropic has called the designation "legally unsound" and an "unprecedented action" against an American company, vowing to challenge it in court. The designation could bar tens of thousands of military contractors from using Anthropic's technology in their work for the Pentagon. The ban terminates a contract with a ceiling of up to $200 million for Anthropic to develop prototype AI capabilities for national security. While this represents a fraction of Anthropic's $14 billion in revenue, the broader implications of being blacklisted could be substantial. There is a six-month phase-out period for the Department of Defense and other agencies already using Anthropic's products. The decision has divided Silicon Valley. OpenAI's CEO Sam Altman publicly supported Anthropic's safety principles, even as his company secured the new Pentagon deal. Hundreds of employees from Google and OpenAI signed an open letter in solidarity with Anthropic. However, Elon Musk, CEO of the competing AI firm xAI, backed the Trump administration's stance. The move has also drawn criticism from civil liberties groups and some lawmakers. The Electronic Frontier Foundation urged Anthropic to "stick by their principles," arguing that tech companies should not be bullied into enabling surveillance. Democratic Senator Mark Warner expressed "serious concerns about whether national security decisions are being driven by careful analysis or political considerations." In contrast, some Republican lawmakers have supported the administration's position, emphasizing the need for the military to have unrestricted access to technology for national security. The new agreement with OpenAI reportedly includes similar "red lines" to what Anthropic had advocated for, prohibiting domestic mass surveillance and requiring human responsibility for the use of force. OpenAI's Sam Altman stated that the Department of Defense agreed to these principles and that they are reflected in their agreement. The Pentagon has not clarified what distinguishes the terms of the OpenAI deal from those rejected by Anthropic.