US Treasury Halts Use of Claude AI

In a notable move for AI in government, the U.S. Treasury has terminated its use of Anthropic's Claude AI. The decision highlights the ongoing tension between leveraging private AI innovation and protecting the public interest, signaling a cautious approach to integrating large language models in sensitive government operations.

The termination of the Treasury's Claude AI contract stems from a wider dispute between Anthropic and the Pentagon over "red lines" in AI usage. Anthropic refused to grant the military unconditional use of its models, specifically prohibiting their deployment for mass surveillance or in fully autonomous weapons systems, leading to a government-wide directive to cease using the company's technology. This clash highlights a core tension in GovTech: leveraging private sector innovation while upholding public service values and ethics. The government's move to blacklist Anthropic as a "supply chain risk" signals a hardline stance, prioritizing operational flexibility over provider-imposed ethical guardrails, a development with significant implications for future public-private AI partnerships. Across Europe, governments are also navigating the complexities of AI adoption, but often with a different emphasis. Estonia's "Bürokratt" program, for example, uses a network of AI solutions to create proactive, personalized public services based on life events, aiming for a "zero bureaucracy" user experience. This service design approach saves citizens an estimated 1.4 million hours annually by automating and pre-filling applications for everything from school enrollment to business licenses. For UX designers in the public sector, the focus is shifting toward human-centered AI and proactive service delivery. This involves moving beyond simple chatbots to create integrated "AI service hubs" that can complete entire transactions. The goal is to design seamless, accessible, and equitable user journeys, a challenge that requires deep user research and a focus on inclusive design from the outset. The European Union's AI Act establishes a regulatory framework that directly impacts the design of these services. It classifies AI systems by risk, imposing strict requirements on "high-risk" applications common in the public sector, such as those used for determining access to benefits, education, or essential services. This regulation mandates human oversight, transparency, and robust data governance, shaping the design constraints for public-facing AI. Digital accessibility is a critical and legally mandated component of AI implementation in government. AI-powered tools offer new ways to enhance accessibility, from real-time speech-to-text and audio descriptions to identifying accessible routes for users with mobility impairments. However, designers must also ensure the AI interfaces themselves are compliant with WCAG standards, providing features like keyboard navigation and proper markup for assistive technologies. The rise of AI is also transforming the UX workflow itself within public agencies. AI tools are increasingly used to automate and analyze user research, summarize data, and generate reports, freeing up designers to focus on more complex strategic challenges. This shift requires new skills in prompt engineering and the critical evaluation of AI-generated outputs to ensure they are free from bias and align with user needs. Ultimately, the success of AI in government hinges on trust. For UX and service designers, this means creating systems that are not only efficient but also transparent, fair, and accountable. This involves clearly communicating when AI is being used, providing users with control over their data and AI-driven interactions, and co-designing solutions with the communities they serve to build confidence and ensure the technology meets real-world needs.

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.