Microsoft and Amazon Build Out Agentic Infrastructure
Major cloud providers are developing dedicated infrastructure for enterprise-grade AI agents. Microsoft is investing in platforms for "stateful, secure, and scalable agents," including DevOps copilots. Amazon's Bedrock AgentCore is being positioned as a solution for the "Day 2" problems of agent deployment, focusing on integrating with enterprise security, governance, and monitoring systems for regulated industries.
- Amazon's Bedrock AgentCore is designed to be framework- and model-agnostic, supporting open-source agent frameworks like CrewAI, LangGraph, and LlamaIndex, allowing developers to use foundation models from within or outside of the AWS ecosystem. - Microsoft’s strategy centers on deep ecosystem integration with its Azure AI Foundry (now Microsoft Foundry) Agent Service, which focuses on seamless connectivity with Microsoft 365, Teams, and SharePoint and supports connections to over 1,400 enterprise data sources. - For governance, Amazon introduced "Policy" in AgentCore, which allows teams to set boundaries for agents in natural language that are then translated into Cedar, AWS's open-source policy language, to block unauthorized actions in real-time. - Microsoft is addressing agent governance through Microsoft Agent 365, a unified control plane that integrates with its existing security suite to manage agent fleets, using Microsoft Entra for identity, Purview for data security, and Defender for threat protection. - To enhance agent capabilities, Amazon provides built-in tools like AgentCore Browser Tool, a secure cloud-based browser for web interaction, and Code Interpreter, which allows agents to write and execute code in isolated sandbox environments. - Microsoft has evolved GitHub Copilot into an autonomous agent capable of tasks like fixing bugs and launching virtual machines, and has unified its developer SDKs, Semantic Kernel and AutoGen, into a single open-source Microsoft Agent Framework. - Both platforms have built for enterprise-grade observability, with Amazon Bedrock AgentCore and the Microsoft Agent Framework providing native support for OpenTelemetry (OTel), allowing integration into existing monitoring stacks like Datadog or New Relic. - The market for this infrastructure is expanding rapidly, with market research firm IDC projecting there will be 1.3 billion AI agents in use by 2028 and Gartner expecting 40% of enterprise applications to have embedded agents by 2026.
