Portkey and Solid Raise Funds for Production AI Infrastructure
Two startups have secured funding to address the challenges of running AI in production. Portkey raised a $15M Series A for its AI gateway, which acts as a unified control plane for governance, observability, and cost management. Solid launched with $20M in seed funding to automate the creation of "context graphs," ensuring enterprise AI operates with consistent, up-to-date knowledge.
- Portkey's AI gateway operates as a containerized workload using Helm charts for Kubernetes, offering a secure hybrid deployment where the data plane runs within a customer's VPC while Portkey hosts the control plane for administration and analytics. This architecture is designed for high throughput, processing over 500 billion LLM tokens across 125 million daily requests for clients like Postman and Snorkel AI. The platform provides features like automatic retries, provider failover, and caching to enhance the reliability of AI applications. - Solid's "context graph" extends the concept of a static enterprise knowledge graph by incorporating live data, events, and system states to reflect how a business operates in real-time. This allows AI agents to reason with current information rather than historical snapshots, which is critical for operational tasks. The platform aims to automate the creation and maintenance of this business context, addressing how metrics and definitions vary across teams and tools. - For insurtech applications, this technology can directly impact claims processing and underwriting by providing AI systems with a unified, real-time understanding of data. This can reduce the time underwriters spend on administrative tasks, which can be up to 40% of their time, and speed up claim settlement times, a key factor in customer satisfaction. AI can assist in everything from intelligent document processing of claims to ensuring underwriting processes adhere to the latest compliance regulations. - The founders of Solid, CEO Yoni Leitersdorf and CTO Tal Segalov, are alumni of Israel's Unit 8200 and this is Leitersdorf's second entrepreneurial venture after selling his previous company, Indeni. The $20M seed round was led by Team8 and SignalFire, an unusually large amount for a seed round, which the founders attribute to the significant market potential. - Portkey's Series A funding was led by Elevation Capital with participation from Lightspeed, which also led its $3 million seed round in August 2023. The new capital is aimed at enhancing support for agent-driven systems by improving controls around permissions, identity, and budget management. - From a system design perspective, Portkey functions as an API gateway specifically for LLMs, routing traffic to different models and managing tasks like caching and fallbacks, analogous to how an API gateway manages microservices. Solid's context graph addresses a core challenge in agentic AI: providing agents with reliable, shared context to act upon, which is a prerequisite for moving beyond advisory AI to operational AI that can execute tasks. - The development of multi-agent AI systems, which both Portkey and Solid enable, often follows design patterns like orchestrator-worker, hierarchical, or blackboard models to manage complexity. Frameworks such as LangChain, Microsoft's Agent Framework, and DSPy provide structured ways to build these systems, but the underlying challenge of maintaining a consistent state and context, which Solid addresses, is crucial for reliability. The choice of a single agent versus a multi-agent architecture depends on the complexity of the task, with multi-agent systems being better suited for problems that can be broken down into specialized sub-tasks.
