Bangalore LLMOps Startup Portkey Raises $15M
Portkey, a Bangalore-based LLMOps startup, has raised $15 million in a funding round led by Elevation Capital with participation from Lightspeed. The company provides operational tooling for engineering teams to manage, monitor, and control costs for large language model deployments. Portkey's initial customers were large Indian enterprises, acquired through direct technical outreach and pilot integrations.
- The company was co-founded in 2023 by Rohit Agarwal and Ayush Garg. This recent $15 million Series A round follows a $3 million seed round led by Lightspeed in August 2023. - Portkey's platform functions as an AI gateway and control plane, allowing engineering teams to integrate with over 250 large language models through a unified API. This enables features like load balancing across multiple providers, automatic retries, and fallbacks to ensure application reliability. - Key product features include observability tools that provide over 40 metrics for monitoring cost, latency, and quality, as well as a semantic caching feature designed to reduce redundant API calls and cut costs by up to 50%. - The startup reports significant traction, processing over 500 billion LLM tokens across 125 million daily requests and managing over $500,000 in daily AI spending for more than 24,000 organizations globally. - Portkey's client roster includes notable AI-first companies like Postman and Snorkel AI. - To encourage early adoption, Portkey has made its core enterprise AI gateway available for free, aiming to lower the barrier for teams to implement governance and observability from the beginning of their AI development lifecycle. - The fresh capital is earmarked for expanding its AI control plane's capabilities, particularly to enhance support for more complex, agent-based AI systems with additional controls for permissions, identity, and budget management. - The LLMOps market is experiencing rapid growth, with forecasts projecting the global market size to reach over $8.7 billion by 2033, driven by the increasing enterprise adoption of generative AI.
