OpenRouter COO on AI Infrastructure at Scale
Chris Clark, COO of OpenRouter, shared operational lessons from managing the AI gateway, which processes a trillion tokens daily across over 70 providers. He emphasized that scalable infrastructure is a key competitive moat in agentic SaaS. The data also suggests that usage-based pricing models are superior to flat subscriptions for AI-intensive applications.
- OpenRouter's business model is built on a 5% commission on customer spending for processing AI model requests, a model that has seen the company's annualized revenue grow from $1 million to $5 million in 2025. This growth is fueled by processing over $100 million in annualized inference spend. - The company was co-founded by CEO Alex Atallah, previously the co-founder and CTO of the NFT marketplace OpenSea. Atallah left OpenSea in 2022 to found OpenRouter in 2023, applying a similar "aggregation layer" strategy to the fragmented AI model market as he did with NFTs. - In 2025, OpenRouter raised a total of $40 million in funding over two rounds, with a seed round led by Andreessen Horowitz and a Series A led by Menlo Ventures, resulting in a valuation of approximately $500 million. - Data from a 100 trillion token study by OpenRouter reveals that programming-related queries have surged to become a dominant use case, growing from about 11% of total token volume in early 2025 to over 50% by the end of the year. This reflects a significant shift towards using AI for code generation and development workflows. - The same study shows a diversification in model usage, with open-source models from Chinese developers like DeepSeek and Qwen gaining significant market share, reaching nearly 30% of total usage in some weeks. This challenges the early dominance of proprietary models. - The market for agentic AI is expanding rapidly, with Gartner projecting that 33% of enterprise software applications will include agentic AI by 2028, a significant increase from less than 1% in 2024. - The move to usage-based pricing is accelerating in the SaaS industry, with 63% of companies now having some form of this model. A 2025 survey showed that 78% of companies with usage-based pricing adopted it within the last five years. - OpenRouter's main competitors are not just other universal API providers like Portkey and Martian, but also the major cloud hyperscalers such as AWS Bedrock, Google Vertex AI, and Azure OpenAI Service, which bundle multiple AI models within their existing cloud ecosystems.
