Blackwell GPU spot rents spike
Hourly rental rates for Nvidia’s Blackwell GPUs have jumped sharply to $4.08, up about 48% from two months earlier as demand for agentic AI workloads surged. The spike in spot pricing points to immediate access pressure even if overall supply is increasing. (intellectia.ai)
Renting one of Nvidia’s newest Blackwell graphics processors on the spot market now costs $4.08 an hour, up 48% from $2.75 two months earlier. (techmeme.com) The increase comes from the Ornn Compute Price Index, which tracks graphics processor rental prices across cloud data centers and on-premises markets. Other recent reports citing the index said prices across Nvidia’s lineup have risen as buyers scramble for immediate capacity. (prnewswire.com, fxbus.com) A spot rental is the pay-now, use-now market for computing power, closer to hailing a car than signing a lease. When that price jumps while supply is still expanding, it usually means the fastest-growing customers need chips right away, not next quarter. (prnewswire.com, techmeme.com) Those customers are increasingly running “agentic” artificial intelligence systems, which break work into many steps and generate far more output tokens than a simple chatbot reply. Nvidia said reasoning workloads need high-speed communication, memory, and compute to keep responses fast. (blogs.nvidia.com) That demand is showing up in product usage. OpenAI said last week that its application programming interfaces now process more than 15 billion tokens per minute, up from 6 billion per minute in October. (openai.com) Blackwell is Nvidia’s latest architecture for these jobs, and the B200 version packs 192 gigabytes of high-bandwidth memory, which is the chip’s ultra-fast working memory for large models. Nvidia markets the Blackwell line for training, fine-tuning, and inference, the stage when a model answers real user requests. (resources.nvidia.com, jarvislabs.ai) Cloud supply is not standing still. Nvidia said CoreWeave made Blackwell generally available in the cloud with GB200 NVL72 instances, but broader availability has not stopped buyers from paying up for immediate access. (blogs.nvidia.com, techmeme.com) The pressure is spilling into service quality and product choices. Reports tied to the same Wall Street Journal coverage said some companies are rationing access, Anthropic’s application programming interface availability was running at 98.95%, and OpenAI shelved parts of Sora to free up compute for coding and enterprise products. (the-decoder.com, aidailypost.com) For now, the $4.08 price is a simple signal: even with more Blackwell systems coming online, fast access to top-end artificial intelligence chips is getting more expensive, not less. (techmeme.com, fxbus.com)
