Blackwell GPU rents spike
Hourly rental rates for Nvidia’s Blackwell GPUs have surged to about $4.08 an hour, up roughly 48% from $2.75 two months earlier according to a compute‑pricing index. Analysts link the jump to rising demand for agentic AI workloads and it’s showing up in market commentary about Nvidia’s near-term business case ((alltoc.com), (intellectia.ai)).
Renting Nvidia’s newest Blackwell graphics processors now costs about $4.08 an hour, up from $2.75 roughly two months ago. (techmeme.com) The price jump comes from the Ornn Compute Price Index, a market gauge that tracks cloud rental rates for graphics processing units used in artificial intelligence work. Ornn said on April 2 that the index had been added to Bloomberg Terminal, widening its reach with investors and traders. (prnewswire.com) Blackwell is Nvidia’s latest data-center chip family, announced on March 18, 2024, for training and running large artificial intelligence models. Nvidia says the B200 version carries 192 gigabytes of high-bandwidth memory and is built for faster inference, the step where a model answers prompts. (nvidianews.nvidia.com, nvidia.com) Cloud rental rates are a real-time read on scarcity because many companies do not buy these chips outright; they lease computing time by the hour from cloud providers instead. Techmeme’s summary of the Wall Street Journal report said the rise was driven by demand for “agentic” artificial intelligence systems, which chain together multiple model calls and tools to complete tasks. (techmeme.com) That matters because inference demand has become a bigger part of the Nvidia story than one-time training runs. Nvidia says a full GB200 NVL72 rack links 72 Blackwell graphics processors and 36 Grace central processors to serve trillion-parameter models and mixture-of-experts systems, the kinds of setups used for high-volume responses. (nvidia.com) The market is also signaling that Blackwell capacity is still unevenly distributed. Public price trackers this week showed wide spreads across providers, with some Blackwell B200 listings starting near $2.25 an hour while other offers were far higher depending on region, contract terms, and whether capacity was spot or on-demand. (datastorage.com, getdeploying.com) That spread helps explain why an index can rise even when some list prices look cheaper. Spot markets move with short-term supply and demand, and Ornn’s measure is being cited as evidence that available top-end graphics processing unit capacity tightened again in early April. (prnewswire.com, techmeme.com) For Nvidia, the signal is not just that Blackwell shipped, but that customers are paying more to get access now. As long as hourly rents keep climbing, the shortage story around advanced artificial intelligence compute remains visible in the market price. (techmeme.com, nvidianews.nvidia.com)