Blackwell GPU rent spikes

Renting Nvidia’s newest Blackwell graphics processors on demand now costs about $4.08 an hour, up from $2.75 two months ago. (techmeme.com) The price jump comes from the Ornn Compute Price Index, which tracks spot rental rates for Nvidia chips in cloud data centers. Market summaries published April 13 said Blackwell rents rose 48% in two months as demand for “agentic” artificial intelligence workloads increased. (fxbus.com) (techstartups.com) A graphics processing unit, or GPU, is the chip that trains and runs large artificial intelligence models, and renting one by the hour is how many startups test models without buying servers outright. Nvidia says its Blackwell line is built for generative artificial intelligence and accelerated computing, with products such as the B200 and GB200 aimed at training and inference. (nvidia.com 1) (nvidia.com 2) Nvidia’s GB200 NVL72 system links 72 Blackwell GPUs and 36 Grace central processing units in one liquid-cooled rack, and Nvidia says that setup can act like one large GPU for large language model inference. Nvidia also says the DGX B200 system uses eight Blackwell GPUs and delivers three times the training performance and 15 times the inference performance of the prior generation. (nvidia.com 1) (nvidia.com 2) That performance has made Blackwell attractive for artificial intelligence agents, which keep models running across longer chains of tasks instead of answering one prompt at a time. The Wall Street Journal summary cited by Techmeme said that demand from those workloads is now showing up directly in rental markets. (techmeme.com) (the-decoder.com) The increase is not uniform across the market. Lambda’s public pricing page listed Nvidia B200 capacity at $6.69 per GPU-hour on April 13, while other pricing trackers showed a wide spread across providers depending on region, cluster size, and whether capacity was sold as single GPUs or larger blocks. (lambda.ai) (getdeploying.com) (thundercompute.com) Cloud providers say the supply squeeze is broader than one chip. A market report published April 13 said Ornn data showed spot rental prices rising across Nvidia’s lineup, and quoted Vultr Chief Executive Officer J.J. Kardwell saying the compute shortage was “extremely severe.” (fxbus.com) For teams building on rented hardware, the move from $2.75 to $4.08 changes the math on testing and deployment. At $4.08 an hour, one Blackwell GPU running nonstop for 30 days would cost about $2,938 before taxes and storage or networking fees. (fxbus.com) (lambda.ai) The next signal to watch is whether more Blackwell capacity reaches the market and pushes spot rates back down. For now, the clearest number in the rental market is still $4.08 an hour. (techmeme.com)