Blackwell GPUs reshape inference
Nvidia’s Blackwell lineup — led by the RTX PRO 6000 Blackwell Server Edition — is being billed as a cost‑efficient inference workhorse with up to 2x price‑performance vs prior H100 setups, and early DirectStorage GPU decompression tests show practical wins for asset streaming. Startups running production inference or real‑time workloads are being nudged toward newer Blackwell hardware despite ongoing supply and export tensions. (ad-hoc-news.de)
The RTX PRO 6000 Blackwell Server Edition is built on NVIDIA’s GB202 die and ships with 96 GB of GDDR7 VRAM on a 512‑bit interface, a reported 24,064 CUDA cores, 752 tensor cores and 188 RT cores. (techpowerup.com) Blackwell adds a fixed‑function Decompression Engine (DE) that accelerates Snappy, LZ4 and Deflate streams and is exposed to developers via NVIDIA’s nvCOMP compression library and memory‑pool flags such as cudaMemPoolCreateUsageHwDecompress. (developer.nvidia.com) Microsoft published DirectStorage 1.4 in public preview on March 11, 2026, adding Zstandard (Zstd) and a Game Asset Conditioning Library (GACL) that, when paired with GPU‑side decompression, aims to shrink compressed asset sizes and make high‑throughput NVMe→GPU streaming more predictable. (devblogs.microsoft.com) Independent testers report the PRO 6000 closes the single‑GPU cost gap versus H100 setups — one analysis measured roughly a 28% lower cost‑per‑token on single‑GPU LLM inference — while NVLink‑equipped datacenter cards retain a 3–4× advantage when scaling large models across many GPUs. (cloudrift.ai) NVIDIA announced the RTX PRO Blackwell family at GTC on March 18, 2025 with partner availability through OEMs including Dell, HPE, Lenovo and Supermicro, retail listings for workstation PRO 6000 variants surfaced around $8.5k–$8.6k while some server resellers showed market prices above $13k. (investor.nvidia.com) U.S. export curbs have driven Nvidia to explore China‑compliant, lower‑tier Blackwell variants per Reuters‑sourced reporting, even as multiple outlets documented buyers obtaining Blackwell systems by routing orders through third‑party traders in Malaysia, Taiwan and Vietnam. (cnbc.com)
