NVIDIA GTC: agents & inference

NVIDIA’s GTC pushed ‘agentic AI’ and a shift from training-first to inference/agent workloads, unveiling the Vera Rubin architecture and enterprise toolkits for autonomous agents and secure deployment. Jensen Huang framed this as an industrial shift toward AI factories—investor reaction was immediate, with NVDA stock notably moving on the announcements. (blogs.nvidia.com)

Vera Rubin is shipping with seven new chips in full production and five rack types — Vera Rubin NVL72 GPU racks, Vera CPU racks, NVIDIA Groq 3 LPX inference accelerator racks, NVIDIA BlueField‑4 STX storage racks and NVIDIA Spectrum‑6 SPX Ethernet racks. (investor.nvidia.com) NVIDIA positions Rubin as a POD‑scale system delivered through deep codesign across compute, networking and storage and backed by an ecosystem of more than 80 NVIDIA MGX partners to support multi‑rack AI factory deployments. (investor.nvidia.com) The open‑source NVIDIA Agent Toolkit launched at GTC with 17 enterprise adopters named on stage, including Adobe, Salesforce, SAP, ServiceNow, Siemens, CrowdStrike and Atlassian. (venturebeat.com) The toolkit bundles the Nemotron model family, AI‑Q agent blueprints, the OpenShell runtime and cuOpt optimization skills, and NVIDIA states AI‑Q’s hybrid frontier+Nemotron architecture delivers more than a 50% reduction in cost per query while topping DeepResearch Bench leaderboards. (eweek.com) NemoClaw installs Nemotron models and the OpenShell runtime in a single command and is specified to run locally on dedicated platforms from GeForce RTX PCs and RTX PRO workstations to DGX Station and DGX Spark, enabling hybrid local+cloud privacy routing for always‑on agents. (nvidianews.nvidia.com) Systems vendors moved fast: HPE showed Vera Rubin systems and Pegatron announced server platforms powered by NVIDIA Vera Rubin NVL72 and HGX Rubin NVL8 for private‑cloud and enterprise server builds. (crn.com) (marketwatch.com) Jensen Huang told the GTC audience he now sees at least $1 trillion of orders for Blackwell and Vera Rubin chips through 2027, up from prior estimates, and NVDA stock closed March 16, 2026 at $183.22, up roughly 1.65% that day. (datacenterdynamics.com) (finance.yahoo.com)

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.