NVIDIA says AI sped up GPU design

NVIDIA reported that an internal large language model reduced a GPU‑design task that once took ten months and eight engineers to an overnight job, while stressing human oversight remains essential. The company trained the model on decades of GPU‑design data and is already applying AI across its chip‑design workflow. (tomshardware.com, videocardz.com)

NVIDIA says it used an internal artificial intelligence model to turn one GPU design job from ten months into an overnight run. (videocardz.com) The task was porting a standard cell library, the catalog of tiny logic building blocks that chip teams reuse, to a new manufacturing process. Bill Dally, NVIDIA’s chief scientist, said that work had taken eight engineers about 10 months, or 80 person-months, before the company built its NB-Cell system. (videocardz.com) Dally described the result during a March 2026 NVIDIA GTC session with Google DeepMind and Google Research chief scientist Jeff Dean. NVIDIA’s session page lists the talk as a 60-minute discussion on hardware, systems scaling, and algorithmic advances for the 2026 to 2030 period. (nvidia.com) A large language model is software trained to predict the next token in text, and chip teams are adapting that pattern-finding skill to design documents, code, bug reports, and engineering scripts. NVIDIA’s research group says it trains custom large language models for chip design and works with internal hardware teams on those systems. (research.nvidia.com) NVIDIA has been building this approach for at least two years. Its 2023 ChipNeMo paper said the company was testing domain-adapted models for three jobs inside chip development: an engineering assistant chatbot, electronic design automation script generation, and bug summarization and analysis. (research.nvidia.com, arxiv.org) That paper said NVIDIA did not rely on a general-purpose chatbot alone. The company adapted tokenizers, continued pretraining on chip-design material, added supervised fine-tuning, and built retrieval systems so the model could pull from internal design knowledge. (research.nvidia.com, arxiv.org) Dally said NVIDIA is already using artificial intelligence in other parts of its design flow, including design exploration, standard cell library work, bug handling, and verification. He also said the company is still far from having artificial intelligence design chips end to end without human input. (videocardz.com) The company’s own research language is narrower than the overnight claim. In the ChipNeMo paper, NVIDIA presented the models as tools to improve productivity on language-heavy engineering tasks, not as autonomous replacements for chip architects or verification teams. (research.nvidia.com, arxiv.org) That leaves NVIDIA with the same closing point Dally made on stage: the software is moving more design work into machine speed, but engineers are still checking the answers. (videocardz.com)

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.