SHOW DIRECTORY
Training Data
Sonya Huang and Pat Grady interview leading AI builders and researchers about the technical and commercial frontier of AI.
SOURCE DESCRIPTION · RSS
2 EPISODESENSELECTED SOURCE
SUBSCRIBE[Feed_]
Language
Nvidia CTO Michael Kagan: Scaling Beyond Moore's Law to Million-GPU Clusters
Michael KaganSonya HuangPat Grady
AI’s scaling curve is shifting NVIDIA’s optimization target from chips to rack-scale systems, with models doubling every three months and demanding roughly 10X–16X annual performance growth.Mellanox’s low-jitter networking, NVLink/CUDA integration and fault-tolerant architecture support scaling toward 100,000 GPUs, but energy and heat constrain 100–150-megawatt deployments as Kagan says he does not know how long the 10X annual slope will last.