Nvidia HPC/AI chip is actually six chips [Video]

Nvidia’s idea of a “chip” now includes a massive single board the size of a PC motherboard that packs four Blackwell GPUs, two Grace CPUs and a high-speed interconnect to wire it all together and has a power draw of 5.4 kilowatts.

Officially dubbed the GB200 NVL4, it is essentially two GB200 Superchips glued together without the off-board NVLink. The NVLink is only for onboard communication. Data traveling off the board uses a variety of networking protocols, like Ethernet and InfiniBand.

The GB200 NVL4 Superchip is designed for servers running a mix of high-performance computing and AI workloads, said Dion Harris, director of accelerated computing at Nvidia, in a briefing last week with journalists.

The GB200 NVL4 Superchip features 1.3TB of coherent memory that is shared across all four B200 GPUs using NVLink, which offers bidirectional throughput of up to 1.8 TB/s per GPU.

Compared to the GH200 NVL4, the …