Nvidia has introduced its new Grace Hopper superchip, and its huge reminiscence is sufficient to make the whole RTX 40-series weep. Additional than that, it is packing eight of them into what Jensen Huang calls “one big GPU” with the DGX GH200—a fully mega superserver to speed up AI.
The superchip comes with 576GB of GPU reminiscence, together with 96GB of HBM3 reminiscence and 480GB of LPDDR5. Contemplating even the 24GB of GDDR6X on the RTX 4090, it makes for stark comparability to what we’re used to over in GeForce land.
Huang says the superchip has “virtually the whole laptop” on it, together with 72 ARM CPUs, and Nvidia’s grabbing eight of them to stuff contained in the DGX GH200—a superb couple of racks value of AI servers.
The DGX GH200 is large, each actually and figuratively. We’re 150 miles of fibre optic cables, and 2000 followers that may recycle 70,000 cubic toes per minute of air. “It could actually in all probability recycle the air on this total room in a few minutes”, says Huang.
And at 40,000 kilos in weight, the DGX GH200 is “4 elephants, one GPU.” In different phrases, you are not going to suit one in your research. However I assume that is a part of the fantastic thing about cloud based mostly acceleration—you do not have to.
Not that we may afford one anyway, contemplating the value this monster is more likely to be. Nvidia did not verify the value tag we will count on, however I would guess on it being eye-watering.
Between the eight Grace Hopper chips within the DGX GH200 sits 900GB/s value of chip to chip hyperlinks from NVLink switches. As soon as mixed, that places it altogether within the area of an exaflop in computing energy.
And naturally, between some sporadic Mandarin standup comedy, Jensen panders to the players within the viewers with “I’m wondering if this might play Crysis? Solely players will get that joke.”
In fact Nvidia is not shifting away from gaming, regardless of our musings round a latest incomes name, however it’s clear the main focus for the longer term is on AI. Contemplating Nvidia simply introduced ACE for Video games, an AI toolset that lets builders create NPCs that may speak again to you in real-time. Nvidia’s already confirmed that the system will run on Nvidia DGX Cloud however may additionally run on an everyday ol’ GPU.
