This H100 SXM Hopper GPU from Nvidia is reported to cost over USD $36,550 each… now that’s the price of a car in the palm of your hand!
Taken from ServeTheHome … At GTC 2022, NVIDIA had some nice renderings of the NVIDIA H100. A few weeks ago I was able to hold one, and I just got the call that I can now share the photos. For those that prefer live shots instead of renderings, here is our first look at the NVIDIA H100 Hopper GPU that will be a big deal in the market starting later this year.
… as you may have seen in our NVIDIA Cedar Fever 1.6Tbps Modules Used in the DGX H100 piece, I was checking out some new hardware. One of those was this covered by the Random Floating Black Box at NVIDIA:
Here is the front side of the NVIDIA H100. You can see the SXM packaging is getting fairly packed at this point. There is a lot more here than we saw on the V100 generation.
Final Words
Since I just got the call that we could publish the photos that I was probably not supposed to take in the first place, I just wanted to get these out there. The H100 is real. What NVIDIA needs is for the next-generation of AMD EPYC and Intel Xeon CPUs to come out for PCIe Gen5 support so that it has a platform for its next-gen PCIe Gen5 GPUs, BlueField-3 DPUs, ConnectX-7, and more. We confirmed in the Cedar Fever article that NVIDIA has motherboard designs for the DGX H100 for both Sapphire Rapids and Genoa, but one will be picked closer to launch (if it has not been in the past month.)
These photos are actually one of the big drivers behind NVIDIA Grace. NVIDIA has the H100 today, but it does not have x86 PCIe Gen5 platforms to sell to customers, and it will not be using Ampere or another Arm solution in this generation. NVIDIA having its own CPU will allow the company to put out new accelerator generations without having to wait for delayed x86 CPUs in the future.
Source: ServeTheHome
