This thing is a BEAST … mind you, unfortunately it’s not for desktop computers.
Taken from Videocardz … Twitter user Locuza specializing in creating visual summaries of the existing knowledge on upcoming hardware products, has made a new GPU diagram featuring NVIDIA GH100 GPU, the upcoming data-center accelerator and company’s first 5 nm processor.
His diagram features two details that have been revealed in the past 2 weeks, details that we have missed. The origin of this leak is not official data, but the information that has leaked after hacking group published leaked confidential data from NVIDIA servers.
Although NVIDIA is more than likely to announce its Hopper GPUs tomorrow, some details might not immediately be confirmed. For instance, the fact that only one Graphics Processing Cluster (GPC) has a 3D engine, while 7 do not. This means that not all GPCs in Hopper GPU are identical, and NVIDIA is clearly saving space for a functionality that is simply not as important for a datacenter GPU as it would have been for a consumer product.
Furthermore, it is said that GH100 GPU would feature 48 MB of L2 Cache. This is not an upgrade over Ampere GA100 GPU (48MB) though. However, it is three times as much as AMD’s Instinct MI250 “Aldebaran” GPU with 16MB of total L2 cache. Interestingly, NVIDIA’s RTX 40 series codenamed “Ada” are rumored to feature even more L2 cache, up to 96MB for AD102 GPU.
Thanks to the leak, NVIDIA GH100 is confirmed to feature 8 GPCs. Each cluster is to feature 9 TPCs and each TPC comes with two Streaming Multiprocessors. Now assuming that the architecture has not changed in regard to CUDA cores, this would give 144 SMs and 9216 CUDA cores (or 17152 if FP32 cores are doubled).
Source: Videocardz
