Wow, looks like Mea is serious about AI … by buying 350,000 NVIDIA H100 Tensor GPUs worth $10.5 billion.
Taken from TPU … Mark Zuckerberg has shared some interesting insights about Meta’s AI infrastructure buildout, which is on track to include an astonishing number of NVIDIA H100 Tensor GPUs. In the post on Instagram, Meta’s CEO has noted the following: “We’re currently training our next-gen model Llama 3, and we’re building massive compute infrastructure to support our future roadmap, including 350k H100s by the end of this year — and overall almost 600k H100s equivalents of compute if you include other GPUs.” That means that the company will enhance its AI infrastructure with 350,000 H100 GPUs on top of the existing GPUs, which is equivalent to 250,000 H100 in terms of computing power, for a total of 600,000 H100-equivalent GPUs.
The raw number of GPUs installed comes at a steep price. With the average selling price of H100 GPU nearing 30,000 US dollars, Meta’s investment will settle the company back around $10.5 billion. Other GPUs should be in the infrastructure, but most will comprise the NVIDIA Hopper family. Additionally, Meta is currently training the LLama 3 AI model, which will be much more capable than the existing LLama 2 family and will include better reasoning, coding, and math-solving capabilities. These models will be open-source. Later down the pipeline, as the artificial general intelligence (AGI) comes into play, Zuckerberg has noted that “Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit.” So, expect to see these models in the GitHub repositories in the future.
Source: Mark Zuckerberg (Instagram) via TPU
