xAI turns on 100,000x liquid-cooled Nvidia H100s in Memphis Supercluster

@xai is building a new Artificial Intelligence training cluster which combines the compute of 100,000 of Nvidia’s best chip (for now), the H100 which retails for around US$30,000 each.

Elon Musk took to @x to announce that the xAI, X and Nvidia teams all worked together to get the new liquid-cooled AI training cluster operational.

At 4:20am, it’s clear the team were working hard to get this to work and with a hardware investment of as much as $3 Billion, its understandable that they’d want to put it to work as soon as possible.

Nice work by @xAI team, @X team, @Nvidia & supporting companies getting Memphis Supercluster training started at ~4:20am local time.

With 100k liquid-cooled H100s on a single RDMA fabric, it’s the most powerful AI training cluster in the world!

— Elon Musk (@elonmusk) July 22, 2024

The AI Training Farm is built in Memphis, Texas, around 6.5hrs from Tesla’s Texas Gigafactory.

xAI will use the new training compute to train a new version of @grok which is available to premium subscribers of @x.

Elon recently gave Lex Fridman who has interviewed Musk multiple times, a tour of the new facility.

xAI also shared a photo of the team with the compute cluster in the background.

Musk claims that the new facility is the most powerful AI training cluster in the world.. which does beg the question.. how does this compare with Tesla’s training cluster that is being used to train the model(s) for Full Self Driving software to power the robotaxis and humanoid robots of the future.

Jason Cartwrighthttps://techau.com.au/author/jason/

Creator of techAU, Jason has spent the dozen+ years covering technology in Australia and around the world. Bringing a background in multimedia and passion for technology to the job, Cartwright delivers detailed product reviews, event coverage and industry news on a daily basis.

Disclaimer: Tesla Shareholder from 20/01/2021

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : TechAU – https://techau.com.au/xai-turns-on-100000x-liquid-cooled-nvidia-h100s-in-memphis-supercluster/