(Image credit: Future / Mike Moore)
The next generation of AI will be powered by Nvidia hardware, the company has declared after it revealed its next generation of GPUs.
Company CEO Jensen Huang took the wraps off the new Blackwell chips at Nvidia GTC 2024 today, promising a major step forward in terms of AI power and efficiency.
The first Blackwell “superchip”, the GB200, is set to ship later this year, with the ability to scale up from a single rack all the way to an entire data center, as Nvidia looks to push on with its leadership in the AI race.
Nvidia Blackwell
Representing a significant step forward for the company’s hardware from its predecessor, Hopper, Huang noted that Blackwell contains 208 billion transistors (up from 80 billion in Hopper) across its two GPU dies, which are connected by 10 TB/second chip-to-chip link into a single, unified GPU.
This makes Blackwell up to 30x faster than Hopper when it comes to AI inference tasks, offering up to 20 petaflops of FP4 power, far ahead of anything else on the market today.
(Image credit: Future / Mike Moore)
During his keynote, Huang highlighted not only the huge jump in power between Blackwell and Hopper – but also the major difference in size.
“Blackwell’s not a chip, it’s the name of a platform,” Huang said. “Hopper is fantastic, but we need bigger GPUs.”
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
Despite this, Nvidia says Blackwell can reduce cost and energy consumption by up to 25x, giving the example of training a 1.8 trillion parameter model – which would previously have taken 8,000 Hopper GPUs and 15 megawatts of power – but can now be done by just 2,000 Blackwell GPUs consuming just four megawatts.
The new GB200 brings together two Nvidia B200 Tensor Core GPUs and a Grace CPU to create what the company simply calls, “a massive superchip” able to drive forward AI development, providing 7x the performance and four times the training speed of an H10O-powered system.
The company also revealed a next-gen NVLink network switch chip with 50 billion transistors, which will mean 576 GPUs are able to talk to each other, creating 1.8 terabytes per second of bidirectional bandwidth.
Nvidia has already signed up a host of major partners to build Blackwell-powered systems, with AWS, Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure already on board alongside a host of big industry names.
More from TechRadar Pro
Nvidia’s Project GROOT brings the human-robot future a significant step closerNvidia is taking the Apple Vision Pro to the OmniverseHere is our guide to the best AI writers available
Mike Moore is Deputy Editor at TechRadar Pro. He has worked as a B2B and B2C tech journalist for nearly a decade, including at one of the UK’s leading national newspapers and fellow Future title ITProPortal, and when he’s not keeping track of all the latest enterprise and workplace trends, can most likely be found watching, following or taking part in some kind of sport.
>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : TechRadar – https://www.techradar.com/pro/the-worlds-most-powerful-chip-nvidia-says-its-new-blackwell-is-set-to-power-the-next-generation-of-ai