* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Monday, July 21, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    12 ‘Late Show’ Moments Proving Stephen Colbert Can’t Be Replaced – The Mountaineer

    12 Unforgettable ‘Late Show’ Moments That Prove Stephen Colbert Is Truly One of a Kind

    Canes owner Tom Dundon’s real estate firm eyes entertainment complex near RDU – The Business Journals

    Canes Owner Tom Dundon’s Real Estate Firm Unveils Plans for Thrilling New Entertainment Complex Near RDU

    Inspired Entertainment, Inc.’s (NASDAQ:INSE) Price Is Right But Growth Is Lacking After Shares Rocket 29% – simplywall.st

    Inspired Entertainment Soars 29% but Growth Momentum Falls Short

    Kroger shares summer entertainment tips – Supermarket Perimeter

    Ultimate Summer Entertainment Tips to Make Your Season Unforgettable

    Theater at Santa Fe’s San Isidro Plaza will be converted into IMAX, family entertainment venue – Santa Fe New Mexican

    Santa Fe’s San Isidro Plaza Theater Transforms into Exciting IMAX Family Entertainment Venue

    B&B Theatres will open massive entertainment complex in Texas – The Business Journals

    B&B Theatres will open massive entertainment complex in Texas – The Business Journals

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Cold Weather Alloy Opens New Possibilities for Space Technology – Universe Today

    Revolutionary Cold Weather Alloy Unlocks New Frontiers in Space Technology

    Defence Holdings PLC Transitions from Esports to Pioneering Defence Technology

    Bull of the Day: Credo Technology Group (CRDO) – Yahoo Finance

    Bull of the Day: Why Credo Technology Group (CRDO) Is Poised for a Breakout

    BlackSky Technology Inc. Stock Analysis and Forecast – Explosive wealth accumulation – Jammu Links News

    BlackSky Technology Inc.: Unlocking Explosive Wealth Potential Through Expert Stock Analysis and Forecast

    Polypurine Hairpin Technology is Safe, Effective at Inhibiting PCSK9 to Regulate Cholesterol – Pharmacy Times

    Polypurine Hairpin Technology: A Safe and Powerful Breakthrough for Controlling Cholesterol by Targeting PCSK9

    A major AI training data set contains millions of examples of personal data – MIT Technology Review

    A major AI training data set contains millions of examples of personal data – MIT Technology Review

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    12 ‘Late Show’ Moments Proving Stephen Colbert Can’t Be Replaced – The Mountaineer

    12 Unforgettable ‘Late Show’ Moments That Prove Stephen Colbert Is Truly One of a Kind

    Canes owner Tom Dundon’s real estate firm eyes entertainment complex near RDU – The Business Journals

    Canes Owner Tom Dundon’s Real Estate Firm Unveils Plans for Thrilling New Entertainment Complex Near RDU

    Inspired Entertainment, Inc.’s (NASDAQ:INSE) Price Is Right But Growth Is Lacking After Shares Rocket 29% – simplywall.st

    Inspired Entertainment Soars 29% but Growth Momentum Falls Short

    Kroger shares summer entertainment tips – Supermarket Perimeter

    Ultimate Summer Entertainment Tips to Make Your Season Unforgettable

    Theater at Santa Fe’s San Isidro Plaza will be converted into IMAX, family entertainment venue – Santa Fe New Mexican

    Santa Fe’s San Isidro Plaza Theater Transforms into Exciting IMAX Family Entertainment Venue

    B&B Theatres will open massive entertainment complex in Texas – The Business Journals

    B&B Theatres will open massive entertainment complex in Texas – The Business Journals

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Cold Weather Alloy Opens New Possibilities for Space Technology – Universe Today

    Revolutionary Cold Weather Alloy Unlocks New Frontiers in Space Technology

    Defence Holdings PLC Transitions from Esports to Pioneering Defence Technology

    Bull of the Day: Credo Technology Group (CRDO) – Yahoo Finance

    Bull of the Day: Why Credo Technology Group (CRDO) Is Poised for a Breakout

    BlackSky Technology Inc. Stock Analysis and Forecast – Explosive wealth accumulation – Jammu Links News

    BlackSky Technology Inc.: Unlocking Explosive Wealth Potential Through Expert Stock Analysis and Forecast

    Polypurine Hairpin Technology is Safe, Effective at Inhibiting PCSK9 to Regulate Cholesterol – Pharmacy Times

    Polypurine Hairpin Technology: A Safe and Powerful Breakthrough for Controlling Cholesterol by Targeting PCSK9

    A major AI training data set contains millions of examples of personal data – MIT Technology Review

    A major AI training data set contains millions of examples of personal data – MIT Technology Review

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Science

Google, Intel, Nvidia Battle in Generative AI Training

November 13, 2023
in Science
Google, Intel, Nvidia Battle in Generative AI Training
Share on FacebookShare on Twitter

The leading public apples-to-apples test for computer systems’ ability to train machine learning neural networks has fully entered the generative AI era. Earlier this year, MLPerf added a test for training large language models (LLM), GPT-3 in particular. This month it adds Stable Diffusion, a text-to-image generator. Computers powered by Intel and Nvidia took on the new benchmark. And the rivals continued their earlier battle in training GPT-3, where they were joined this go-around by Google.

All three devoted huge systems to the task—Nvidia’s 10,000 GPU supercomputer was the largest ever tested—and that size is necessary in generative AI. Even Nvidia’s largest system would have taken eight days of work to fully complete its LLM job.

Overall, 19 companies and institutions submitted more than 200 results, which showed a 2.8-fold performance boost over the past five months, and a 49-fold boost since MLPerf began five years ago.

Nvidia, Microsoft test 10,752-GPU monsters

Nvidia continued to dominate the MLPerf benchmarks with systems made from its H100 GPUs. But the cherry on top were results from Eos, the company’s new 10,752-GPU AI supercomputer. Bending all those GPUsto the task of the GPT-3 training benchmark, Eos had the job done in just under 4 minutes. Microsoft’s cloud computing arm, Azure, tested a system of the exact same size and were behind Eos by mere seconds. (Azure powers GitHub’s coding assistant CoPilot and OpenAI’s ChatGPT.)

Eos’s GPUs are capable of an aggregate 42.6 billion billion floating point operations per second (exaflops). And they are bound together with interconnects—Nvidia’s Quantum-2 Infiniband—that sling 1.1 million billion bytes per second. “Some of these speeds and feeds are mind-blowing,” says Dave Salvatore, Nvidia’s director of AI benchmarking and cloud computing. “This is an incredibly capable machine.”

Eos triples the number of H100 GPUs that have been bound into a single machine. That three-fold increase purchased a 2.8-fold performance improvement, or 93 percent scaling efficiency. Efficient scaling is key to continued improvement of generative AI, which have been growing 10-fold every year.

The GPT-3 benchmark Eos tackled is not a complete training of GPT-3, because MLPerf wanted it to be within reach of many companies. Instead, it involves training the system to a certain checkpoint that proves the training would have reached the needed accuracy given enough time. And these trainings do take time. Extrapolating from Eos’s 4 minutes means it would take 8 days to complete the training, and that’s on what might be the most powerful AI supercomputer yet built. A more reasonably-sized computer—512 H100s—would take 4 months.

Intel continues to close in

Intel submitted results for systems using the Gaudi 2 accelerator chip and for those that had no accelerator at all, relying only its 4th generation Xeon CPU. The big change from the last set of training benchmarks was that the company had enabled Gaudi 2’s 8-bit floating point (FP8) capabilities. The use of lower precision numbers, such as FP8, has been responsible for most of the improvement in GPU performance in last 10 years. The use of FP8 in parts of GPT-3 and other transformer neural networks where their low precision won’t affect accuracy has already showed its value in Nvidia’s H100 results. Now Gaudi 2 is seeing the boost.

“We projected a 90 percent gain” from switching on FP8, says Eitan Medina, chief operating officer at Intel’s Habana Labs. “We delivered more than what was promised—a 103 percent reduction in time-to-train for a 384-accelerator cluster.”

That new result puts the Gaudi 2 system a little less than one-third the speed of an Nvidia system on a per-chip basis and three times faster than Google’s TPUv5e. On the new image generation benchmark, Gaudi 2 was also about half the H100’s speed. GPT-3 was the only benchmark FP8 was enabled for this round, but Medina says his team is working on switching it on for others now.

Medina continued to make the case that Gaudi 2 has a significantly lower price to the H100, and so it has an advantage on a combined metric of price and performance. Medina expects the advantage will grow with the next generation of Intel accelerator chip, Gaudi 3. That chip will be in volume production in 2024 and will be built using the same semiconductor manufacturing process as the Nvidia H100.

Separately, Intel submitted results for systems based only on CPUs. Again, showing training times of between minutes and hours for several benchmarks. Beyond the MLPerf benchmarks, Intel also shared some data showing that a 4-node Xeon system, whose chips include the AMX matrix engine can fine tune the image generator stable diffusion in less than five minutes. Fine tuning takes an already-trained neural network and specializes it toward a certain task. For example, Nvidia’s chip design AI is a fine-tuning of an existing large language model called NeMo.

You can see all the results here.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : IEEE – https://spectrum.ieee.org/generative-ai-training

Tags: GoogleIntelscience
Previous Post

Andrew Ng: Unbiggen AI

Next Post

MIT Professor’s IoT Sensors Make Roads Safer

Cold Weather Alloy Opens New Possibilities for Space Technology – Universe Today

Revolutionary Cold Weather Alloy Unlocks New Frontiers in Space Technology

July 21, 2025
Sports Fans Saddened By Barron Trump’s Announcement – Yahoo Sports

Sports Fans Express Disappointment Over Barron Trump’s Announcement

July 21, 2025
Migrating shorebird killed by raptor at 3000 m above ground as revealed by high-resolution tracking – ESA Journals

Dramatic High-Altitude Encounter: Migrating Shorebird Taken Down by Raptor at 3000 Meters

July 21, 2025
One Dietary Supplement Shown to Reduce Aggression by Up to 28% – ScienceAlert

This Dietary Supplement Can Slash Aggression by Nearly 30%

July 21, 2025
Hundreds of NASA Employees Condemn Trump Administration Cuts in Public Letter – The New York Times

Hundreds of NASA Employees Unite in Powerful Open Letter Opposing Trump Administration Budget Cuts

July 21, 2025
JioHotstar taps influencers to turn Wimbledon into a lifestyle experience for India’s young consumers – MSN

How JioHotstar Is Turning Wimbledon into a Lifestyle Phenomenon for India’s Youth Through Influencers

July 21, 2025
Porsche CEO seeks fresh cost cuts, warning business model ‘no longer works’ in post-Trump, new China world – Fortune

Porsche CEO seeks fresh cost cuts, warning business model ‘no longer works’ in post-Trump, new China world – Fortune

July 21, 2025
The economy is turbulent for influencers, too — here’s how you might see it online – NPR

How Today’s Turbulent Economy Is Transforming the World of Influencers-and What It Means for Your Online Experience

July 21, 2025
Tom Troupe, prolific star of the stage and screen, is dead at 97 – Los Angeles Times

Legendary Stage and Screen Star Tom Troupe Passes Away at 97

July 21, 2025
Mayo’s Alzheimer’s blood test research, Baptist’s leadless pacemaker top Healthful News – The Florida Times-Union

Revolutionary Breakthroughs in Alzheimer’s Blood Tests and Leadless Pacemakers Transform Healthcare Forever

July 21, 2025

Categories

Archives

July 2025
MTWTFSS
 123456
78910111213
14151617181920
21222324252627
28293031 
« Jun    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (732)
  • Economy (755)
  • Entertainment (21,639)
  • General (16,025)
  • Health (9,793)
  • Lifestyle (763)
  • News (22,149)
  • People (757)
  • Politics (764)
  • Science (15,972)
  • Sports (21,253)
  • Technology (15,738)
  • World (738)

Recent News

Cold Weather Alloy Opens New Possibilities for Space Technology – Universe Today

Revolutionary Cold Weather Alloy Unlocks New Frontiers in Space Technology

July 21, 2025
Sports Fans Saddened By Barron Trump’s Announcement – Yahoo Sports

Sports Fans Express Disappointment Over Barron Trump’s Announcement

July 21, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version