* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Monday, June 23, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    Safety concerns in Deep Ellum create apprehension as the entertainment district gains visitors – CBS News

    Safety Concerns Surge Amid Deep Ellum’s Booming Popularity and Growing Crowds

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Promising Technology Stocks To Follow Today – June 22nd – MarketBeat

    Top Technology Stocks to Watch Today – June 22nd

    Technology Convergence Report 2025 – The World Economic Forum

    Technology Convergence Report 2025 – The World Economic Forum

    How AI can help make cities work better for residents – MIT Technology Review

    How AI can help make cities work better for residents – MIT Technology Review

    Tech Champions with Leo Bletnitsky of Healthy Technology Solutions – Buzz Media Group

    Meet Tech Champion Leo Bletnitsky of Healthy Technology Solutions

    Crypto’s true revolution is about humanity, not technology – Cointelegraph

    Crypto’s Real Revolution: Transforming Humanity Beyond Technology

    $1 Billion Problem: New Technology Could Save Your Daily Cup of Coffee – SciTechDaily

    The $1 Billion Challenge: How New Technology Could Rescue Your Daily Cup of Coffee

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    Safety concerns in Deep Ellum create apprehension as the entertainment district gains visitors – CBS News

    Safety Concerns Surge Amid Deep Ellum’s Booming Popularity and Growing Crowds

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Promising Technology Stocks To Follow Today – June 22nd – MarketBeat

    Top Technology Stocks to Watch Today – June 22nd

    Technology Convergence Report 2025 – The World Economic Forum

    Technology Convergence Report 2025 – The World Economic Forum

    How AI can help make cities work better for residents – MIT Technology Review

    How AI can help make cities work better for residents – MIT Technology Review

    Tech Champions with Leo Bletnitsky of Healthy Technology Solutions – Buzz Media Group

    Meet Tech Champion Leo Bletnitsky of Healthy Technology Solutions

    Crypto’s true revolution is about humanity, not technology – Cointelegraph

    Crypto’s Real Revolution: Transforming Humanity Beyond Technology

    $1 Billion Problem: New Technology Could Save Your Daily Cup of Coffee – SciTechDaily

    The $1 Billion Challenge: How New Technology Could Rescue Your Daily Cup of Coffee

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Google says its ‘Trillium’ TPUs are ready to power the next-generation of AI models

May 14, 2024
in Technology
Google says its ‘Trillium’ TPUs are ready to power the next-generation of AI models
Share on FacebookShare on Twitter

I/O Google blew the lid off its sixth tensor processing unit (TPU) codenamed Trillium, designed to support a new generation of bigger, more capable of large language and recommender models.

Initially built to accelerate Google’s internal machine learning workloads, like those built into Gmail, Google Maps, and YouTube, the search giant began making the matrix math accelerators available on its cloud in 2018.

Six generations later, Google’s TPUs are central to the development of the Gemini large language models behind its growing portfolio of generative AI apps and services.

According to Google, Trillium boasts a 4.7x increase in peak compute performance and twice the high bandwidth memory capacity and bandwidth of its earlier TPU v5e design, which we looked at last summer. Google has also doubled the interchip interconnect bandwidth.

Looking at the v5e’s spec sheet, Google’s claims of a 4.7x boost suggest that the new chip is capable of roughly 926 teraFLOPS at BF16 and 1,847 teraFLOPS at INT8. However, that’s assuming Google isn’t relying on lower precision INT4 or FP4 datatypes to achieve that score, like Nvidia is with its Blackwell chips.

This would make Trillium about twice as fast as Google’s TPU v5p accelerators which it announced less than six months ago.

According to Google these performance gains were achieved by increasing the size of the TPU’s matrix multiple units (MXUs) — heart of the chip — and boosting the clock speed.

Alongside the MXU improvements, the chip also boasts Google’s third-gen SparseCore, a specialized accelerator designed to process large embeddings commonly found in ranking and recommender systems.

Meanwhile, a doubling of bandwidth and capacity means that we’re looking at 32GB of HBM operating at 1.6TB/s and a chip-to-chip interconnect capable of 3.2 Tbps.

Google claims the higher memory capacity will enable the chip to support bigger models containing more weights and larger key-value caches — the latter being important for handling large numbers of concurrent users.

As a general rule, you need about 1GB of memory for every billion parameters when training or inferencing a model at 8-bit precision. So a 32GB TPUv6 would be able to support models up to about 30 billion parameters — double that when using models quantized to 4-bit precision.

The higher chip-to-chip interconnect bandwidth, meanwhile, means that multiple TPUs can be strung together much more efficiently in order to support inferencing or training on much larger models.

In terms of scalability, Trillium looks quite similar to the v5e instances it replaces in that it supports pods with up to 256 chips. Multiple Pods can then be networked using Google’s multisplice tech  and Titanium infrastructure processing units to support training workloads scaling to “tens of thousands of chips.”

Add AI servers to the list of iDevices Apple Silicon could soon power

Google Search results polluted by buggy AI-written code frustrate coders

Google I/O is Google A/I as search biz goes all-in on AI

CoreWeave plows £1B into UK HQ and datacenters as it eyes European expansion

Despite the boost in performance, Google claims its latest TPU is capable of delivering those FLOPS using 67 percent less power than its previous generation.

They add that several customers, including Nuro, Deep Genomics, Deloitte and Google’s own DeepMind team will be among the first to put Trillium through its paces training and running their respective models.

However, it remains to be seen when the rest of us will be able to get our hands on Google’s shiny new TPUs. For the moment, Google is soliciting interest via an online form which you can find here. ®

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : The Register – https://go.theregister.com/feed/www.theregister.com/2024/05/14/google_tpu_trillium/

Tags: GoogletechnologyTRILLIUM
Previous Post

Liverpool attempted to trademark ‘Allez Allez Allez’ after famous fan chant

Next Post

Marketing Briefing: Backlash ‘a sign of the times’ as major brands like Apple and Bumble pull ads drawing ire

US judge blocks slashing of universities’ federal funding from National Science Foundation – Reuters

US Judge Halts Cuts to Federal Funding for Universities from National Science Foundation

June 23, 2025
The Computer-Science Bubble Is Bursting – The Atlantic

Is the Computer-Science Boom Coming to an End?

June 23, 2025

6 Life Moments When Staying Silent Is the Wisest Choice

June 23, 2025
Dollar Gains as the World Awaits Iran’s Response to US Attack – Yahoo Finance

Dollar Gains as the World Awaits Iran’s Response to US Attack – Yahoo Finance

June 23, 2025
The Political Economy of Reform in Lebanon and its Challenges – Middle East Transparent

Unveiling Lebanon’s Reform Journey: Overcoming Challenges and Political Obstacles

June 23, 2025
Three AI Trends Reshaping the Future of Media & Entertainment – TVTechnology

3 Game-Changing AI Trends Revolutionizing the Future of Media and Entertainment

June 23, 2025
Tell us your immigration crackdown story – CNN

Tell us your immigration crackdown story – CNN

June 23, 2025
Promising Technology Stocks To Follow Today – June 22nd – MarketBeat

Top Technology Stocks to Watch Today – June 22nd

June 23, 2025
Steelers Prediction Sees TJ Watt Trade to Buccaneers in Blockbuster – Yahoo Sports

Steelers Prediction Sees TJ Watt Trade to Buccaneers in Blockbuster – Yahoo Sports

June 23, 2025
Senior Thesis Spotlight: Considering facets of human psychology from a data science point of view – Princeton University

Exploring Human Psychology Through the Lens of Data Science: A Senior Thesis Spotlight

June 23, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (697)
  • Economy (713)
  • Entertainment (21,611)
  • General (15,527)
  • Health (9,753)
  • Lifestyle (718)
  • News (22,149)
  • People (716)
  • Politics (720)
  • Science (15,932)
  • Sports (21,209)
  • Technology (15,698)
  • World (693)

Recent News

US judge blocks slashing of universities’ federal funding from National Science Foundation – Reuters

US Judge Halts Cuts to Federal Funding for Universities from National Science Foundation

June 23, 2025
The Computer-Science Bubble Is Bursting – The Atlantic

Is the Computer-Science Boom Coming to an End?

June 23, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version