* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Wednesday, June 4, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

    Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

    Salem’s Harborwalk Garden Cultivates Community with Entertainment, Food, and Events – 105.7 WROR

    Discover the Vibrant Community Spirit at Salem’s Harborwalk Garden: A Hub for Entertainment, Food, and Fun!

    Entertainment-Focused Narrative and Culture Change Practice – New America

    Transforming Culture Through Engaging Entertainment Narratives

    Rising stars: Young classical musicians surging on social media – Yahoo

    Meet the Next Generation of Classical Music Sensations Making Waves on Social Media!

    Devin Harjes Dies: ‘Manifest’ & ‘Boardwalk Empire’ Actor Was 41 – WyomingNews.com

    Tragic Loss: Devin Harjes, Star of ‘Manifest’ and ‘Boardwalk Empire,’ Passes Away at 41

    Why Starz Entertainment Stock Soared Today – The Motley Fool

    Unpacking the Surge: What Fueled Starz Entertainment’s Stock Explosion Today!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Finland Set to Lead EU Quantum Technology Defense Project – IoT World Today

    Finland Set to Lead EU Quantum Technology Defense Project – IoT World Today

    AI for lawyers: Win back your time using technology – nationaljurist.com

    Reclaim Your Time: How AI is Transforming the Legal Profession

    Prosecutors accuse men of exporting U.S. military technology to China – Milwaukee Journal Sentinel

    Men Charged with Illegally Exporting U.S. Military Technology to China

    ROLAND’S NEW WIRELESS TRIGGER TECHNOLOGY, PORTER & DAVIES ON TOUR, NEW 64 AUDIO ASPIRE UNIVERSAL IEM MODELS, WAVES FREE PLUGIN PACK – Modern Drummer Magazine

    ROLAND’S NEW WIRELESS TRIGGER TECHNOLOGY, PORTER & DAVIES ON TOUR, NEW 64 AUDIO ASPIRE UNIVERSAL IEM MODELS, WAVES FREE PLUGIN PACK – Modern Drummer Magazine

    This giant microwave may change the future of war – MIT Technology Review

    Revolutionizing Warfare: The Impact of a Game-Changing Giant Microwave

    Bajeed Pattan Joins Forbes Technology Council as Innovation Leader – PRWeb

    Bajeed Pattan Takes the Helm as Innovation Leader at Forbes Technology Council!

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

    Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

    Salem’s Harborwalk Garden Cultivates Community with Entertainment, Food, and Events – 105.7 WROR

    Discover the Vibrant Community Spirit at Salem’s Harborwalk Garden: A Hub for Entertainment, Food, and Fun!

    Entertainment-Focused Narrative and Culture Change Practice – New America

    Transforming Culture Through Engaging Entertainment Narratives

    Rising stars: Young classical musicians surging on social media – Yahoo

    Meet the Next Generation of Classical Music Sensations Making Waves on Social Media!

    Devin Harjes Dies: ‘Manifest’ & ‘Boardwalk Empire’ Actor Was 41 – WyomingNews.com

    Tragic Loss: Devin Harjes, Star of ‘Manifest’ and ‘Boardwalk Empire,’ Passes Away at 41

    Why Starz Entertainment Stock Soared Today – The Motley Fool

    Unpacking the Surge: What Fueled Starz Entertainment’s Stock Explosion Today!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Finland Set to Lead EU Quantum Technology Defense Project – IoT World Today

    Finland Set to Lead EU Quantum Technology Defense Project – IoT World Today

    AI for lawyers: Win back your time using technology – nationaljurist.com

    Reclaim Your Time: How AI is Transforming the Legal Profession

    Prosecutors accuse men of exporting U.S. military technology to China – Milwaukee Journal Sentinel

    Men Charged with Illegally Exporting U.S. Military Technology to China

    ROLAND’S NEW WIRELESS TRIGGER TECHNOLOGY, PORTER & DAVIES ON TOUR, NEW 64 AUDIO ASPIRE UNIVERSAL IEM MODELS, WAVES FREE PLUGIN PACK – Modern Drummer Magazine

    ROLAND’S NEW WIRELESS TRIGGER TECHNOLOGY, PORTER & DAVIES ON TOUR, NEW 64 AUDIO ASPIRE UNIVERSAL IEM MODELS, WAVES FREE PLUGIN PACK – Modern Drummer Magazine

    This giant microwave may change the future of war – MIT Technology Review

    Revolutionizing Warfare: The Impact of a Game-Changing Giant Microwave

    Bajeed Pattan Joins Forbes Technology Council as Innovation Leader – PRWeb

    Bajeed Pattan Takes the Helm as Innovation Leader at Forbes Technology Council!

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Opinion: Is anyone going to make money in AI inference?

January 8, 2024
in Technology
Opinion: Is anyone going to make money in AI inference?
Share on FacebookShare on Twitter

TechSpot is celebrating its 25th anniversary. TechSpot means tech analysis and advice you can trust.

A big topic in semiconductors today is the recognition that the real market opportunity for AI silicon is going to be the market for AI inference. We think this makes sense, but we are starting to wonder whether anyone is going to make any money from this.

The market for AI inference is important for two reasons. First, Nvidia seems to have a lock on AI training. True, AMD and Intel have offerings in this space, but let’s classify those as “aspirational” for now. For the time being, this is Nvidia’s market. Second, the market for AI inference is likely to be much larger than the training market. Intel’s CEO Pat Gelsinger has a good analogy for this – weather models. Only a few entities need to create weather prediction models (NASA, NOAA, etc), but everyone wants to check the weather.

Editor’s Note:
Guest author Jonathan Goldberg is the founder of D2D Advisory, a multi-functional consulting firm. Jonathan has developed growth strategies and alliances for companies in the mobile, networking, gaming, and software industries.

The same holds for AI, the utility of models will be derived by the ability of end-users to make use of them. As a result, the importance of the inference market has been a consistent theme in all the analyst and investor events we have attended recently, and even Nvidia has shifted their positioning lately to talk a lot more about inference.

Of course, there are two pieces of the inference market – cloud and edge. Cloud inference takes place in the data center and edge inference takes place on the device. We have heard people debate the definition of these two recently, the boundaries can get a bit blurry. But we think the breakdown is fairly straightforward, if the company operating the model pays for the capex that is cloud inference, if the end user pays the capex (by buying a phone or PC) that is edge inference.

Cloud inference is likely to be the most interesting contest to watch. Nvidia has articulated a very strong case for why they will transfer their dominance in training to inference. Put simply, there is a lot of overlap and Nvidia has Cuda and other software tools to make the connection between the two very easy. We suspect this will appeal to many customers, we are in an era of “You don’t get fired for buying Nvidia”, and the company has a lot to offer here.

On the other hand, their big competitors are going to push very hard for their share of this market. Moreover, the hyperscalers who will likely consume the majority of inference silicon have the ability to break the reliance on Nvidia whether by designing their own silicon or making full use of the competition. We expect this to be the center of a lot of attention in coming years.

The market for edge inference is a much more open question. For starters, no one really knows how much AI models will rely on the edge. The companies that are operating these models (especially the hyperscalers) would really like for edge inference to predominate. This will greatly reduce the amount of money they have to spend building all those cloud inference data centers. We suspect that the economics of AI may not pencil out if this is not possible.

The reality is that we do not know what consumers would be willing to pay because we do not really know what AI will do for consumers.

That being said, this vision comes with a significant caveat – will consumers actually be willing to pay for AI? Today, if we asked the average consumer how much they would pay to run ChatGPT on their own computer we suspect the answer would be $0. Yes, they are willing to pay $20 a month to use ChatGPT, but would they be willing to pay more to get it to run locally. The benefit of this is not entirely clear, maybe they could get answers more quickly but ChatGPT is already fairly fast when delivered from the cloud. And if consumers are not willing to pay more for PCs or phones with “AI capabilities” then the chip makers will not be able to charge premiums for silicon with those capabilities. We mentioned that Qualcomm faces this problem in smartphones, but the same applies to Intel and AMD for PCs.

We have asked everyone about this and have yet to get a clear answer. The reality is that we do not know what consumers would be willing to pay because we do not really know what AI will do for consumers. When pressed, the semis executives we spoke with all tend to default to some version of “We have seen some incredible demos, coming soon” or “We think Microsoft is working on some incredible things”. These are fair answers, we are not (yet) full-blown AI skeptics, and we imagine there are some incredible projects in the works.

This reliance on software begs the question as to how much value there is for semis makers in AI. If the value of those AI PCs depends on software companies (especially Microsoft) then it is likely to assume that Microsoft will capture the bulk of the value for consumer AI services. Microsoft is kind of an expert at this. There is a very real possibility that the only boost that comes from AI semis will be that they spark a one-time device refresh. That will be good for a year or two, but is much smaller than the massive opportunity some companies are making AI out to be.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : TechSpot – https://www.techspot.com/news/101432-opinion-anyone-going-make-money-ai-inference.html

Tags: AnyoneOpiniontechnology
Previous Post

Infographic shows how the PC fared against other platforms over 50+ years of gaming

Next Post

CES 2024’s Cutting-Edge Tech: Here Are Our Early Favorites

Kehoe calls special session on storm damage, KC sports teams – FOX 2

Kehoe Announces Special Session to Address Storm Damage and Support KC Sports Teams

June 3, 2025
From Eggs To Fingerlings, Wyoming Students Dive Into The World Of Fish Conservation – KGAB

From Eggs to Fingerlings: Wyoming Students Make Waves in Fish Conservation!

June 3, 2025
‘Sport Science’ founder, host John Brenkus dies at 54 – USA Today

Remembering John Brenkus: The Visionary Behind ‘Sport Science’ Passes Away at 54

June 3, 2025
Champion for Science Education Begins Term as 2025–2026 President of the National Science Teaching Association – FinancialContent

New Era for Science Education: Meet the 2025–2026 President of the National Science Teaching Association!

June 3, 2025
What is the 6-6-6 walking workout that’s going viral? Know its health benefits – financialexpress.com

Discover the Viral 6-6-6 Walking Workout: Unlock Its Amazing Health Benefits!

June 3, 2025

Rediscovered After 185 Years: Meet the Adorable Asian Small-Clawed Otter, the World’s Tiniest Otter Species!

June 3, 2025
USD/JPY climbs a full cent as the US economy keeps on rolling – TradingView

USD/JPY Soars as US Economic Momentum Continues!

June 3, 2025
Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

June 3, 2025
Entry list: Henry Ford Health 200 at Michigan International Speedway – arcaracing.com

Get Ready for the Henry Ford Health 200: Exciting Entry List Revealed for Michigan International Speedway!

June 3, 2025
Inside Iowa Politics: The men who have disappeared from the workforce – KTIV

Inside Iowa Politics: The men who have disappeared from the workforce – KTIV

June 3, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (663)
  • Economy (677)
  • Entertainment (21,583)
  • General (15,260)
  • Health (9,720)
  • Lifestyle (680)
  • News (22,149)
  • People (678)
  • Politics (686)
  • Science (15,898)
  • Sports (21,182)
  • Technology (15,663)
  • World (665)

Recent News

Kehoe calls special session on storm damage, KC sports teams – FOX 2

Kehoe Announces Special Session to Address Storm Damage and Support KC Sports Teams

June 3, 2025
From Eggs To Fingerlings, Wyoming Students Dive Into The World Of Fish Conservation – KGAB

From Eggs to Fingerlings: Wyoming Students Make Waves in Fish Conservation!

June 3, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version