* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Thursday, June 26, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Susquehanna Raises Penn Entertainment Inc. (PENN) Price Target. – Yahoo Finance

    Susquehanna Raises Price Target for Penn Entertainment Inc. (PENN)

    George Lopez is coming to Spokane – KXLY.com

    George Lopez is coming to Spokane – KXLY.com

    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Frontdoor Announces Tech Expert Dr. Bala Ganesh as Chief Technology Officer – Business Wire

    Frontdoor Appoints Tech Visionary Dr. Bala Ganesh as New Chief Technology Officer

    Defense technology giant Northrop Grumman to host interviews in Iuka to fill technician roles – supertalk.fm

    Defense technology giant Northrop Grumman to host interviews in Iuka to fill technician roles – supertalk.fm

    China’s Military Introduces Mosquito-Sized Drones: A Game-Changing Surveillance Technology – Indian Defence Review

    China Unveils Mosquito-Sized Drones: Revolutionizing Surveillance Technology

    Marvell Technology Stock Rallies After AI Event Sparks Investor Optimism – Yahoo Finance

    Marvell Technology Stock Rallies After AI Event Sparks Investor Optimism – Yahoo Finance

    Promising Technology Stocks To Follow Today – June 22nd – MarketBeat

    Top Technology Stocks to Watch Today – June 22nd

    Technology Convergence Report 2025 – The World Economic Forum

    Technology Convergence Report 2025 – The World Economic Forum

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Susquehanna Raises Penn Entertainment Inc. (PENN) Price Target. – Yahoo Finance

    Susquehanna Raises Price Target for Penn Entertainment Inc. (PENN)

    George Lopez is coming to Spokane – KXLY.com

    George Lopez is coming to Spokane – KXLY.com

    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Frontdoor Announces Tech Expert Dr. Bala Ganesh as Chief Technology Officer – Business Wire

    Frontdoor Appoints Tech Visionary Dr. Bala Ganesh as New Chief Technology Officer

    Defense technology giant Northrop Grumman to host interviews in Iuka to fill technician roles – supertalk.fm

    Defense technology giant Northrop Grumman to host interviews in Iuka to fill technician roles – supertalk.fm

    China’s Military Introduces Mosquito-Sized Drones: A Game-Changing Surveillance Technology – Indian Defence Review

    China Unveils Mosquito-Sized Drones: Revolutionizing Surveillance Technology

    Marvell Technology Stock Rallies After AI Event Sparks Investor Optimism – Yahoo Finance

    Marvell Technology Stock Rallies After AI Event Sparks Investor Optimism – Yahoo Finance

    Promising Technology Stocks To Follow Today – June 22nd – MarketBeat

    Top Technology Stocks to Watch Today – June 22nd

    Technology Convergence Report 2025 – The World Economic Forum

    Technology Convergence Report 2025 – The World Economic Forum

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Opinion: Is anyone going to make money in AI inference?

January 8, 2024
in Technology
Opinion: Is anyone going to make money in AI inference?
Share on FacebookShare on Twitter

TechSpot is celebrating its 25th anniversary. TechSpot means tech analysis and advice you can trust.

A big topic in semiconductors today is the recognition that the real market opportunity for AI silicon is going to be the market for AI inference. We think this makes sense, but we are starting to wonder whether anyone is going to make any money from this.

The market for AI inference is important for two reasons. First, Nvidia seems to have a lock on AI training. True, AMD and Intel have offerings in this space, but let’s classify those as “aspirational” for now. For the time being, this is Nvidia’s market. Second, the market for AI inference is likely to be much larger than the training market. Intel’s CEO Pat Gelsinger has a good analogy for this – weather models. Only a few entities need to create weather prediction models (NASA, NOAA, etc), but everyone wants to check the weather.

Editor’s Note:
Guest author Jonathan Goldberg is the founder of D2D Advisory, a multi-functional consulting firm. Jonathan has developed growth strategies and alliances for companies in the mobile, networking, gaming, and software industries.

The same holds for AI, the utility of models will be derived by the ability of end-users to make use of them. As a result, the importance of the inference market has been a consistent theme in all the analyst and investor events we have attended recently, and even Nvidia has shifted their positioning lately to talk a lot more about inference.

Of course, there are two pieces of the inference market – cloud and edge. Cloud inference takes place in the data center and edge inference takes place on the device. We have heard people debate the definition of these two recently, the boundaries can get a bit blurry. But we think the breakdown is fairly straightforward, if the company operating the model pays for the capex that is cloud inference, if the end user pays the capex (by buying a phone or PC) that is edge inference.

Cloud inference is likely to be the most interesting contest to watch. Nvidia has articulated a very strong case for why they will transfer their dominance in training to inference. Put simply, there is a lot of overlap and Nvidia has Cuda and other software tools to make the connection between the two very easy. We suspect this will appeal to many customers, we are in an era of “You don’t get fired for buying Nvidia”, and the company has a lot to offer here.

On the other hand, their big competitors are going to push very hard for their share of this market. Moreover, the hyperscalers who will likely consume the majority of inference silicon have the ability to break the reliance on Nvidia whether by designing their own silicon or making full use of the competition. We expect this to be the center of a lot of attention in coming years.

The market for edge inference is a much more open question. For starters, no one really knows how much AI models will rely on the edge. The companies that are operating these models (especially the hyperscalers) would really like for edge inference to predominate. This will greatly reduce the amount of money they have to spend building all those cloud inference data centers. We suspect that the economics of AI may not pencil out if this is not possible.

The reality is that we do not know what consumers would be willing to pay because we do not really know what AI will do for consumers.

That being said, this vision comes with a significant caveat – will consumers actually be willing to pay for AI? Today, if we asked the average consumer how much they would pay to run ChatGPT on their own computer we suspect the answer would be $0. Yes, they are willing to pay $20 a month to use ChatGPT, but would they be willing to pay more to get it to run locally. The benefit of this is not entirely clear, maybe they could get answers more quickly but ChatGPT is already fairly fast when delivered from the cloud. And if consumers are not willing to pay more for PCs or phones with “AI capabilities” then the chip makers will not be able to charge premiums for silicon with those capabilities. We mentioned that Qualcomm faces this problem in smartphones, but the same applies to Intel and AMD for PCs.

We have asked everyone about this and have yet to get a clear answer. The reality is that we do not know what consumers would be willing to pay because we do not really know what AI will do for consumers. When pressed, the semis executives we spoke with all tend to default to some version of “We have seen some incredible demos, coming soon” or “We think Microsoft is working on some incredible things”. These are fair answers, we are not (yet) full-blown AI skeptics, and we imagine there are some incredible projects in the works.

This reliance on software begs the question as to how much value there is for semis makers in AI. If the value of those AI PCs depends on software companies (especially Microsoft) then it is likely to assume that Microsoft will capture the bulk of the value for consumer AI services. Microsoft is kind of an expert at this. There is a very real possibility that the only boost that comes from AI semis will be that they spark a one-time device refresh. That will be good for a year or two, but is much smaller than the massive opportunity some companies are making AI out to be.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : TechSpot – https://www.techspot.com/news/101432-opinion-anyone-going-make-money-ai-inference.html

Tags: AnyoneOpiniontechnology
Previous Post

Infographic shows how the PC fared against other platforms over 50+ years of gaming

Next Post

CES 2024’s Cutting-Edge Tech: Here Are Our Early Favorites

Tiny night lizards survived dinosaur-killing asteroid strike, despite being close enough to see it happen – Live Science

How Tiny Night Lizards Defied Extinction After the Dinosaur-Killing Asteroid Impact

June 26, 2025
Scientists Confirm Anti-Aging Drug Appears to Prolong Life in Animals – ScienceAlert

Scientists Confirm Anti-Aging Drug Appears to Prolong Life in Animals – ScienceAlert

June 26, 2025
Tokyo Lifestyle Makes Strategic Move into Australian Market with Premium Store in Sydney Chinatown – Stock Titan

Tokyo Lifestyle Makes Strategic Move into Australian Market with Premium Store in Sydney Chinatown – Stock Titan

June 26, 2025
First images from world’s largest digital camera reveal galaxies and cosmic collisions – NBC News

First images from world’s largest digital camera reveal galaxies and cosmic collisions – NBC News

June 26, 2025
Spirit Airlines Rebrands Travel Options: First, Premium Economy, Value – One Mile at a Time

Spirit Airlines Unveils Exciting New Travel Options: First, Premium Economy, and Value Classes

June 26, 2025
Susquehanna Raises Penn Entertainment Inc. (PENN) Price Target. – Yahoo Finance

Susquehanna Raises Price Target for Penn Entertainment Inc. (PENN)

June 26, 2025

Vanderburgh County Health Department Takes Bold Action Against Vaccine Hesitancy

June 26, 2025
Why Trump needs the world to believe Iran’s nuclear program is ‘obliterated’ – CNN

Why Trump Wants the World to Believe Iran’s Nuclear Program Is Completely Destroyed

June 26, 2025
House panel wrangles on rail safety technology – FreightWaves

House Panel Sparks Debate Over the Future of Rail Safety Technology

June 26, 2025
The Desert Sun unveils its Top Spring Athletes: History-makers and record-breakers – The Desert Sun

Meet This Spring’s Top Athletes: History-Makers and Record-Breakers Revealed!

June 26, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (698)
  • Economy (718)
  • Entertainment (21,613)
  • General (15,574)
  • Health (9,757)
  • Lifestyle (723)
  • News (22,149)
  • People (720)
  • Politics (725)
  • Science (15,936)
  • Sports (21,214)
  • Technology (15,702)
  • World (698)

Recent News

Tiny night lizards survived dinosaur-killing asteroid strike, despite being close enough to see it happen – Live Science

How Tiny Night Lizards Defied Extinction After the Dinosaur-Killing Asteroid Impact

June 26, 2025
Scientists Confirm Anti-Aging Drug Appears to Prolong Life in Animals – ScienceAlert

Scientists Confirm Anti-Aging Drug Appears to Prolong Life in Animals – ScienceAlert

June 26, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version