* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Monday, September 1, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Comanche Nation Entertainment closes casino near Devol – KSWO 7News

    Comanche Nation Entertainment Closes Casino Near Devol in Surprising Move

    Erykah Badu Announces ‘Abi & Alan’ Album With The Alchemist Will Be Delayed – yahoo.com

    Erykah Badu Opens Up About the Delay of Her Highly Anticipated ‘Abi & Alan’ Album with The Alchemist

    If You Needed Some BTS Pics Of The Rock’s Tree Trunk Legs To Spice Up Your Day, We Got ‘Em – yahoo.com

    Need a Boost? Check Out These Epic BTS Shots of The Rock’s Tree Trunk Legs!

    Sabrina Carpenter’s pearl-clutching magic? Humor – CNN

    Sabrina Carpenter’s pearl-clutching magic? Humor – CNN

    South Park Is In Trouble And Needs To Change Course, Fast – yahoo.com

    South Park Faces Major Challenges and Must Adapt Fast to Survive

    ‘Netflix House’ entertainment complexes are coming. Here’s when they open – Los Angeles Times

    Exciting News: Netflix’s House Entertainment Complexes Are Opening Soon!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    This Secret Technology Will Make The IPhone 17 Super Thin Air – VOI.ID

    How This Breakthrough Technology Will Make the iPhone 17 Incredibly Thin and Lightweight

    Gator football kicks off with excitement and new technology – WCJB | TV20

    Gator Football Kicks Off with Thrilling Action and Innovative Technology

    Marvell Technology (MRVL) Loses 18.6% as Growth Outlook Fails to Impress – Yahoo Finance

    Marvell Technology (MRVL) Loses 18.6% as Growth Outlook Fails to Impress – Yahoo Finance

    Propelling solar technology into a perovskite future – CORDIS

    Propelling solar technology into a perovskite future – CORDIS

    13 Top Technology Trends (2025) – Exploding Topics

    13 Game-Changing Technology Trends to Watch in 2025

    Japan’s legacy LCD and chip technology find new home in India – Nikkei Asia

    How Japan’s Breakthrough LCD and Chip Technologies Are Driving Innovation in India

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Comanche Nation Entertainment closes casino near Devol – KSWO 7News

    Comanche Nation Entertainment Closes Casino Near Devol in Surprising Move

    Erykah Badu Announces ‘Abi & Alan’ Album With The Alchemist Will Be Delayed – yahoo.com

    Erykah Badu Opens Up About the Delay of Her Highly Anticipated ‘Abi & Alan’ Album with The Alchemist

    If You Needed Some BTS Pics Of The Rock’s Tree Trunk Legs To Spice Up Your Day, We Got ‘Em – yahoo.com

    Need a Boost? Check Out These Epic BTS Shots of The Rock’s Tree Trunk Legs!

    Sabrina Carpenter’s pearl-clutching magic? Humor – CNN

    Sabrina Carpenter’s pearl-clutching magic? Humor – CNN

    South Park Is In Trouble And Needs To Change Course, Fast – yahoo.com

    South Park Faces Major Challenges and Must Adapt Fast to Survive

    ‘Netflix House’ entertainment complexes are coming. Here’s when they open – Los Angeles Times

    Exciting News: Netflix’s House Entertainment Complexes Are Opening Soon!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    This Secret Technology Will Make The IPhone 17 Super Thin Air – VOI.ID

    How This Breakthrough Technology Will Make the iPhone 17 Incredibly Thin and Lightweight

    Gator football kicks off with excitement and new technology – WCJB | TV20

    Gator Football Kicks Off with Thrilling Action and Innovative Technology

    Marvell Technology (MRVL) Loses 18.6% as Growth Outlook Fails to Impress – Yahoo Finance

    Marvell Technology (MRVL) Loses 18.6% as Growth Outlook Fails to Impress – Yahoo Finance

    Propelling solar technology into a perovskite future – CORDIS

    Propelling solar technology into a perovskite future – CORDIS

    13 Top Technology Trends (2025) – Exploding Topics

    13 Game-Changing Technology Trends to Watch in 2025

    Japan’s legacy LCD and chip technology find new home in India – Nikkei Asia

    How Japan’s Breakthrough LCD and Chip Technologies Are Driving Innovation in India

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Opinion: Is anyone going to make money in AI inference?

January 8, 2024
in Technology
Opinion: Is anyone going to make money in AI inference?
Share on FacebookShare on Twitter

TechSpot is celebrating its 25th anniversary. TechSpot means tech analysis and advice you can trust.

A big topic in semiconductors today is the recognition that the real market opportunity for AI silicon is going to be the market for AI inference. We think this makes sense, but we are starting to wonder whether anyone is going to make any money from this.

The market for AI inference is important for two reasons. First, Nvidia seems to have a lock on AI training. True, AMD and Intel have offerings in this space, but let’s classify those as “aspirational” for now. For the time being, this is Nvidia’s market. Second, the market for AI inference is likely to be much larger than the training market. Intel’s CEO Pat Gelsinger has a good analogy for this – weather models. Only a few entities need to create weather prediction models (NASA, NOAA, etc), but everyone wants to check the weather.

Editor’s Note:
Guest author Jonathan Goldberg is the founder of D2D Advisory, a multi-functional consulting firm. Jonathan has developed growth strategies and alliances for companies in the mobile, networking, gaming, and software industries.

The same holds for AI, the utility of models will be derived by the ability of end-users to make use of them. As a result, the importance of the inference market has been a consistent theme in all the analyst and investor events we have attended recently, and even Nvidia has shifted their positioning lately to talk a lot more about inference.

Of course, there are two pieces of the inference market – cloud and edge. Cloud inference takes place in the data center and edge inference takes place on the device. We have heard people debate the definition of these two recently, the boundaries can get a bit blurry. But we think the breakdown is fairly straightforward, if the company operating the model pays for the capex that is cloud inference, if the end user pays the capex (by buying a phone or PC) that is edge inference.

Cloud inference is likely to be the most interesting contest to watch. Nvidia has articulated a very strong case for why they will transfer their dominance in training to inference. Put simply, there is a lot of overlap and Nvidia has Cuda and other software tools to make the connection between the two very easy. We suspect this will appeal to many customers, we are in an era of “You don’t get fired for buying Nvidia”, and the company has a lot to offer here.

On the other hand, their big competitors are going to push very hard for their share of this market. Moreover, the hyperscalers who will likely consume the majority of inference silicon have the ability to break the reliance on Nvidia whether by designing their own silicon or making full use of the competition. We expect this to be the center of a lot of attention in coming years.

The market for edge inference is a much more open question. For starters, no one really knows how much AI models will rely on the edge. The companies that are operating these models (especially the hyperscalers) would really like for edge inference to predominate. This will greatly reduce the amount of money they have to spend building all those cloud inference data centers. We suspect that the economics of AI may not pencil out if this is not possible.

The reality is that we do not know what consumers would be willing to pay because we do not really know what AI will do for consumers.

That being said, this vision comes with a significant caveat – will consumers actually be willing to pay for AI? Today, if we asked the average consumer how much they would pay to run ChatGPT on their own computer we suspect the answer would be $0. Yes, they are willing to pay $20 a month to use ChatGPT, but would they be willing to pay more to get it to run locally. The benefit of this is not entirely clear, maybe they could get answers more quickly but ChatGPT is already fairly fast when delivered from the cloud. And if consumers are not willing to pay more for PCs or phones with “AI capabilities” then the chip makers will not be able to charge premiums for silicon with those capabilities. We mentioned that Qualcomm faces this problem in smartphones, but the same applies to Intel and AMD for PCs.

We have asked everyone about this and have yet to get a clear answer. The reality is that we do not know what consumers would be willing to pay because we do not really know what AI will do for consumers. When pressed, the semis executives we spoke with all tend to default to some version of “We have seen some incredible demos, coming soon” or “We think Microsoft is working on some incredible things”. These are fair answers, we are not (yet) full-blown AI skeptics, and we imagine there are some incredible projects in the works.

This reliance on software begs the question as to how much value there is for semis makers in AI. If the value of those AI PCs depends on software companies (especially Microsoft) then it is likely to assume that Microsoft will capture the bulk of the value for consumer AI services. Microsoft is kind of an expert at this. There is a very real possibility that the only boost that comes from AI semis will be that they spark a one-time device refresh. That will be good for a year or two, but is much smaller than the massive opportunity some companies are making AI out to be.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : TechSpot – https://www.techspot.com/news/101432-opinion-anyone-going-make-money-ai-inference.html

Tags: AnyoneOpiniontechnology
Previous Post

Infographic shows how the PC fared against other platforms over 50+ years of gaming

Next Post

CES 2024’s Cutting-Edge Tech: Here Are Our Early Favorites

Sky High Farm’s Biennial Blends Art, Agriculture and Ecological Urgency – observer.com

Sky High Farm’s Biennial Blends Art, Agriculture and Ecological Urgency – observer.com

September 1, 2025

After 150 Job Applications and Rescinded Offers, Computer Science Grads Face an Unforgiving Job Market

September 1, 2025
Proportion of US students taking chemistry fails to keep pace with other science disciplines – Chemistry World

Why Fewer US Students Are Choosing Chemistry Compared to Other Sciences

September 1, 2025
Going zero-waste for a month opened my eyes — here are 7 lessons I wish I knew sooner – VegOut

7 Eye-Opening Lessons I Learned from Living Zero-Waste for a Month

September 1, 2025
This Secret Technology Will Make The IPhone 17 Super Thin Air – VOI.ID

How This Breakthrough Technology Will Make the iPhone 17 Incredibly Thin and Lightweight

September 1, 2025
2 men shot and killed at Don Knabe Community Regional Park in Cerritos – ABC7 Los Angeles

2 men shot and killed at Don Knabe Community Regional Park in Cerritos – ABC7 Los Angeles

September 1, 2025
More drama to come after Australia, USA ignite Women’s Rugby World Cup – ESPN

More drama to come after Australia, USA ignite Women’s Rugby World Cup – ESPN

September 1, 2025
India Was the Economic Alternative to China. Trump Ended That. – The New York Times

How Trump’s Policies Disrupted India’s Bid to Challenge China as an Economic Powerhouse

September 1, 2025
Comanche Nation Entertainment closes casino near Devol – KSWO 7News

Comanche Nation Entertainment Closes Casino Near Devol in Surprising Move

September 1, 2025
White House names RFK Jr deputy Jim O’Neill as replacement CDC director – BBC

White House names RFK Jr deputy Jim O’Neill as replacement CDC director – BBC

September 1, 2025

Categories

Archives

September 2025
MTWTFSS
1234567
891011121314
15161718192021
22232425262728
2930 
« Aug    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (801)
  • Economy (819)
  • Entertainment (21,699)
  • General (16,793)
  • Health (9,860)
  • Lifestyle (834)
  • News (22,149)
  • People (821)
  • Politics (827)
  • Science (16,030)
  • Sports (21,318)
  • Technology (15,800)
  • World (800)

Recent News

Sky High Farm’s Biennial Blends Art, Agriculture and Ecological Urgency – observer.com

Sky High Farm’s Biennial Blends Art, Agriculture and Ecological Urgency – observer.com

September 1, 2025

After 150 Job Applications and Rescinded Offers, Computer Science Grads Face an Unforgiving Job Market

September 1, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version