* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Sunday, August 24, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Quotes of the Week: Peacemaker, Project Runway, Countdown and More – yahoo.com

    This Week’s Most Memorable Quotes from Peacemaker, Project Runway, Countdown, and More!

    Drake Appears in Teaser for Bobbi Althoff’s New Podcast ‘Not This Again’ – yahoo.com

    Drake Drops a Surprise Cameo in Bobbi Althoff’s Thrilling New Podcast Teaser ‘Not This Again

    From polka to Poison, Corn Palace adjusts entertainment offerings with the times – Mitchell Republic

    From polka to Poison, Corn Palace adjusts entertainment offerings with the times – Mitchell Republic

    How to watch ‘F1: The Movie’ on Prime Video – About Amazon

    Experience the Thrill: How to Stream ‘F1: The Movie’ on Prime Video

    FOX One is now available on Prime Video: Here’s everything to know – About Amazon

    FOX One is now available on Prime Video: Here’s everything to know – About Amazon

    What Are Our Predictions for Taylor Swift’s ‘Life of a Showgirl’ Based on What She’s Told Us So Far? – yahoo.com

    Uncover the Hidden Surprises in Taylor Swift’s ‘Life of a Showgirl’ – Can You Decode Her Clues?

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    UNLV Responds to Workforce Need with Microcredential in Nuclear Technology – University of Nevada, Las Vegas | UNLV

    UNLV Unveils Cutting-Edge Microcredential Program to Fuel Growth in Nuclear Technology

    Why Technology Will Never Take Over Completely – Patheos

    Why Technology Will Never Completely Control Our Lives

    Alcorn State awarded grant to boost STEM with VR technology – WJTV

    Alcorn State Secures Grant to Transform STEM Education Through Cutting-Edge VR Technology

    Hyundai: The Only Way To Beat China Is To Embrace Technology – InsideEVs

    Hyundai’s Bold Strategy to Outpace China with Cutting-Edge Technology

    Teaching older adults how to use technology – WWNY

    Empowering Older Adults to Master Technology with Confidence

    Denver man receives pacemaker using new technology – CBS News

    Denver Man’s Life Transformed by Revolutionary Pacemaker Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Quotes of the Week: Peacemaker, Project Runway, Countdown and More – yahoo.com

    This Week’s Most Memorable Quotes from Peacemaker, Project Runway, Countdown, and More!

    Drake Appears in Teaser for Bobbi Althoff’s New Podcast ‘Not This Again’ – yahoo.com

    Drake Drops a Surprise Cameo in Bobbi Althoff’s Thrilling New Podcast Teaser ‘Not This Again

    From polka to Poison, Corn Palace adjusts entertainment offerings with the times – Mitchell Republic

    From polka to Poison, Corn Palace adjusts entertainment offerings with the times – Mitchell Republic

    How to watch ‘F1: The Movie’ on Prime Video – About Amazon

    Experience the Thrill: How to Stream ‘F1: The Movie’ on Prime Video

    FOX One is now available on Prime Video: Here’s everything to know – About Amazon

    FOX One is now available on Prime Video: Here’s everything to know – About Amazon

    What Are Our Predictions for Taylor Swift’s ‘Life of a Showgirl’ Based on What She’s Told Us So Far? – yahoo.com

    Uncover the Hidden Surprises in Taylor Swift’s ‘Life of a Showgirl’ – Can You Decode Her Clues?

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    UNLV Responds to Workforce Need with Microcredential in Nuclear Technology – University of Nevada, Las Vegas | UNLV

    UNLV Unveils Cutting-Edge Microcredential Program to Fuel Growth in Nuclear Technology

    Why Technology Will Never Take Over Completely – Patheos

    Why Technology Will Never Completely Control Our Lives

    Alcorn State awarded grant to boost STEM with VR technology – WJTV

    Alcorn State Secures Grant to Transform STEM Education Through Cutting-Edge VR Technology

    Hyundai: The Only Way To Beat China Is To Embrace Technology – InsideEVs

    Hyundai’s Bold Strategy to Outpace China with Cutting-Edge Technology

    Teaching older adults how to use technology – WWNY

    Empowering Older Adults to Master Technology with Confidence

    Denver man receives pacemaker using new technology – CBS News

    Denver Man’s Life Transformed by Revolutionary Pacemaker Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

AI reality check: New NPUs don’t matter as much as you’d think

January 12, 2024
in Technology
AI reality check: New NPUs don’t matter as much as you’d think
Share on FacebookShare on Twitter

You probably already own an AI PC.

In the past few months, Intel and PC makers have beat the drum of the AI PC loudly and in concert with AMD, Intel, and Qualcomm. It’s no secret that “AI” is the new “metaverse” — you know, that thing that everyone was talking up a few years ago — and executives and investors alike want to use AI to boost sales and stock prices.

And it’s true that AI does depend on the NPUs found in chips like Intel’s Core Ultra, the brand that Intel is positioning as synonymous with on-chip AI. The same goes for AMD’s Ryzen 8000 series — which beat Intel to the desktop with an NPU — as well as Qualcomm’s Snapdragon X Elite.

It’s just that the integrated NPUs found within the Core Ultra right now (Meteor Lake, but with Lunar Lake waiting in the wings) do not play the outsized role in AI computation that they’re being positioned as. Instead, the more traditional roles for computational horsepower (the CPU and especially the GPU) contribute more to the task.

It’s important to note several things: First, actually benchmarking AI performance is something absolutely everyone is wrestling with. “AI” is comprised of rather divergent tasks: image generation, such as using Stable Diffusion; large-language models (LLMs), the chatbots popularized by the (cloud-based) Microsoft Copilot and Google Bard; and a host of application-specific enhancements, such as AI improvements in Adobe Premiere and Lightroom. Combine the numerous variables in LLMs alone (frameworks, models, and quantization, all of which affect how chatbots will run on a PC) and the pace at which these variables fluctuate, and it’s very difficult to pick a winner — and for more than a moment in time.

The next point, though, is one that we can say with some certainty: That benchmarking works best when you eliminate as many variables as possible. And that’s what we can do with one small piece of the puzzle: How much does the CPU, GPU, and NPU contribute to AI calculations performed by Intel’s Core Ultra chip, Meteor Lake.

Intel Meteor Lake MSI test bedIntel’s Meteor Lake test bed, from MSI.

Mark Hachman / IDG

The NPU isn’t the engine of on-chip AI right now. The GPU is

We’re not trying to establish how well Meteor Lake performs in AI. But what we can do is perform a reality check on how much the NPU matters in AI.

The specific test we’re using is UL’s Procyon AI inferencing benchmark, which calculates how effectively a processor runs when handling various large language models. Specifically, it allows the tester to break it down, comparing the CPU, GPU, and NPU.

In this case, we tested the Core Ultra 7 165H inside an MSI laptop, provided for testing during an Intel benchmarking day at CES 2024. (Much of my time was spent interviewing Dan Rogers of Intel, but I was able to get some tests in.) Procyon runs the LLMs on top of the processor and calculates a score, based upon performance, latency, and so on.

Without ado, here are the numbers:

Procyon (OpenVINO) NPU: 356

Procyon (OpenVINO) GPU: 552

Procyon (OpenVINO): CPU: 196

The Procyon tests proved several points: First, the NPU does make a difference; compared to the performance and efficiency cores elsewhere in the CPU, the NPU outperforms it by 82 percent, all by itself. But the GPU’s AI performance is 182 percent of the CPU, and outperforms the NPU by 55 percent.

Intel Meteor Lake Procyon AI detailThe detailed results for the Procyon NPU inferencing test for the Core 7 Ultra 165H.

Mark Hachman / IDG

Put another way: If you value AI, buy a large, beefy graphics card or GPU first.

But the second point is less obvious: Yes, you can run AI applications on a CPU or GPU, without any need for a dedicated AI logic block. All the Procyon tests demonstrate is that some blocks are more effective than others.

Intel’s claim is that the NPU is more efficient. In the real world, “efficiency” is chipmaker code for “long battery life.” At the same time, Intel has tried to emphasize that the CPU, GPU, and NPU can work together.

Intel Meteor Lake Compute Tile NPU AI hybridIntel made this point early on about how various parts of Meteor Lake could work together, such as on Stable Diffusion.

Intel

In this case, the NPU’s efficiency equates to AI applications that operate over time, and probably on battery. And the best example of that is a lengthy Microsoft Teams call from the depths of a hotel room or conference center (just like CES!) where AI is being used to filter out noise and background activity.

Typically, AI art applications like Stable Diffusion have launched first using the power of your GPU, alongside a ton of available VRAM, to generate local AI art. But over time AI applications have evolved to run on less powerful configurations, including mostly on the CPU. This is a familiar metaphor; you’re not going to run a graphics-intensive game like Crysis well on integrated hardware, but it should run — just very, very slowly. AI LLMs / chatbots will do the same, “thinking” for a long time about their responses and then “typing” them out very slowly. LLMs that can run on a GPU will perform better, and cloud-based solutions will be much faster.

However, AI will evolve

It’s interesting, too, that (as of this writing) UL’s Procyon app recognizes the CPU and the GPU in the AMD Ryzen AI-powered Ryzen 7040, but not the NPU. We’re in the very early days of AI, when not even the basic capabilities of the chips themselves are recognized by the applications that are designed to use them. This just complicates testing even further.

The point is, however, that you don’t need an NPU to run AI on your PC, especially if you already have a gaming laptop or desktop. NPUs from AMD, Intel, and Qualcomm will be nice to have, but they’re not must-haves, either.

Intel Lunar Lake CES 2024Intel’s Michelle Johnston Holthaus, an executive in its Client Computing Group, holds up a sample of Lunar Lake, which is currently sampling to Intel’s PC partners.

Mark Hachman / IDG

It won’t always be this way, though. Intel’s promising that the NPU in the upcoming Lunar Lake chip due at the end of this year will have three times the NPU performance. It’s not saying anything about the CPU or the GPU performance. It’s very possible that, over time, the NPU’s performance in various PC chips will grow so that their AI performance will become massively disproportionate compared to the other parts of the chip. And if not, a slew of AI accelerator chip startups have plans to become the 3Dfx’s of the AI world.

For now, though, we’re here to take a deep breath as 2024 begins. New AI PCs matter, as do the new NPUs. But consumers probably won’t care as much as chipmakers that AI is running on their PC, versus the cloud, no matter how loud the hype is. And for those that do care, the NPU is just one piece of the overall solution.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : PCWorld – https://www.pcworld.com/article/2199565/ai-reality-check-new-npus-dont-matter-as-much-as-youd-think.html

Tags: Checkrealitytechnology
Previous Post

This 5-screen portable battlestation feels perfect for Las Vegas

Next Post

ByteDance’s New Commercial Adjustment: Dongchedi Becomes An Independent Company

Julia Schell scores six tries as Canada thrash Fiji in Women’s Rugby World Cup – The Guardian

Julia Schell scores six tries as Canada thrash Fiji in Women’s Rugby World Cup – The Guardian

August 24, 2025
Why Tipping Feels Out of Control in Today’s Economy – MSN

Why Tipping Feels Out of Control in Today’s Economy – MSN

August 24, 2025
Quotes of the Week: Peacemaker, Project Runway, Countdown and More – yahoo.com

This Week’s Most Memorable Quotes from Peacemaker, Project Runway, Countdown, and More!

August 24, 2025
New report demonstrates that corporal punishment harms children’s health – World Health Organization (WHO)

Shocking New Findings Expose the Serious Harm Corporal Punishment Inflicts on Children’s Health

August 24, 2025
Privately influential but publicly absent, Melania Trump is picking and choosing her moments this term – CNN

Melania Trump: Quietly Influential and Selectively Stepping Into the Spotlight This Term

August 24, 2025
Third annual event highlights cultural, ecological importance of Tawas Lake – Iosco County News Herald

Explore the Vibrant Culture and Stunning Ecology of Tawas Lake at This Year’s Exciting Third Annual Event!

August 24, 2025
UNT Ph.D. Grad Gives $2M to Launch Data Science Innovation Lab – Dallas Innovates

UNT Ph.D. Grad Gives $2M to Launch Data Science Innovation Lab – Dallas Innovates

August 24, 2025
Center to advance hunting and conservation looks to tradition, science – NBC Montana

Center Pioneers New Era in Hunting and Conservation by Merging Tradition with Science

August 24, 2025
‘Hidden gem’ – the lifestyle village beating the property slump – Stuff

‘Hidden gem’ – the lifestyle village beating the property slump – Stuff

August 24, 2025
UNLV Responds to Workforce Need with Microcredential in Nuclear Technology – University of Nevada, Las Vegas | UNLV

UNLV Unveils Cutting-Edge Microcredential Program to Fuel Growth in Nuclear Technology

August 24, 2025

Categories

Archives

August 2025
MTWTFSS
 123
45678910
11121314151617
18192021222324
25262728293031
« Jul    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (787)
  • Economy (808)
  • Entertainment (21,687)
  • General (16,646)
  • Health (9,848)
  • Lifestyle (820)
  • News (22,149)
  • People (809)
  • Politics (817)
  • Science (16,019)
  • Sports (21,306)
  • Technology (15,788)
  • World (789)

Recent News

Julia Schell scores six tries as Canada thrash Fiji in Women’s Rugby World Cup – The Guardian

Julia Schell scores six tries as Canada thrash Fiji in Women’s Rugby World Cup – The Guardian

August 24, 2025
Why Tipping Feels Out of Control in Today’s Economy – MSN

Why Tipping Feels Out of Control in Today’s Economy – MSN

August 24, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version