* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Wednesday, October 1, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Penn State-Themed Restaurant and Entertainment Spot Happy Valley Live Set to Open in State College – StateCollege.com

    Penn State-Themed Restaurant and Entertainment Spot Happy Valley Live Set to Open in State College – StateCollege.com

    The Police Made Chart History With This 1979 Hit Nearly 50 Years Ago – Yahoo

    How The Police Changed Music Forever with Their Iconic 1979 Hit Nearly 50 Years Ago

    Good Deed Entertainment Acquires Worldwide Rights To Liza Mandelup’s Documentary ‘Caterpillar’ – Deadline

    Good Deed Entertainment Lands Global Rights to Liza Mandelup’s Captivating Documentary ‘Caterpillar

    Danielle Fishel Explains Why Being on “DWTS” Makes Her Feel ‘Like It’s 1994 Again’ Filming “Boy Meets World” (Exclusive) – Yahoo

    Danielle Fishel Explains Why Being on “DWTS” Makes Her Feel ‘Like It’s 1994 Again’ Filming “Boy Meets World” (Exclusive) – Yahoo

    Jussie Smollett Claims He Was ‘Disrespected’ on the ‘Special Forces’ Season Premiere – Yahoo

    Jussie Smollett Opens Up About Feeling ‘Disrespected’ During the ‘Special Forces’ Season Premiere

    TicketSmarter Fall Entertainment Guide – Eastern Illinois University Athletics

    TicketSmarter Fall Entertainment Guide – Eastern Illinois University Athletics

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    STELLA Automotive AI Appoints Fred Seidelman as Chief Technology Officer – Yahoo Finance

    STELLA Automotive AI Appoints Fred Seidelman as New Chief Technology Officer

    Saving Energy and Money with Smart Technology – Terms of Service with Clare Duffy – Podcast on CNN Podcasts – CNN

    Saving Energy and Money with Smart Technology – Terms of Service with Clare Duffy – Podcast on CNN Podcasts – CNN

    Four Strategic Signals Technology Leaders Are Tuning In To – SPONSOR CONTENT FROM ARM – Harvard Business Review

    Four Essential Strategic Signals Every Technology Leader Should Watch

    Virginia Tech hosts annual New Music + Technology Festival this week – Cardinal News

    Virginia Tech Kicks Off Exciting Annual New Music and Technology Festival This Week

    Why I gave the world wide web away for free | Tim Berners-Lee – The Guardian

    Why I Decided to Make the World Wide Web Free for Everyone | Tim Berners-Lee

    From shale to steam: Fossil fuel technology boosts clean geothermal energy – Washington Examiner

    From Shale to Steam: How Fossil Fuel Technology is Powering a Clean Geothermal Energy Revolution

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Penn State-Themed Restaurant and Entertainment Spot Happy Valley Live Set to Open in State College – StateCollege.com

    Penn State-Themed Restaurant and Entertainment Spot Happy Valley Live Set to Open in State College – StateCollege.com

    The Police Made Chart History With This 1979 Hit Nearly 50 Years Ago – Yahoo

    How The Police Changed Music Forever with Their Iconic 1979 Hit Nearly 50 Years Ago

    Good Deed Entertainment Acquires Worldwide Rights To Liza Mandelup’s Documentary ‘Caterpillar’ – Deadline

    Good Deed Entertainment Lands Global Rights to Liza Mandelup’s Captivating Documentary ‘Caterpillar

    Danielle Fishel Explains Why Being on “DWTS” Makes Her Feel ‘Like It’s 1994 Again’ Filming “Boy Meets World” (Exclusive) – Yahoo

    Danielle Fishel Explains Why Being on “DWTS” Makes Her Feel ‘Like It’s 1994 Again’ Filming “Boy Meets World” (Exclusive) – Yahoo

    Jussie Smollett Claims He Was ‘Disrespected’ on the ‘Special Forces’ Season Premiere – Yahoo

    Jussie Smollett Opens Up About Feeling ‘Disrespected’ During the ‘Special Forces’ Season Premiere

    TicketSmarter Fall Entertainment Guide – Eastern Illinois University Athletics

    TicketSmarter Fall Entertainment Guide – Eastern Illinois University Athletics

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    STELLA Automotive AI Appoints Fred Seidelman as Chief Technology Officer – Yahoo Finance

    STELLA Automotive AI Appoints Fred Seidelman as New Chief Technology Officer

    Saving Energy and Money with Smart Technology – Terms of Service with Clare Duffy – Podcast on CNN Podcasts – CNN

    Saving Energy and Money with Smart Technology – Terms of Service with Clare Duffy – Podcast on CNN Podcasts – CNN

    Four Strategic Signals Technology Leaders Are Tuning In To – SPONSOR CONTENT FROM ARM – Harvard Business Review

    Four Essential Strategic Signals Every Technology Leader Should Watch

    Virginia Tech hosts annual New Music + Technology Festival this week – Cardinal News

    Virginia Tech Kicks Off Exciting Annual New Music and Technology Festival This Week

    Why I gave the world wide web away for free | Tim Berners-Lee – The Guardian

    Why I Decided to Make the World Wide Web Free for Everyone | Tim Berners-Lee

    From shale to steam: Fossil fuel technology boosts clean geothermal energy – Washington Examiner

    From Shale to Steam: How Fossil Fuel Technology is Powering a Clean Geothermal Energy Revolution

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Hugging Face to make $10M worth of old Nvidia GPUs freely available to AI devs

May 17, 2024
in Technology
Hugging Face to make $10M worth of old Nvidia GPUs freely available to AI devs
Share on FacebookShare on Twitter

Open source AI champion Hugging Face is making $10 million in GPU compute available to the public in a bid to ease the financial burden of model development faced by smaller dev teams.

The program, called ZeroGPU, was announced by Hugging Face CEO Clem Delangue via Xitter on Thursday.

“The open source community doesn’t have the resources available to train and demo these models that the big tech have at their disposal, which is why ChatGPT remains the most used AI application today,” he wrote.

“Hugging Face is fighting this by launching ZeroGPU, a shared infrastructure for indie and academic AI builders to run AI demos on Spaces, giving them the freedom to pursue their work without financial burden.”

Founded in 2016, Hugging Face has become a go-to source of open source AI models which have been optimized to run on a wide variety of hardware – thanks in part to close partnerships with the likes of Nvidia, Intel, AMD and others.

Delangue regards open source as the way forward for AI innovation and adoption, so his biz is making a bounty of complete resources available to whoever needs it. ZeroGPU will be made available via its application hosting service and run atop Nvidia’s older A100 accelerators – $10 million worth of them — on a shared basis.

This setup differs from the way many cloud providers rent GPU resources. Customers often require long-term commitments in order to get the best deals, which can be limiting for smaller players who can’t predict the success of their models ahead of time. The Big Cloud model is also problematic for larger ones trying to commercialize the models they already have.

Stability AI’s GPU commitments were reportedly so large that the British model builder behind the wildly popular Stable Diffusion image generator actually defaulted on its AWS bills.

The shared nature of Hugging Face’s approach means that – at first at least – it will be limited to AI inferencing, rather than training. Depending on the size of the dataset and model, training even small models can require thousands of GPUs running flat out for extended periods of time. Hugging Face’s admittedly thin support docs state that GPU functions are limited to a maximum of 120 seconds, which is clearly not sufficient for training.

The Register contacted Hugging Face for clarification on the applications of ZeroGPU, and a spokesperson replied that it is “mostly inferencing, but we have exciting ideas for the others.” So watch this space.

In terms of how Hugging Face has gotten around having to dedicate entire GPUs to individual users, there’s no shortage of ways to achieve this, depending on the level of isolation required.

According to Delangue, the system is able to “efficiently hold and release GPUs as needed” – but how that actually plays out under the hood isn’t clear.

Techniques like time slicing to run multiple workloads simultaneously and Nvidia’s multi-instance GPU (MIG) tech – which allows the chip to be partitioned into seven logical GPUs – have previously been employed by cloud providers like Vultr to make GPU compute more accessible to developers.

Another way of going about it is by running the workloads in GPU-accelerated containers orchestrated by Kubernetes. Or Hugging Face could be running serverless functions similar to how Cloudflare’s GPU services work.

However, it’s worth noting there are practical limits to all of these approaches – the big one being memory. Based on the support docs, Hugging Face appears to be using the 40GB variant of the A100. Even running 4-bit quantized models, that’s only enough grunt to support a single 80 billion parameter model. Due to key-value cache overheads, the practical limit will be less.

We’ve asked Hugging Face for clarification on how it’s going about sharing those compute resources. We’ll update if and when there’s new information.

Aleph Alpha enlists Cerebras waferscale supers to train AI for German military

US senators’ AI roadmap aims for $32B in R&D spending

OpenAI co-founder to depart ChatGPT

Datacenters looking to renewables, nuclear, and gas, in quest for more power

At a time when GPUs are a scarce resource – so much so that bit barns like Lambda and CoreWeave are using their hardware as collateral to acquire tens of thousands of additional accelerators – Hugging Face’s offering may come as a relief for startups looking to build AI-accelerated apps based on popular models.

It probably doesn’t hurt that Hugging Face raised $235 million in a Series-D funding round led by all of the AI heavy weights you might expect – including Google, Amazon, Nvidia, AMD, Intel, IBM and Qualcomm.

However, this is also somewhat ironic, in that several of Hugging Face’s biggest supporters are the ones developing the kinds of proprietary models Delangue worries could end up squeezing out smaller AI startups.

ZeroGPU Spaces is in open beta now. ®

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : The Register – https://go.theregister.com/feed/www.theregister.com/2024/05/17/hugging_face_nvidia_zerogpu/

Tags: HuggingtechnologyWorth
Previous Post

UK competition cops say Microsoft’s stake in Mistral is not a merger

Next Post

Rosalind Franklin rover gets another shot at Mars after string of bad luck

The sleepy SF neighborhood that just became one of the world’s coolest – SFGATE

The sleepy SF neighborhood that just became one of the world’s coolest – SFGATE

October 1, 2025
The “stuck economy,” tariffs and Wall Street – marketplace.org

How Tariffs and Wall Street Are Strangling the Economy’s Growth

October 1, 2025
LSU Theatre’s season opener: A handkerchief discovered by a lovesick suitor adds up to hilarity – The Advocate

Love, Laughter, and a Lost Handkerchief: LSU Theatre’s Season Opener Promises Hilarious Fun

October 1, 2025
Rural Health Transformation (RHT) Program – Centers for Medicare & Medicaid Services | CMS (.gov)

Rural Health Transformation (RHT) Program – Centers for Medicare & Medicaid Services | CMS (.gov)

October 1, 2025
Ex-NATO head on Russia: ‘We cannot change Putin’s mind’ – DW

Ex-NATO head on Russia: ‘We cannot change Putin’s mind’ – DW

October 1, 2025
PFAS in East Selah drinking water – Washington State Department of Ecology (.gov)

Alarming PFAS Contamination Discovered in East Selah Drinking Water

October 1, 2025
Science Expo – Northern Public Radio

Discover the Wonders of Science at the Exciting Expo!

October 1, 2025
Science and artificial intelligence could help personalize brain stimulation for smokers – News-Medical

How Science and AI Are Transforming Personalized Brain Stimulation to Help Smokers Quit

October 1, 2025
Review: What’s good at new prime-cuts steakhouse in Virginia Beach – Yahoo

Review: What’s good at new prime-cuts steakhouse in Virginia Beach – Yahoo

October 1, 2025
STELLA Automotive AI Appoints Fred Seidelman as Chief Technology Officer – Yahoo Finance

STELLA Automotive AI Appoints Fred Seidelman as New Chief Technology Officer

October 1, 2025

Categories

Archives

October 2025
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
2728293031  
« Sep    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (845)
  • Economy (866)
  • Entertainment (21,740)
  • General (17,347)
  • Health (9,910)
  • Lifestyle (879)
  • News (22,149)
  • People (868)
  • Politics (877)
  • Science (16,076)
  • Sports (21,366)
  • Technology (15,849)
  • World (849)

Recent News

The sleepy SF neighborhood that just became one of the world’s coolest – SFGATE

The sleepy SF neighborhood that just became one of the world’s coolest – SFGATE

October 1, 2025
The “stuck economy,” tariffs and Wall Street – marketplace.org

How Tariffs and Wall Street Are Strangling the Economy’s Growth

October 1, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version