* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Thursday, June 26, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Susquehanna Raises Penn Entertainment Inc. (PENN) Price Target. – Yahoo Finance

    Susquehanna Raises Price Target for Penn Entertainment Inc. (PENN)

    George Lopez is coming to Spokane – KXLY.com

    George Lopez is coming to Spokane – KXLY.com

    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Wayve Expands Engineering Leadership to Power Next-Gen Autonomous Driving Technology – Silicon Canals

    Wayve Boosts Engineering Leadership to Accelerate Next-Gen Autonomous Driving Innovation

    Frontdoor Announces Tech Expert Dr. Bala Ganesh as Chief Technology Officer – Business Wire

    Frontdoor Appoints Tech Visionary Dr. Bala Ganesh as New Chief Technology Officer

    Defense technology giant Northrop Grumman to host interviews in Iuka to fill technician roles – supertalk.fm

    Defense technology giant Northrop Grumman to host interviews in Iuka to fill technician roles – supertalk.fm

    China’s Military Introduces Mosquito-Sized Drones: A Game-Changing Surveillance Technology – Indian Defence Review

    China Unveils Mosquito-Sized Drones: Revolutionizing Surveillance Technology

    Marvell Technology Stock Rallies After AI Event Sparks Investor Optimism – Yahoo Finance

    Marvell Technology Stock Rallies After AI Event Sparks Investor Optimism – Yahoo Finance

    Promising Technology Stocks To Follow Today – June 22nd – MarketBeat

    Top Technology Stocks to Watch Today – June 22nd

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Susquehanna Raises Penn Entertainment Inc. (PENN) Price Target. – Yahoo Finance

    Susquehanna Raises Price Target for Penn Entertainment Inc. (PENN)

    George Lopez is coming to Spokane – KXLY.com

    George Lopez is coming to Spokane – KXLY.com

    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Wayve Expands Engineering Leadership to Power Next-Gen Autonomous Driving Technology – Silicon Canals

    Wayve Boosts Engineering Leadership to Accelerate Next-Gen Autonomous Driving Innovation

    Frontdoor Announces Tech Expert Dr. Bala Ganesh as Chief Technology Officer – Business Wire

    Frontdoor Appoints Tech Visionary Dr. Bala Ganesh as New Chief Technology Officer

    Defense technology giant Northrop Grumman to host interviews in Iuka to fill technician roles – supertalk.fm

    Defense technology giant Northrop Grumman to host interviews in Iuka to fill technician roles – supertalk.fm

    China’s Military Introduces Mosquito-Sized Drones: A Game-Changing Surveillance Technology – Indian Defence Review

    China Unveils Mosquito-Sized Drones: Revolutionizing Surveillance Technology

    Marvell Technology Stock Rallies After AI Event Sparks Investor Optimism – Yahoo Finance

    Marvell Technology Stock Rallies After AI Event Sparks Investor Optimism – Yahoo Finance

    Promising Technology Stocks To Follow Today – June 22nd – MarketBeat

    Top Technology Stocks to Watch Today – June 22nd

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Science

AI trained on AI churns out gibberish garbage

July 26, 2024
in Science
AI trained on AI churns out gibberish garbage
Share on FacebookShare on Twitter

Historical artistic interpretation of an ouroboros. It is a dragon eating its own tail.

Ouroboros. Credit: API/Gamma-Rapho via Getty Images

Large language models like those offered by OpenAI and Google famously require vast troves of training data to work. The latest versions of these models have already scoured much of the existing internet which has led some to fear there may not be enough new data left to train future iterations. Some prominent voices in the industry, like Meta CEO Mark Zuckerberg have posited a solution to that data dilemma: simply train new AI systems on old AI outputs. 

But new research suggests that cannibalizing of past model outputs would quickly result in strings of babbling AI gibberish and could eventually lead to what’s being called “model collapse.” In one example, researchers fed an AI a benign paragraph about church architecture only to have it rapidly degrade over generations. The final, most “advanced” model simply repeated the phrase “black@tailed jackrabbits” continuously.

A study published in Nature this week put that AI-trained-on-AI scenario to the test. The researchers made their own language model which they initially fed original, human-generated text. They then made nine more generations of models, each trained on the text output generated by the model before it. The end result in the final generation was nonessential surrealist-sounding gibberish that had essentially nothing to do with the original text. Over time and successive generations, the researchers say their model “becomes poisoned with its own projection of reality.” 

AI models forget meaning the more they trains on themselves 

The researchers refer to this odd case of AI seemingly imploding on itself as “model collapse,” a degenerative process that can present itself in early and late stage forms. On the early side of things, collapse begins to occur when AI models several generations removed from the original training data seemingly forgets outliers, or rarities in the original text. This has the effect of making the most likely outputs more and more common. That would be an issue in the real world, because it could result in a whittling down of minority views or expression. An LLM showing signs of early collapse could present a version of reality that lacks diversity and suffers from an overwhelming sameness.

Things get weirder in the later stages of collapse. In those last generations, the models trained on models are so far removed from the original training data that they begin to forget key aspects of the initial training and lose the plot entirely. It’s at this stage that models begin generating complete meaningless gibberish. When this happens, the researchers say the model’s “indiscriminate” self-cannibalizing of its own previous outputs “causes irreversible defects in the resulting model.” 

The researchers claim this cascading effect and eventual model collapse are inevitable for large models trained on their own data. It’s important to note this research focused specifically on language models and does not weigh on what could happen if multimodal models like image and video generators were trained on themselves. This research also zeroes in on what should happen on a model training on its own data. It’s unclear exactly what would happen if one model, say from Meta, were to train on output generated from OpenAI. 

Preserving original human text could stave off collapse 

The prospect of real-world model collapse isn’t an unthinkable hypothetical. Right now, countless websites are up and running featuring articles and blog posts entirely generated by LLMs. In the race to build new models as fast as possible, it’s not unthinkable that much of that AI-generated slop could wind up seeping its way into training sets.

One possible solution to that inadvertently including AI generated content into training sets would be to encourage a watermarking standard across platforms that clearly marks the authenticity of content and whether or not it was produced by a machine. Google, Adobe, and big tech players are trying to do just that with a special “content credential” badge they are trying to standardize as part of the The Coalition for Content Provenance and Authenticity (C2PA).

But that would only apply to images. AI-generated text is also much more difficult to feasibly watermark or even accurately identify using available detection software. A more realistic approach may require AI developers to scrupulously vet material for signs of AI manipulation, and potentially pay reputable human sources for access to train on their high quality data. Without those safeguards of human training data, the internet risks being folded by a wave of AI vomit. Nobody wants that. 

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Popular Science – https://www.popsci.com/technology/ai-trained-on-ai-gibberish/

Tags: churnssciencetrained
Previous Post

Our memory of music persists in old age

Next Post

Explore the cosmos with this telescope for 40% off

Wayve Expands Engineering Leadership to Power Next-Gen Autonomous Driving Technology – Silicon Canals

Wayve Boosts Engineering Leadership to Accelerate Next-Gen Autonomous Driving Innovation

June 26, 2025
Fantasy Football: Which teams are set to pass the most (and least) in 2025? – Yahoo Sports

Fantasy Football Preview: Which Teams Will Lead the League in Passing Attempts in 2025?

June 26, 2025
Tiny night lizards survived dinosaur-killing asteroid strike, despite being close enough to see it happen – Live Science

How Tiny Night Lizards Defied Extinction After the Dinosaur-Killing Asteroid Impact

June 26, 2025
Scientists Confirm Anti-Aging Drug Appears to Prolong Life in Animals – ScienceAlert

Scientists Confirm Anti-Aging Drug Appears to Prolong Life in Animals – ScienceAlert

June 26, 2025
Tokyo Lifestyle Makes Strategic Move into Australian Market with Premium Store in Sydney Chinatown – Stock Titan

Tokyo Lifestyle Makes Strategic Move into Australian Market with Premium Store in Sydney Chinatown – Stock Titan

June 26, 2025
First images from world’s largest digital camera reveal galaxies and cosmic collisions – NBC News

First images from world’s largest digital camera reveal galaxies and cosmic collisions – NBC News

June 26, 2025
Spirit Airlines Rebrands Travel Options: First, Premium Economy, Value – One Mile at a Time

Spirit Airlines Unveils Exciting New Travel Options: First, Premium Economy, and Value Classes

June 26, 2025
Susquehanna Raises Penn Entertainment Inc. (PENN) Price Target. – Yahoo Finance

Susquehanna Raises Price Target for Penn Entertainment Inc. (PENN)

June 26, 2025

Vanderburgh County Health Department Takes Bold Action Against Vaccine Hesitancy

June 26, 2025
Why Trump needs the world to believe Iran’s nuclear program is ‘obliterated’ – CNN

Why Trump Wants the World to Believe Iran’s Nuclear Program Is Completely Destroyed

June 26, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (698)
  • Economy (718)
  • Entertainment (21,613)
  • General (15,576)
  • Health (9,757)
  • Lifestyle (723)
  • News (22,149)
  • People (720)
  • Politics (725)
  • Science (15,936)
  • Sports (21,215)
  • Technology (15,703)
  • World (698)

Recent News

Wayve Expands Engineering Leadership to Power Next-Gen Autonomous Driving Technology – Silicon Canals

Wayve Boosts Engineering Leadership to Accelerate Next-Gen Autonomous Driving Innovation

June 26, 2025
Fantasy Football: Which teams are set to pass the most (and least) in 2025? – Yahoo Sports

Fantasy Football Preview: Which Teams Will Lead the League in Passing Attempts in 2025?

June 26, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version