* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Sunday, October 12, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Diane Keaton, Oscar-Winning Star of ‘Annie Hall’ and ‘The Godfather,’ Dies at 79 – Yahoo

    Diane Keaton, Oscar-Winning Star of ‘Annie Hall’ and ‘The Godfather,’ Dies at 79 – Yahoo

    THE VAMPIRE LESTAT Shares First Look Teaser Trailer (And It’s Fangtastic) – Yahoo

    THE VAMPIRE LESTAT Shares First Look Teaser Trailer (And It’s Fangtastic) – Yahoo

    The Live-Action Simpsons Movie That Was Supposed To Star Phil Hartman – Yahoo

    The Live-Action Simpsons Movie That Was Supposed To Star Phil Hartman – Yahoo

    The Best “Friends” Halloween Episodes That Blend Spooky And Silly In The Perfect Way – Yahoo

    The Best “Friends” Halloween Episodes That Blend Spooky And Silly In The Perfect Way – Yahoo

    MSG Entertainment Takes Radio City Music Hall Into the Future With Introduction of Sphere Immersive Sound – Business Wire

    MSG Entertainment Transforms Radio City Music Hall with Cutting-Edge Sphere Immersive Sound Experience

    Israel’s Entertainment Industry Is Being Targeted by the Left in Hollywood and the Right at Home – The Wall Street Journal

    Inside the Fierce Clash Shaping Israel’s Entertainment Industry: Hollywood vs. Local Voices

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Inside Europe’s military technology resurgence – NBC News

    Europe’s Bold Comeback: Unveiling the Rise of Cutting-Edge Military Technology

    Vicor Corporation: Great Technology, Execution Trapped In Time (NASDAQ:VICR) – Seeking Alpha

    Vicor Corporation: Innovative Technology Hindered by Lackluster Execution

    4J schools trying out new electronic hall pass technology – Lookout Eugene-Springfield

    4J Schools Unveils Cutting-Edge Electronic Hall Pass System to Transform Student Experience

    China outlines more controls on exports of rare earths and technology – fox40.com

    China Unveils Tougher Restrictions on Rare Earth and Technology Exports

    Wisconsin Dairy Leads the Way with Cutting-Edge Technology Systems

    ENERCON and Biome collaborate for wind turbine noise reduction technology – Yahoo Finance

    ENERCON and Biome Join Forces to Revolutionize Wind Turbine Noise Reduction

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Diane Keaton, Oscar-Winning Star of ‘Annie Hall’ and ‘The Godfather,’ Dies at 79 – Yahoo

    Diane Keaton, Oscar-Winning Star of ‘Annie Hall’ and ‘The Godfather,’ Dies at 79 – Yahoo

    THE VAMPIRE LESTAT Shares First Look Teaser Trailer (And It’s Fangtastic) – Yahoo

    THE VAMPIRE LESTAT Shares First Look Teaser Trailer (And It’s Fangtastic) – Yahoo

    The Live-Action Simpsons Movie That Was Supposed To Star Phil Hartman – Yahoo

    The Live-Action Simpsons Movie That Was Supposed To Star Phil Hartman – Yahoo

    The Best “Friends” Halloween Episodes That Blend Spooky And Silly In The Perfect Way – Yahoo

    The Best “Friends” Halloween Episodes That Blend Spooky And Silly In The Perfect Way – Yahoo

    MSG Entertainment Takes Radio City Music Hall Into the Future With Introduction of Sphere Immersive Sound – Business Wire

    MSG Entertainment Transforms Radio City Music Hall with Cutting-Edge Sphere Immersive Sound Experience

    Israel’s Entertainment Industry Is Being Targeted by the Left in Hollywood and the Right at Home – The Wall Street Journal

    Inside the Fierce Clash Shaping Israel’s Entertainment Industry: Hollywood vs. Local Voices

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Inside Europe’s military technology resurgence – NBC News

    Europe’s Bold Comeback: Unveiling the Rise of Cutting-Edge Military Technology

    Vicor Corporation: Great Technology, Execution Trapped In Time (NASDAQ:VICR) – Seeking Alpha

    Vicor Corporation: Innovative Technology Hindered by Lackluster Execution

    4J schools trying out new electronic hall pass technology – Lookout Eugene-Springfield

    4J Schools Unveils Cutting-Edge Electronic Hall Pass System to Transform Student Experience

    China outlines more controls on exports of rare earths and technology – fox40.com

    China Unveils Tougher Restrictions on Rare Earth and Technology Exports

    Wisconsin Dairy Leads the Way with Cutting-Edge Technology Systems

    ENERCON and Biome collaborate for wind turbine noise reduction technology – Yahoo Finance

    ENERCON and Biome Join Forces to Revolutionize Wind Turbine Noise Reduction

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Google DeepMind unveils ‘superhuman’ AI system that excels in fact-checking, saving costs and improving accuracy

March 29, 2024
in Technology
Google DeepMind unveils ‘superhuman’ AI system that excels in fact-checking, saving costs and improving accuracy
Share on FacebookShare on Twitter

Join us in Atlanta on April 10th and explore the landscape of security workforce. We will explore the vision, benefits, and use cases of AI for security teams. Request an invite here.

A new study from Google’s DeepMind research unit has found that an artificial intelligence system can outperform human fact-checkers when evaluating the accuracy of information generated by large language models.

The paper, titled “Long-form factuality in large language models” and published on the pre-print server arXiv, introduces a method called Search-Augmented Factuality Evaluator (SAFE). SAFE uses a large language model to break down generated text into individual facts, and then uses Google Search results to determine the accuracy of each claim.

“SAFE utilizes an LLM to break down a long-form response into a set of individual facts and to evaluate the accuracy of each fact using a multi-step reasoning process comprising sending search queries to Google Search and determining whether a fact is supported by the search results,” the authors explained.

‘Superhuman’ performance sparks debate

The researchers pitted SAFE against human annotators on a dataset of roughly 16,000 facts, finding that SAFE’s assessments matched the human ratings 72% of the time. Even more notably, in a sample of 100 disagreements between SAFE and the human raters, SAFE’s judgment was found to be correct in 76% of cases.

VB Event

The AI Impact Tour – Atlanta

Continuing our tour, we’re headed to Atlanta for the AI Impact Tour stop on April 10th. This exclusive, invite-only event, in partnership with Microsoft, will feature discussions on how generative AI is transforming the security workforce. Space is limited, so request an invite today.

Request an invite

While the paper asserts that “LLM agents can achieve superhuman rating performance,” some experts are questioning what “superhuman” really means here.

On a quick read I can’t figure out much about the human subjects, but it looks like superhuman means better than an underpaid crowd worker, rather a true human fact checker? That makes the characterization misleading. (Like saying that 1985 chess software was superhuman).…

— Gary Marcus (@GaryMarcus) March 28, 2024

Gary Marcus, a well-known AI researcher and frequent critic of overhyped claims, suggested on Twitter that in this case, “superhuman” may simply mean “better than an underpaid crowd worker, rather a true human fact checker.”

“That makes the characterization misleading,” he said. “Like saying that 1985 chess software was superhuman.”

Marcus raises a valid point. To truly demonstrate superhuman performance, SAFE would need to be benchmarked against expert human fact-checkers, not just crowdsourced workers. The specific details of the human raters, such as their qualifications, compensation, and fact-checking process, are crucial for properly contextualizing the results.

Cost savings and benchmarking top models

One clear advantage of SAFE is cost — the researchers found that using the AI system was about 20 times cheaper than human fact-checkers. As the volume of information generated by language models continues to explode, having an economical and scalable way to verify claims will be increasingly vital.

The DeepMind team used SAFE to evaluate the factual accuracy of 13 top language models across 4 families (Gemini, GPT, Claude, and PaLM-2) on a new benchmark called LongFact. Their results indicate that larger models generally produced fewer factual errors. 

However, even the best-performing models generated a significant number of false claims. This underscores the risks of over-relying on language models that can fluently express inaccurate information. Automatic fact-checking tools like SAFE could play a key role in mitigating those risks.

Transparency and human baselines are crucial

While the SAFE code and LongFact dataset have been open-sourced on GitHub, allowing other researchers to scrutinize and build upon the work, more transparency is still needed around the human baselines used in the study. Understanding the specifics of the crowdworkers’ background and process is essential for assessing SAFE’s capabilities in proper context.

As the tech giants race to develop ever more powerful language models for applications ranging from search to virtual assistants, the ability to automatically fact-check the outputs of these systems could prove pivotal. Tools like SAFE represent an important step towards building a new layer of trust and accountability.

However, it’s crucial that the development of such consequential technologies happens in the open, with input from a broad range of stakeholders beyond the walls of any one company. Rigorous, transparent benchmarking against human experts — not just crowdworkers — will be essential to measure true progress. Only then can we gauge the real-world impact of automated fact-checking on the fight against misinformation.

VB Daily

Stay in the know! Get the latest news in your inbox daily

By subscribing, you agree to VentureBeat’s Terms of Service.

Thanks for subscribing. Check out more VB newsletters here.

An error occured.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : VentureBeat – https://venturebeat.com/ai/google-deepmind-unveils-superhuman-ai-system-that-excels-in-fact-checking-saving-costs-and-improving-accuracy/

Tags: DeepMindGoogletechnology
Previous Post

The Pirate Queen interview: How Singer Studios and Lucy Liu brought forgotten history to life

Next Post

How data can help you understand the game industry | Joost Van Dreunen interview

Global Warning: Our future in a warmer world – Al Jazeera

Global Warning: Our future in a warmer world – Al Jazeera

October 12, 2025
UCF Economist: Florida’s Economic Outlook Still Sunny — But Storm Clouds Loom – University of Central Florida

Florida’s Economic Future Shines Bright-But Storm Clouds Loom Ahead

October 12, 2025
Diane Keaton, Oscar-Winning Star of ‘Annie Hall’ and ‘The Godfather,’ Dies at 79 – Yahoo

Diane Keaton, Oscar-Winning Star of ‘Annie Hall’ and ‘The Godfather,’ Dies at 79 – Yahoo

October 12, 2025
Yale’s Head of Emergency Medicine Discusses Health Challenges, and ‘The Pitt’ – Yale Medicine

Yale’s Head of Emergency Medicine Discusses Health Challenges, and ‘The Pitt’ – Yale Medicine

October 12, 2025
Former President Joe Biden undergoing radiation therapy for prostate cancer – Spectrum News

Former President Joe Biden undergoing radiation therapy for prostate cancer – Spectrum News

October 12, 2025
Whatcom County farm reaches settlement over illegal irrigation allegations – My Bellingham Now

Whatcom County Farm Reaches Settlement in Illegal Irrigation Case

October 11, 2025
Taylor Robinson on Data, Biosecurity, and the Science Behind Healthier Vertical Farms – iGrow News

Taylor Robinson on Data, Biosecurity, and the Science Behind Healthier Vertical Farms – iGrow News

October 11, 2025
Grand opening of the new UNR College of Agriculture Main Station Farm Science Center – KTVN

Join the Exciting Grand Opening of the New UNR College of Agriculture Main Station Farm Science Center!

October 11, 2025
PS Store Adds Helpful Feature But Users Have Concerns – PlayStation LifeStyle

PS Store Adds Helpful Feature But Users Have Concerns – PlayStation LifeStyle

October 11, 2025
Inside Europe’s military technology resurgence – NBC News

Europe’s Bold Comeback: Unveiling the Rise of Cutting-Edge Military Technology

October 11, 2025

Categories

Archives

October 2025
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
2728293031  
« Sep    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (863)
  • Economy (884)
  • Entertainment (21,757)
  • General (17,544)
  • Health (9,926)
  • Lifestyle (896)
  • News (22,149)
  • People (884)
  • Politics (894)
  • Science (16,094)
  • Sports (21,384)
  • Technology (15,864)
  • World (867)

Recent News

Global Warning: Our future in a warmer world – Al Jazeera

Global Warning: Our future in a warmer world – Al Jazeera

October 12, 2025
UCF Economist: Florida’s Economic Outlook Still Sunny — But Storm Clouds Loom – University of Central Florida

Florida’s Economic Future Shines Bright-But Storm Clouds Loom Ahead

October 12, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version