* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Tuesday, August 5, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Hank Hill returns to a changed world in new ‘King of the Hill’ episodes – New Haven Register

    Hank Hill Navigates a Bold New World in Thrilling New ‘King of the Hill’ Episodes

    Exclusive | Fox Takes Stake in IndyCar Owner Penske Entertainment – The Wall Street Journal

    Exclusive | Fox Takes Stake in IndyCar Owner Penske Entertainment – The Wall Street Journal

    Go-to entertainment: why gaming was made for the toilet – The Guardian

    Why Gaming Is the Ultimate Way to Pass Time in the Bathroom

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Sens. Blackburn, Warnock introduce CREATE Act to provide tax relief to music creators – Yahoo Home

    Sens. Blackburn and Warnock Launch CREATE Act to Deliver Tax Relief for Music Creators

    That’s (Political) Entertainment: When Theatre Meets Politics

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Nasdaq-listed Verb Technology to build $558 million TON treasury, rebrand as TON Strategy Co. – The Block

    Nasdaq-Listed Verb Technology to Build $558 Million TON Treasury and Rebrand as TON Strategy Co

    How Tech Firms Like Google and Meta Are Embracing the Military – The New York Times

    How Tech Firms Like Google and Meta Are Embracing the Military – The New York Times

    Credo Technology: Wiring The AI Revolution (NASDAQ:CRDO) – Seeking Alpha

    Credo Technology: Driving the Next Wave of AI Innovation

    Microsoft Seeks to Extend Access to OpenAI Technology – PYMNTS.com

    Microsoft Aims to Broaden Access to OpenAI Technology

    Livonia police use grappler technology to stop drunk driver – ClickOnDetroit | WDIV Local 4

    Livonia Police Deploy Grappler Technology to Safely Stop Drunk Driver

    Emory orthopaedic surgeons use robotic technology to transform knee replacement surgery – Emory News Center

    How Robotic Technology is Revolutionizing Knee Replacement Surgery

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Hank Hill returns to a changed world in new ‘King of the Hill’ episodes – New Haven Register

    Hank Hill Navigates a Bold New World in Thrilling New ‘King of the Hill’ Episodes

    Exclusive | Fox Takes Stake in IndyCar Owner Penske Entertainment – The Wall Street Journal

    Exclusive | Fox Takes Stake in IndyCar Owner Penske Entertainment – The Wall Street Journal

    Go-to entertainment: why gaming was made for the toilet – The Guardian

    Why Gaming Is the Ultimate Way to Pass Time in the Bathroom

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Sens. Blackburn, Warnock introduce CREATE Act to provide tax relief to music creators – Yahoo Home

    Sens. Blackburn and Warnock Launch CREATE Act to Deliver Tax Relief for Music Creators

    That’s (Political) Entertainment: When Theatre Meets Politics

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Nasdaq-listed Verb Technology to build $558 million TON treasury, rebrand as TON Strategy Co. – The Block

    Nasdaq-Listed Verb Technology to Build $558 Million TON Treasury and Rebrand as TON Strategy Co

    How Tech Firms Like Google and Meta Are Embracing the Military – The New York Times

    How Tech Firms Like Google and Meta Are Embracing the Military – The New York Times

    Credo Technology: Wiring The AI Revolution (NASDAQ:CRDO) – Seeking Alpha

    Credo Technology: Driving the Next Wave of AI Innovation

    Microsoft Seeks to Extend Access to OpenAI Technology – PYMNTS.com

    Microsoft Aims to Broaden Access to OpenAI Technology

    Livonia police use grappler technology to stop drunk driver – ClickOnDetroit | WDIV Local 4

    Livonia Police Deploy Grappler Technology to Safely Stop Drunk Driver

    Emory orthopaedic surgeons use robotic technology to transform knee replacement surgery – Emory News Center

    How Robotic Technology is Revolutionizing Knee Replacement Surgery

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Health

Explanations Don’t Help Clinicians Spot Biased AI

December 20, 2023
in Health
Explanations Don’t Help Clinicians Spot Biased AI
Share on FacebookShare on Twitter

Providing clinicians with artificial intelligence (AI) predictions along with model explanations can boost diagnostic accuracy, but that accuracy drops when using a biased AI model — and explanations don’t mitigate those negative effects, according to a randomized clinical vignette survey study.

Clinicians who were asked to differentiate between pneumonia, heart failure, or chronic obstructive pulmonary disease (COPD) had a baseline accuracy of 73% (95% CI 68.3-77.8), which rose to about 76% when using AI without explanations. Adding in an explanation of the model — to mitigate any errors it may make — brought accuracy up to about 78%, according to Michael Sjoding, MD, of University of Michigan Health in Ann Arbor, and colleagues.

However, when using a systematically biased AI model, diagnostic accuracy fell to about 62% — a decline that wasn’t fixed by adding model explanations, which only restored accuracy to about 64%, they reported in JAMA.

“AI is being developed at an extraordinary rate, and our study shows that it has the potential to improve clinical decision making,” co-author Sarah Jabbour, MSE, also of the University of Michigan, told MedPage Today in an email. “But we must be thoughtful about how to carefully integrate AI into clinical workflows with the goal of improving clinical care while not introducing systematic errors or harming patients.”

Jabbour and colleagues explained that recent regulatory guidance has called for AI models to include explanations that may help mitigate errors made by models, but the effectiveness of this strategy hasn’t been established.

To dig deeper into the issue, they designed a study that involved analyzing vignettes of patients hospitalized with acute respiratory failure and diagnosing either pneumonia, heart failure, or COPD as the underlying cause.

To establish baseline diagnostic accuracy, clinicians — doctors, nurse practitioners, and physician assistants — were shown two vignettes without AI input. They were then randomized to see six vignettes with AI input, with or without model explanations. Three of these vignettes included standard-model predictions, while three included systematically biased predictions.

A final vignette with support from an “expert clinician” consult established an upper bound for diagnostic accuracy, which in this case was about 81%.

Overall, 457 clinicians from 13 states participated between April 2022 and January 2023, with 231 randomized to model predictions without explanations, and 226 randomized to also get explanations. Median participant age was 34 and about 58% were female.

The vignettes included presenting symptoms, physical examination, laboratory results, and chest radiographs. Biased AI models were skewed to make predictions using age, weight, and radiograph adjustments. Explanations for biased models were written to try to reveal potential biases, the researchers said.

“In our study, explanations were presented in a way that were considered to be obvious, where the AI model was completely focused on areas of the chest X-rays unrelated to the clinical condition,” Jabbour told MedPage Today. “We hypothesized that, if presented with such explanations, the participants in our study would notice that the model was behaving incorrectly and not rely on its predictions.”

“This was surprisingly not the case,” she said, “and the explanations when presented alongside biased AI predictions had seemingly no effect in mitigating clinicians’ over-reliance on biased AI.”

AI models can reflect biases that already exist in the healthcare system and can lead to worse overall clinical decision making, Jabbour said. For example, a model trained on a dataset including women who were underdiagnosed for heart failure might identify female patients as being at lower risk for heart failure, especially if clinicians rely heavily on the predictive models without further explanation, she said.

One limitation of the study was its reliance on a web-based survey interface, which is inherently different from the clinical setting. Nor did the study include radiologists who have more training on reading diagnostic imaging, the researchers noted.

In an accompanying editorial, Rohan Khera, MD, MS, of the Yale School of Medicine in New Haven, Connecticut, and colleagues said the results suggest that “a more careful approach to evaluating AI tools is warranted before their rapid adoption, even when AI is used as assistive technology.”

“Even in controlled settings, without the usual pressures on time, clinicians favored automated decision-making systems, relying on the AI-based tool, despite the presence of contradictory or clinically nonsensical information,” Khera and colleagues wrote.

“If a model performs well for certain patients or in certain care scenarios, such automation bias may result in patient benefit in those settings,” they wrote. “However, in other settings where the model is inaccurate — either systematically biased or due to imperfect performance — patients may be harmed as clinicians defer to the AI model over their own judgment.”

author['full_name']

Michael DePeau-Wilson is a reporter on MedPage Today’s enterprise & investigative team. He covers psychiatry, long covid, and infectious diseases, among other relevant U.S. clinical news. Follow

Disclosures

The study was funded by the National Heart, Lung, and Blood Institute (NHLBI).

The study authors reported financial relationships with the U.S. Department of Energy, Toyota Research Institute, the National Science Foundation, the Alfred P. Sloan Foundation, Machine Learning for Healthcare, and Airstrip.

Editorialists reported financial relationships with the Doris Duke Charitable Foundation, Bristol Myers Squibb, Novo Nordisk, Evidence2Health, Ensight-AI, Johnson & Johnson, the Medical Devices Innovation Consortium, and Arnold Ventures.

Primary Source

JAMA

Source Reference: Jabbour S, et al “Measuring the impact of AI in the diagnosis of hospitalized patients: A randomized clinical vignette survey study” JAMA 2023; DOI: 10.1001/jama.2023.22295.

Secondary Source

JAMA

Source Reference: Khera R, et al “Automation bias and assistive AI: Risk of harm from AI-driven clinical decision support” JAMA 2023; DOI:10.1001/jama.2023.22557.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : MedPageToday – https://www.medpagetoday.com/special-reports/features/107944

Tags: Don’tExplanationshealth
Previous Post

Should Normal Range of Albumin Be Redefined for Cardiovascular Health?

Next Post

Can a GLP-1 Agonist Improve Parkinson’s Symptoms?

Nasdaq-listed Verb Technology to build $558 million TON treasury, rebrand as TON Strategy Co. – The Block

Nasdaq-Listed Verb Technology to Build $558 Million TON Treasury and Rebrand as TON Strategy Co

August 5, 2025

USA Wrestling and Pure&Clean Sports continue partnership to champion athlete safety and advance the sport – USA Wrestling

August 5, 2025
Archived natural DNA samplers reveal four decades of biodiversity change across the tree of life – Nature

Four Decades of Biodiversity Uncovered Through Archived Natural DNA Samplers

August 4, 2025
Scientists say they have solved the mystery of what killed more than 5 billion sea stars – Yahoo Home

Scientists say they have solved the mystery of what killed more than 5 billion sea stars – Yahoo Home

August 4, 2025
Science and the courts need to better distinguish between correlations and causation – Genetic Literacy Project

Science and the courts need to better distinguish between correlations and causation – Genetic Literacy Project

August 4, 2025
Adidas Relies on ‘Brand Heat’ in Lifestyle Footwear for Future Growth – WWD

Adidas Relies on ‘Brand Heat’ in Lifestyle Footwear for Future Growth – WWD

August 4, 2025
Team USA sets new relay record at swim worlds and Katie Ledecky wins again – CBS News

Team USA Smashes Relay Record at Swim Worlds as Katie Ledecky Reigns Supreme Again

August 4, 2025
Dow futures reverse higher as recession alarm bells jolt Wall Street awake from dreams of a gravity-defying economy – Fortune

Dow Futures Soar Amid Growing Recession Concerns Shaking Wall Street Confidence

August 4, 2025
Hank Hill returns to a changed world in new ‘King of the Hill’ episodes – New Haven Register

Hank Hill Navigates a Bold New World in Thrilling New ‘King of the Hill’ Episodes

August 4, 2025
How Trump’s Immigration Policies Are Impacting Health Care – Pulmonology Advisor

How Trump’s Immigration Policies Are Shaping the Future of Health Care

August 4, 2025

Categories

Archives

August 2025
MTWTFSS
 123
45678910
11121314151617
18192021222324
25262728293031
« Jul    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (754)
  • Economy (779)
  • Entertainment (21,656)
  • General (16,286)
  • Health (9,816)
  • Lifestyle (787)
  • News (22,149)
  • People (778)
  • Politics (788)
  • Science (15,992)
  • Sports (21,275)
  • Technology (15,757)
  • World (760)

Recent News

Nasdaq-listed Verb Technology to build $558 million TON treasury, rebrand as TON Strategy Co. – The Block

Nasdaq-Listed Verb Technology to Build $558 Million TON Treasury and Rebrand as TON Strategy Co

August 5, 2025

USA Wrestling and Pure&Clean Sports continue partnership to champion athlete safety and advance the sport – USA Wrestling

August 5, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version