* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Wednesday, August 27, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Do you have a favorable or an unfavorable opinion of Taylor Swift? – YouGov

    Do You Love Taylor Swift or Not? Share Your Thoughts!

    Upload Season 4 Review – yahoo.com

    Upload Season 4 Review: A Thrilling New Chapter Unveiled

    ‘The Roses’ review: Olivia Colman, Benedict Cumberbatch sparkle in dark comedy – Yakima Herald-Republic

    The Roses’ Review: Olivia Colman and Benedict Cumberbatch Shine in Dark Comedy Delight

    ‘When Calls the Heart’ Fans All Want the Same Thing After Seeing the Show’s Latest Update – yahoo.com

    When Calls the Heart’ Fans Rally Together in Excitement Over Exciting New Update!

    Quotes of the Week: Peacemaker, Project Runway, Countdown and More – yahoo.com

    This Week’s Most Memorable Quotes from Peacemaker, Project Runway, Countdown, and More!

    Drake Appears in Teaser for Bobbi Althoff’s New Podcast ‘Not This Again’ – yahoo.com

    Drake Drops a Surprise Cameo in Bobbi Althoff’s Thrilling New Podcast Teaser ‘Not This Again

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    MC Machinery Technology Summit Showcases Manufacturing Innovations – Modern Machine Shop

    MC Machinery Technology Summit Unveils Cutting-Edge Manufacturing Innovations

    US-ROK Technology Cooperation Faces Rising Tensions – The National Interest

    Rising Tensions Put US-South Korea Technology Partnership to the Test

    The Role of AI and Technology in Shaping the Future of Interactive Entertainment – Technology Org

    How AI and Technology Are Transforming the Future of Interactive Entertainment

    Ten upcoming sports stadiums where technology takes to the field – Dezeen

    10 Futuristic Sports Stadiums Revolutionizing the Game with Cutting-Edge Technology

    Figure Technology Solutions, Inc. Files Registration Statement for Proposed Initial Public Offering – Business Wire

    Figure Technology Solutions, Inc. Unveils Exciting Plans for Its Upcoming Initial Public Offering

    UNLV Responds to Workforce Need with Microcredential in Nuclear Technology – University of Nevada, Las Vegas | UNLV

    UNLV Unveils Cutting-Edge Microcredential Program to Fuel Growth in Nuclear Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Do you have a favorable or an unfavorable opinion of Taylor Swift? – YouGov

    Do You Love Taylor Swift or Not? Share Your Thoughts!

    Upload Season 4 Review – yahoo.com

    Upload Season 4 Review: A Thrilling New Chapter Unveiled

    ‘The Roses’ review: Olivia Colman, Benedict Cumberbatch sparkle in dark comedy – Yakima Herald-Republic

    The Roses’ Review: Olivia Colman and Benedict Cumberbatch Shine in Dark Comedy Delight

    ‘When Calls the Heart’ Fans All Want the Same Thing After Seeing the Show’s Latest Update – yahoo.com

    When Calls the Heart’ Fans Rally Together in Excitement Over Exciting New Update!

    Quotes of the Week: Peacemaker, Project Runway, Countdown and More – yahoo.com

    This Week’s Most Memorable Quotes from Peacemaker, Project Runway, Countdown, and More!

    Drake Appears in Teaser for Bobbi Althoff’s New Podcast ‘Not This Again’ – yahoo.com

    Drake Drops a Surprise Cameo in Bobbi Althoff’s Thrilling New Podcast Teaser ‘Not This Again

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    MC Machinery Technology Summit Showcases Manufacturing Innovations – Modern Machine Shop

    MC Machinery Technology Summit Unveils Cutting-Edge Manufacturing Innovations

    US-ROK Technology Cooperation Faces Rising Tensions – The National Interest

    Rising Tensions Put US-South Korea Technology Partnership to the Test

    The Role of AI and Technology in Shaping the Future of Interactive Entertainment – Technology Org

    How AI and Technology Are Transforming the Future of Interactive Entertainment

    Ten upcoming sports stadiums where technology takes to the field – Dezeen

    10 Futuristic Sports Stadiums Revolutionizing the Game with Cutting-Edge Technology

    Figure Technology Solutions, Inc. Files Registration Statement for Proposed Initial Public Offering – Business Wire

    Figure Technology Solutions, Inc. Unveils Exciting Plans for Its Upcoming Initial Public Offering

    UNLV Responds to Workforce Need with Microcredential in Nuclear Technology – University of Nevada, Las Vegas | UNLV

    UNLV Unveils Cutting-Edge Microcredential Program to Fuel Growth in Nuclear Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Health

Explanations Don’t Help Clinicians Spot Biased AI

December 20, 2023
in Health
Explanations Don’t Help Clinicians Spot Biased AI
Share on FacebookShare on Twitter

Providing clinicians with artificial intelligence (AI) predictions along with model explanations can boost diagnostic accuracy, but that accuracy drops when using a biased AI model — and explanations don’t mitigate those negative effects, according to a randomized clinical vignette survey study.

Clinicians who were asked to differentiate between pneumonia, heart failure, or chronic obstructive pulmonary disease (COPD) had a baseline accuracy of 73% (95% CI 68.3-77.8), which rose to about 76% when using AI without explanations. Adding in an explanation of the model — to mitigate any errors it may make — brought accuracy up to about 78%, according to Michael Sjoding, MD, of University of Michigan Health in Ann Arbor, and colleagues.

However, when using a systematically biased AI model, diagnostic accuracy fell to about 62% — a decline that wasn’t fixed by adding model explanations, which only restored accuracy to about 64%, they reported in JAMA.

“AI is being developed at an extraordinary rate, and our study shows that it has the potential to improve clinical decision making,” co-author Sarah Jabbour, MSE, also of the University of Michigan, told MedPage Today in an email. “But we must be thoughtful about how to carefully integrate AI into clinical workflows with the goal of improving clinical care while not introducing systematic errors or harming patients.”

Jabbour and colleagues explained that recent regulatory guidance has called for AI models to include explanations that may help mitigate errors made by models, but the effectiveness of this strategy hasn’t been established.

To dig deeper into the issue, they designed a study that involved analyzing vignettes of patients hospitalized with acute respiratory failure and diagnosing either pneumonia, heart failure, or COPD as the underlying cause.

To establish baseline diagnostic accuracy, clinicians — doctors, nurse practitioners, and physician assistants — were shown two vignettes without AI input. They were then randomized to see six vignettes with AI input, with or without model explanations. Three of these vignettes included standard-model predictions, while three included systematically biased predictions.

A final vignette with support from an “expert clinician” consult established an upper bound for diagnostic accuracy, which in this case was about 81%.

Overall, 457 clinicians from 13 states participated between April 2022 and January 2023, with 231 randomized to model predictions without explanations, and 226 randomized to also get explanations. Median participant age was 34 and about 58% were female.

The vignettes included presenting symptoms, physical examination, laboratory results, and chest radiographs. Biased AI models were skewed to make predictions using age, weight, and radiograph adjustments. Explanations for biased models were written to try to reveal potential biases, the researchers said.

“In our study, explanations were presented in a way that were considered to be obvious, where the AI model was completely focused on areas of the chest X-rays unrelated to the clinical condition,” Jabbour told MedPage Today. “We hypothesized that, if presented with such explanations, the participants in our study would notice that the model was behaving incorrectly and not rely on its predictions.”

“This was surprisingly not the case,” she said, “and the explanations when presented alongside biased AI predictions had seemingly no effect in mitigating clinicians’ over-reliance on biased AI.”

AI models can reflect biases that already exist in the healthcare system and can lead to worse overall clinical decision making, Jabbour said. For example, a model trained on a dataset including women who were underdiagnosed for heart failure might identify female patients as being at lower risk for heart failure, especially if clinicians rely heavily on the predictive models without further explanation, she said.

One limitation of the study was its reliance on a web-based survey interface, which is inherently different from the clinical setting. Nor did the study include radiologists who have more training on reading diagnostic imaging, the researchers noted.

In an accompanying editorial, Rohan Khera, MD, MS, of the Yale School of Medicine in New Haven, Connecticut, and colleagues said the results suggest that “a more careful approach to evaluating AI tools is warranted before their rapid adoption, even when AI is used as assistive technology.”

“Even in controlled settings, without the usual pressures on time, clinicians favored automated decision-making systems, relying on the AI-based tool, despite the presence of contradictory or clinically nonsensical information,” Khera and colleagues wrote.

“If a model performs well for certain patients or in certain care scenarios, such automation bias may result in patient benefit in those settings,” they wrote. “However, in other settings where the model is inaccurate — either systematically biased or due to imperfect performance — patients may be harmed as clinicians defer to the AI model over their own judgment.”

author['full_name']

Michael DePeau-Wilson is a reporter on MedPage Today’s enterprise & investigative team. He covers psychiatry, long covid, and infectious diseases, among other relevant U.S. clinical news. Follow

Disclosures

The study was funded by the National Heart, Lung, and Blood Institute (NHLBI).

The study authors reported financial relationships with the U.S. Department of Energy, Toyota Research Institute, the National Science Foundation, the Alfred P. Sloan Foundation, Machine Learning for Healthcare, and Airstrip.

Editorialists reported financial relationships with the Doris Duke Charitable Foundation, Bristol Myers Squibb, Novo Nordisk, Evidence2Health, Ensight-AI, Johnson & Johnson, the Medical Devices Innovation Consortium, and Arnold Ventures.

Primary Source

JAMA

Source Reference: Jabbour S, et al “Measuring the impact of AI in the diagnosis of hospitalized patients: A randomized clinical vignette survey study” JAMA 2023; DOI: 10.1001/jama.2023.22295.

Secondary Source

JAMA

Source Reference: Khera R, et al “Automation bias and assistive AI: Risk of harm from AI-driven clinical decision support” JAMA 2023; DOI:10.1001/jama.2023.22557.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : MedPageToday – https://www.medpagetoday.com/special-reports/features/107944

Tags: Don’tExplanationshealth
Previous Post

Should Normal Range of Albumin Be Redefined for Cardiovascular Health?

Next Post

Can a GLP-1 Agonist Improve Parkinson’s Symptoms?

Washington Conservation Corps gears up for another year of service – Washington State Department of Ecology (.gov)

Washington Conservation Corps gears up for another year of service – Washington State Department of Ecology (.gov)

August 27, 2025
The Myths in our Midst: On the Teaching of the History of Science and Religion in K–12 – Public Discourse

Unveiling the Myths: Rethinking How We Teach the History of Science and Religion in K-12

August 27, 2025
Are we finally speaking the public’s language when we talk about science post-pandemic? – The Globe and Mail

Is Science Finally Bridging the Gap with the Public Post-Pandemic?

August 27, 2025
FBI crackdown in Ghana sparks urgent push for lifestyle audit law – The Africa Report.com

FBI crackdown in Ghana sparks urgent push for lifestyle audit law – The Africa Report.com

August 27, 2025
MC Machinery Technology Summit Showcases Manufacturing Innovations – Modern Machine Shop

MC Machinery Technology Summit Unveils Cutting-Edge Manufacturing Innovations

August 27, 2025
Athletics Builds Competitors Striving for Excellence in Life – Dartmouth

How Athletics Builds Champions Who Pursue Excellence in Every Area of Life

August 27, 2025
In a post-truth world, what happens if we can’t trust US economic data any more? – The Conversation

What Happens When We Can No Longer Trust US Economic Data in a Post-Truth Era?

August 27, 2025
Lagarde says Europe’s economy would be even worse without the immigrants who moved in after the pandemic – Fortune

Lagarde: Post-Pandemic Immigrants Are Vital to Europe’s Economic Strength

August 27, 2025
Do you have a favorable or an unfavorable opinion of Taylor Swift? – YouGov

Do You Love Taylor Swift or Not? Share Your Thoughts!

August 27, 2025
U of M survey finds Minnesotans concerned about health of lakes, rivers – MPR News

Minnesotans Raise Alarming Concerns About the Future of Their Lakes and Rivers

August 27, 2025

Categories

Archives

August 2025
MTWTFSS
 123
45678910
11121314151617
18192021222324
25262728293031
« Jul    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (793)
  • Economy (812)
  • Entertainment (21,691)
  • General (16,706)
  • Health (9,853)
  • Lifestyle (826)
  • News (22,149)
  • People (813)
  • Politics (820)
  • Science (16,023)
  • Sports (21,312)
  • Technology (15,793)
  • World (794)

Recent News

Washington Conservation Corps gears up for another year of service – Washington State Department of Ecology (.gov)

Washington Conservation Corps gears up for another year of service – Washington State Department of Ecology (.gov)

August 27, 2025
The Myths in our Midst: On the Teaching of the History of Science and Religion in K–12 – Public Discourse

Unveiling the Myths: Rethinking How We Teach the History of Science and Religion in K-12

August 27, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version