* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Wednesday, June 4, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Author Richard Russo Will Speak At Sandwich Town Hall – CapeNews.net

    Join Us for an Inspiring Evening with Author Richard Russo at Sandwich Town Hall!

    Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

    Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

    Salem’s Harborwalk Garden Cultivates Community with Entertainment, Food, and Events – 105.7 WROR

    Discover the Vibrant Community Spirit at Salem’s Harborwalk Garden: A Hub for Entertainment, Food, and Fun!

    Entertainment-Focused Narrative and Culture Change Practice – New America

    Transforming Culture Through Engaging Entertainment Narratives

    Rising stars: Young classical musicians surging on social media – Yahoo

    Meet the Next Generation of Classical Music Sensations Making Waves on Social Media!

    Devin Harjes Dies: ‘Manifest’ & ‘Boardwalk Empire’ Actor Was 41 – WyomingNews.com

    Tragic Loss: Devin Harjes, Star of ‘Manifest’ and ‘Boardwalk Empire,’ Passes Away at 41

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

    Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

    Finland Set to Lead EU Quantum Technology Defense Project – IoT World Today

    Finland Set to Lead EU Quantum Technology Defense Project – IoT World Today

    AI for lawyers: Win back your time using technology – nationaljurist.com

    Reclaim Your Time: How AI is Transforming the Legal Profession

    Prosecutors accuse men of exporting U.S. military technology to China – Milwaukee Journal Sentinel

    Men Charged with Illegally Exporting U.S. Military Technology to China

    ROLAND’S NEW WIRELESS TRIGGER TECHNOLOGY, PORTER & DAVIES ON TOUR, NEW 64 AUDIO ASPIRE UNIVERSAL IEM MODELS, WAVES FREE PLUGIN PACK – Modern Drummer Magazine

    ROLAND’S NEW WIRELESS TRIGGER TECHNOLOGY, PORTER & DAVIES ON TOUR, NEW 64 AUDIO ASPIRE UNIVERSAL IEM MODELS, WAVES FREE PLUGIN PACK – Modern Drummer Magazine

    This giant microwave may change the future of war – MIT Technology Review

    Revolutionizing Warfare: The Impact of a Game-Changing Giant Microwave

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Author Richard Russo Will Speak At Sandwich Town Hall – CapeNews.net

    Join Us for an Inspiring Evening with Author Richard Russo at Sandwich Town Hall!

    Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

    Entertainment Partners Acquires CASHét, Digital Payments Vendor for Productions – Variety

    Salem’s Harborwalk Garden Cultivates Community with Entertainment, Food, and Events – 105.7 WROR

    Discover the Vibrant Community Spirit at Salem’s Harborwalk Garden: A Hub for Entertainment, Food, and Fun!

    Entertainment-Focused Narrative and Culture Change Practice – New America

    Transforming Culture Through Engaging Entertainment Narratives

    Rising stars: Young classical musicians surging on social media – Yahoo

    Meet the Next Generation of Classical Music Sensations Making Waves on Social Media!

    Devin Harjes Dies: ‘Manifest’ & ‘Boardwalk Empire’ Actor Was 41 – WyomingNews.com

    Tragic Loss: Devin Harjes, Star of ‘Manifest’ and ‘Boardwalk Empire,’ Passes Away at 41

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

    Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

    Finland Set to Lead EU Quantum Technology Defense Project – IoT World Today

    Finland Set to Lead EU Quantum Technology Defense Project – IoT World Today

    AI for lawyers: Win back your time using technology – nationaljurist.com

    Reclaim Your Time: How AI is Transforming the Legal Profession

    Prosecutors accuse men of exporting U.S. military technology to China – Milwaukee Journal Sentinel

    Men Charged with Illegally Exporting U.S. Military Technology to China

    ROLAND’S NEW WIRELESS TRIGGER TECHNOLOGY, PORTER & DAVIES ON TOUR, NEW 64 AUDIO ASPIRE UNIVERSAL IEM MODELS, WAVES FREE PLUGIN PACK – Modern Drummer Magazine

    ROLAND’S NEW WIRELESS TRIGGER TECHNOLOGY, PORTER & DAVIES ON TOUR, NEW 64 AUDIO ASPIRE UNIVERSAL IEM MODELS, WAVES FREE PLUGIN PACK – Modern Drummer Magazine

    This giant microwave may change the future of war – MIT Technology Review

    Revolutionizing Warfare: The Impact of a Game-Changing Giant Microwave

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Health

Good evidence confuses ChatGPT when used for health information, study finds

April 4, 2024
in Health
Good evidence confuses ChatGPT when used for health information, study finds
Share on FacebookShare on Twitter

chatgpt

Credit: Pixabay/CC0 Public Domain

A world-first study has found that when asked a health-related question, the more evidence that is given to ChatGPT, the less reliable it becomes—reducing the accuracy of its responses to as low as 28%.

The study was recently presented at Empirical Methods in Natural Language Processing (EMNLP), a Natural Language Processing conference in the field. The findings are published in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing.

As large language models (LLMs) like ChatGPT explode in popularity, they pose a potential risk to the growing number of people using online tools for key health information.

Scientists from CSIRO, Australia’s national science agency, and The University of Queensland (UQ) explored a hypothetical scenario of an average person (non-professional health consumer) asking ChatGPT if “X” treatment has a positive effect on condition “Y.”

The 100 questions presented ranged from “Can zinc help treat the common cold?” to “Will drinking vinegar dissolve a stuck fish bone?”

ChatGPT’s response was compared to the known correct response, or “ground truth,” based on existing medical knowledge.

CSIRO Principal Research Scientist and Associate Professor at UQ Dr. Bevan Koopman said that even though the risks of searching for health information online are well documented, people continue to seek health information online, and increasingly via tools such as ChatGPT.

“The widespread popularity of using LLMs online for answers on people’s health is why we need continued research to inform the public about risks and to help them optimize the accuracy of their answers,” Dr. Koopman said. “While LLMs have the potential to greatly improve the way people access information, we need more research to understand where they are effective and where they are not.”

The study looked at two question formats. The first was a question only. The second was a question biased with supporting or contrary evidence.

Results revealed that ChatGPT was quite good at giving accurate answers in a question-only format, with an 80% accuracy in this scenario.

However, when the language model was given an evidence-biased prompt, accuracy reduced to 63%. Accuracy was reduced again to 28% when an “unsure” answer was allowed. This finding is contrary to popular belief that prompting with evidence improves accuracy.

“We’re not sure why this happens. But given this occurs whether the evidence given is correct or not, perhaps the evidence adds too much noise, thus lowering accuracy,” Dr. Koopman said.

ChatGPT launched on November 30, 2022, and has quickly become one of the most widely used large language models (LLMs). LLMs are a form of artificial intelligence that recognize, translate, summarize, predict, and generate text.

Study co-author UQ Professor Guido Zuccon, Director of AI for the Queensland Digital Health Centre (QDHeC), said that major search engines are now integrating LLMs and search technologies in a process called Retrieval Augmented Generation.

“We demonstrate that the interaction between the LLM and the search component is still poorly understood and controllable, resulting in the generation of inaccurate health information,” said Professor Zuccon.

Next steps for the research are to investigate how the public uses the health information generated by LLMs.

More information:
Bevan Koopman et al, Dr ChatGPT tell me what I want to hear: How different prompts impact health answer correctness, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (2023). DOI: 10.18653/v1/2023.emnlp-main.928

Citation:
Good evidence confuses ChatGPT when used for health information, study finds (2024, April 3)
retrieved 3 April 2024
from https://medicalxpress.com/news/2024-04-good-evidence-chatgpt-health.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Medical Xpress – https://medicalxpress.com/news/2024-04-good-evidence-chatgpt-health.html

Tags: confusesevidencehealth
Previous Post

MS-13 gang member pleads guilty in killing of 4 young men on Long Island in 2017

Next Post

Recent contact with young children linked to over 60s risk of acquiring pneumonia-causing bacteria

Collective dynamical regimes predict invasion success and impacts in microbial communities – Nature

Collective dynamical regimes predict invasion success and impacts in microbial communities – Nature

June 4, 2025
John Brenkus, ‘Sport Science’ Host, Died By Suicide, Medical Examiner Says – TMZ

Tragic Loss: ‘Sport Science’ Host John Brenkus Passes Away in Heartbreaking Circumstances

June 4, 2025
Meghan to take a break from As ever as she announces next step for those ‘wondering and waiting’ – Nine – Honey

Meghan to take a break from As ever as she announces next step for those ‘wondering and waiting’ – Nine – Honey

June 4, 2025
Aeternum Update 1.3.27 – newworld.com

Exciting New Features and Enhancements in Aeternum Update 1.3.27!

June 4, 2025
Larry Kudlow: Liberal media has been ‘completely wrong’ on the Trump economy – Fox Business

Larry Kudlow: Liberal media has been ‘completely wrong’ on the Trump economy – Fox Business

June 4, 2025
Author Richard Russo Will Speak At Sandwich Town Hall – CapeNews.net

Join Us for an Inspiring Evening with Author Richard Russo at Sandwich Town Hall!

June 4, 2025
Hochul, Jeffries raise concerns over possible impacts of One Big Beautiful Bill Act – Spectrum News

Hochul, Jeffries raise concerns over possible impacts of One Big Beautiful Bill Act – Spectrum News

June 4, 2025
Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

June 4, 2025
Kehoe calls special session on storm damage, KC sports teams – FOX 2

Kehoe Announces Special Session to Address Storm Damage and Support KC Sports Teams

June 3, 2025
From Eggs To Fingerlings, Wyoming Students Dive Into The World Of Fish Conservation – KGAB

From Eggs to Fingerlings: Wyoming Students Make Waves in Fish Conservation!

June 3, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (664)
  • Economy (678)
  • Entertainment (21,584)
  • General (15,261)
  • Health (9,720)
  • Lifestyle (681)
  • News (22,149)
  • People (679)
  • Politics (687)
  • Science (15,898)
  • Sports (21,182)
  • Technology (15,664)
  • World (665)

Recent News

Collective dynamical regimes predict invasion success and impacts in microbial communities – Nature

Collective dynamical regimes predict invasion success and impacts in microbial communities – Nature

June 4, 2025
John Brenkus, ‘Sport Science’ Host, Died By Suicide, Medical Examiner Says – TMZ

Tragic Loss: ‘Sport Science’ Host John Brenkus Passes Away in Heartbreaking Circumstances

June 4, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version