* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Thursday, July 24, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Black Box Players presents ‘The Three Musketeers’ – CBS 19 News

    Experience the Adventure: Black Box Players Bring ‘The Three Musketeers’ to Life!

    AP Entertainment SummaryBrief at 1:51 p.m. EDT – Channel 3000

    Entertainment Highlights: Key Updates You Can’t Miss

    ‘Devil Wears Prada 2’ casts Anne Hathaway’s love interest replacing Adrian Grenier’s Nate – Entertainment Weekly

    Devil Wears Prada 2′ Casts New Love Interest for Anne Hathaway, Replacing Adrian Grenier’s Nate

    12 ‘Late Show’ Moments Proving Stephen Colbert Can’t Be Replaced – The Mountaineer

    12 Unforgettable ‘Late Show’ Moments That Prove Stephen Colbert Is Truly One of a Kind

    Canes owner Tom Dundon’s real estate firm eyes entertainment complex near RDU – The Business Journals

    Canes Owner Tom Dundon’s Real Estate Firm Unveils Plans for Thrilling New Entertainment Complex Near RDU

    Inspired Entertainment, Inc.’s (NASDAQ:INSE) Price Is Right But Growth Is Lacking After Shares Rocket 29% – simplywall.st

    Inspired Entertainment Soars 29% but Growth Momentum Falls Short

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Behind the Screens: The Impact of Technology on Real Estate – TRREB

    Behind the Screens: How Technology is Transforming the Future of Real Estate

    Sustainserv and Palau Announce Technology Partnership to Leverage Innovative AI Platform to Advance Sustainability Reporting – Business Wire

    Sustainserv and Palau Team Up to Transform Sustainability Reporting with Breakthrough AI Technology

    Morgan Adamski Joins PwC in Newly Created Cyber, Data & Technology Risk Division – HSToday

    Morgan Adamski Leads the Charge in PwC’s Cutting-Edge Cyber, Data & Technology Risk Division

    Transformative technology, support for food entrepreneurs spotlighted – University of Hawaii System

    How Cutting-Edge Technology and Strong Support Are Revolutionizing Food Entrepreneurs’ Success

    Cold Weather Alloy Opens New Possibilities for Space Technology – Universe Today

    Revolutionary Cold Weather Alloy Unlocks New Frontiers in Space Technology

    Defence Holdings PLC Transitions from Esports to Pioneering Defence Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Black Box Players presents ‘The Three Musketeers’ – CBS 19 News

    Experience the Adventure: Black Box Players Bring ‘The Three Musketeers’ to Life!

    AP Entertainment SummaryBrief at 1:51 p.m. EDT – Channel 3000

    Entertainment Highlights: Key Updates You Can’t Miss

    ‘Devil Wears Prada 2’ casts Anne Hathaway’s love interest replacing Adrian Grenier’s Nate – Entertainment Weekly

    Devil Wears Prada 2′ Casts New Love Interest for Anne Hathaway, Replacing Adrian Grenier’s Nate

    12 ‘Late Show’ Moments Proving Stephen Colbert Can’t Be Replaced – The Mountaineer

    12 Unforgettable ‘Late Show’ Moments That Prove Stephen Colbert Is Truly One of a Kind

    Canes owner Tom Dundon’s real estate firm eyes entertainment complex near RDU – The Business Journals

    Canes Owner Tom Dundon’s Real Estate Firm Unveils Plans for Thrilling New Entertainment Complex Near RDU

    Inspired Entertainment, Inc.’s (NASDAQ:INSE) Price Is Right But Growth Is Lacking After Shares Rocket 29% – simplywall.st

    Inspired Entertainment Soars 29% but Growth Momentum Falls Short

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Behind the Screens: The Impact of Technology on Real Estate – TRREB

    Behind the Screens: How Technology is Transforming the Future of Real Estate

    Sustainserv and Palau Announce Technology Partnership to Leverage Innovative AI Platform to Advance Sustainability Reporting – Business Wire

    Sustainserv and Palau Team Up to Transform Sustainability Reporting with Breakthrough AI Technology

    Morgan Adamski Joins PwC in Newly Created Cyber, Data & Technology Risk Division – HSToday

    Morgan Adamski Leads the Charge in PwC’s Cutting-Edge Cyber, Data & Technology Risk Division

    Transformative technology, support for food entrepreneurs spotlighted – University of Hawaii System

    How Cutting-Edge Technology and Strong Support Are Revolutionizing Food Entrepreneurs’ Success

    Cold Weather Alloy Opens New Possibilities for Space Technology – Universe Today

    Revolutionary Cold Weather Alloy Unlocks New Frontiers in Space Technology

    Defence Holdings PLC Transitions from Esports to Pioneering Defence Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Health

ChatGPT Takes on the Neuro Boards

December 9, 2023
in Health
ChatGPT Takes on the Neuro Boards
Share on FacebookShare on Twitter

ChatGPT significantly outperformed humans on a mock version of the American Board of Psychiatry and Neurology (ABPN) boards.

ChatGPT-4, the newer version of Open AI’s large language model, bested the mean human score on a question bank approved by the ABPN, answering 85% of questions correctly versus a human score of 73.8%, according to Varun Venkataramani, MD, PhD, of University Hospital Heidelberg in Germany, and co-authors.

An older model, ChatGPT-3.5, answered only 66.8% of questions correctly. “Both models used confident or very confident language, even when incorrect,” Venkataramani and colleagues reported in JAMA Network Open.

The study is a good demonstration of the power and capabilities of large language models like ChatGPT, but its findings could be misinterpreted, noted Lyell Jones Jr., MD, of the Mayo Clinic in Rochester, Minnesota, who wasn’t involved with the study.

“This paper demonstrates that ChatGPT can answer multiple choice questions correctly,” Jones told MedPage Today. “It does not demonstrate that ChatGPT can practice clinical medicine or serve as a substitute for clinical decision-making.”

“Tests, including multiple choice tests, are tools designed to assess medical knowledge, which is only one domain or competency required to practice medicine,” Jones continued. “Transformer technologies like those employed by ChatGPT can predict text but they do not conduct interviews, do a physical exam, generate an assessment and plan, interpret clinical data, and communicate results.”

While it’s a great technical feat for the software to answer many questions correctly, “the error rate was still high, and the tendency to express certainty while still incorrect presents an additional risk or caution in the use of large language model tools,” he added.

Transformer-based natural language processing tools like GPT could enhance neurology clinical care but come with limitations and risks, including fabricated facts. Risks and benefits were addressed in a recent paper in Neurology that showed ChatGPT provided potentially dangerous advice for a young woman with epilepsy who wished to become pregnant. Research involving medical questions in other specialties has suggested that, despite improvements, neither ChatGPT 3.5 nor 4 should be relied on as a sole source of medical knowledge.

In their study, Venkataramani and co-authors used a question bank approved by the ABPN and categorized questions as either lower- or higher-order based on Bloom’s taxonomy. Lower-order questions assessed remembering and basic understanding; higher-order questions measured applying, analyzing, or evaluating information.

The bank of 2,036 questions resembled the neurology board exam and was part of a self-assessment program that could be used for continuing medical education (CME) credit; a score of 70% was the threshold for CME. The researchers excluded 80 questions — those with videos or images, and those based on preceding questions — leaving 1,956 questions in the study.

Both large language models were server-contained and trained on more than 45 terabytes of text data from websites, books, and articles. Neither had the ability to search the internet.

GPT-3.5 matched human users on lower-order questions but lagged on higher-level questions. GPT-4 surpassed humans on both lower- and higher-order questions. GPT-4 had better performance on questions in behavioral, cognitive, and psychological categories (89.8%) compared with questions about epilepsy and seizures (70.9%) or neuromuscular topics (78.8%).

On a 5-point Likert scale, both models consistently rated their confidence in their answers as confident or highly confident, regardless of whether their answer was correct. When prompted with a right answer after a wrong one, both models apologized and agreed with the provided answer in all cases.

A study limitation is that official ABPN board exam questions could not be used due to their confidential and regulated nature, Venkataramani and co-authors said. In addition, the passing grade was an approximation based on the ABPN threshold for CME.

It’s unclear what the clinical or educational utility of these findings are, Jones observed. “It’s a great technical demonstration, but do we need software that can take tests designed for humans?” he asked.

“A more interesting study in this vein would be use of ChatGPT for generation of high-quality multiple-choice questions, educational cases, or other teaching materials,” he suggested. “In any use, the error rates are high enough that any application of transformer technology in clinical or educational settings requires careful human validation and fact-checking.”

Judy George covers neurology and neuroscience news for MedPage Today, writing about brain aging, Alzheimer’s, dementia, MS, rare diseases, epilepsy, autism, headache, stroke, Parkinson’s, ALS, concussion, CTE, sleep, pain, and more. Follow

Disclosures

Venkataramani had no disclosures. A co-author reported a patent for glioma treatment agents.

Jones has received publishing royalties from a publication relating to health care, has noncompensated relationships as a member of the board of directors of the Mayo Clinic Accountable Care Organization and the American Academy of Neurology Institute, and has received personal compensation for serving as an editor for the American Academy of Neurology.

Primary Source

JAMA Network Open

Source Reference: Schubert MC, et al “Performance of large language models on a neurology board–style examination” JAMA Netw Open 2023; DOI: 10.1001/jamanetworkopen.2023.46721.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : MedPageToday – https://www.medpagetoday.com/neurology/generalneurology/107764

Tags: ChatGPThealthtakes
Previous Post

The Dumbbell Goblet Squat Works Way More Than Just Your Legs and Butt

Next Post

Got Raw Milk?

Behind the Screens: The Impact of Technology on Real Estate – TRREB

Behind the Screens: How Technology is Transforming the Future of Real Estate

July 24, 2025
Gustavus hires Jordan Benson as Sports Information Director – Minnesota Intercollegiate Athletic Conference

Gustavus Welcomes Jordan Benson as New Sports Information Director

July 24, 2025
Join the Neighborhood Ecology Corps – RaleighNC.gov

Join the Neighborhood Ecology Corps – RaleighNC.gov

July 24, 2025

WEBS Program Ignites Passion for Science with Exciting Hands-On Labs

July 24, 2025

Science Explains Why Some People Keep Making Bad Decisions Even After Being Punished – Study Finds

July 24, 2025
Fidel Castro’s grandson slammed for flaunting lavish lifestyle amid Cuba’s economic crisis – Mint

Fidel Castro’s Grandson Stuns Nation with Lavish Lifestyle Amid Cuba’s Economic Struggles

July 23, 2025
Art on the Road: Framing the World – Oregon ArtsWatch

Art on the Road: Framing the World – Oregon ArtsWatch

July 23, 2025
Zimbabwe Says Informal Sector Dominates 76% of The Economy – Bloomberg

Zimbabwe’s Informal Sector Now Powers 76% of the Economy

July 23, 2025
MSC Cruises Unveils Entertainment Venues Aboard New Ship MSC World Asia – TravelPulse

Explore the Thrilling New Entertainment Venues Aboard MSC World Asia!

July 23, 2025
Mitochondria and health – National Institutes of Health (NIH) | (.gov)

Unlocking the Power of Mitochondria: The Key to Better Health

July 23, 2025

Categories

Archives

July 2025
MTWTFSS
 123456
78910111213
14151617181920
21222324252627
28293031 
« Jun    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (736)
  • Economy (759)
  • Entertainment (21,642)
  • General (16,069)
  • Health (9,797)
  • Lifestyle (767)
  • News (22,149)
  • People (761)
  • Politics (768)
  • Science (15,975)
  • Sports (21,257)
  • Technology (15,742)
  • World (742)

Recent News

Behind the Screens: The Impact of Technology on Real Estate – TRREB

Behind the Screens: How Technology is Transforming the Future of Real Estate

July 24, 2025
Gustavus hires Jordan Benson as Sports Information Director – Minnesota Intercollegiate Athletic Conference

Gustavus Welcomes Jordan Benson as New Sports Information Director

July 24, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version