* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Saturday, October 4, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Al Roker Gives Olivia Dean an Unexpected ‘New Job’ on the ‘Today’ Show – Yahoo

    Al Roker Shocks Olivia Dean with an Exciting New Role on the ‘Today’ Show

    Books about the arts and some haunts for a Denton October – Denton Record-Chronicle

    Uncover Artistic Treasures and Spooky Adventures to Experience in Denton This October

    Taylor Swift Releases New Album The Life of a Showgirl : Listen and Read the Full Credits – Yahoo

    Taylor Swift Releases New Album The Life of a Showgirl : Listen and Read the Full Credits – Yahoo

    Toni Braxton Is Turning Her Biggest Hits Into Lifetime Movies – Yahoo

    Toni Braxton Is Turning Her Biggest Hits Into Lifetime Movies – Yahoo

    Major airline to offer new in-flight entertainment options for passengers – PennLive.com

    Major airline to offer new in-flight entertainment options for passengers – PennLive.com

    Penn State-Themed Restaurant and Entertainment Spot Happy Valley Live Set to Open in State College – StateCollege.com

    Penn State-Themed Restaurant and Entertainment Spot Happy Valley Live Set to Open in State College – StateCollege.com

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    What the Recent Price Surge Means for Figure Technology Solutions After SEC Settlement – Yahoo Finance

    What the Recent Price Surge Reveals About Figure Technology Solutions Following SEC Settlement

    MAC Brings iPad Technology to Football Sidelines Across All 13 Member Schools – Sports Video Group

    MAC Brings iPad Technology to Football Sidelines Across All 13 Member Schools – Sports Video Group

    Technology Is Becoming More Important Than Humans In CX – No Jitter

    Technology Is Becoming More Important Than Humans In CX – No Jitter

    A Tech Expo Shows What China Can Make, but Not Who’ll Buy It All – The New York Times

    Inside China’s Tech Expo: Cutting-Edge Innovations Face Uncertain Demand

    Steampunk Metal Oval Technology Sense Sunglasses Personality Handmade Chain Multicolor Sunglasses UV400 – The San Joaquin Valley Sun

    Steampunk Metal Oval Sunglasses with Handmade Multicolor Chain – Bold UV400 Protection and Unique Style

    STELLA Automotive AI Appoints Fred Seidelman as Chief Technology Officer – Yahoo Finance

    STELLA Automotive AI Appoints Fred Seidelman as New Chief Technology Officer

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Al Roker Gives Olivia Dean an Unexpected ‘New Job’ on the ‘Today’ Show – Yahoo

    Al Roker Shocks Olivia Dean with an Exciting New Role on the ‘Today’ Show

    Books about the arts and some haunts for a Denton October – Denton Record-Chronicle

    Uncover Artistic Treasures and Spooky Adventures to Experience in Denton This October

    Taylor Swift Releases New Album The Life of a Showgirl : Listen and Read the Full Credits – Yahoo

    Taylor Swift Releases New Album The Life of a Showgirl : Listen and Read the Full Credits – Yahoo

    Toni Braxton Is Turning Her Biggest Hits Into Lifetime Movies – Yahoo

    Toni Braxton Is Turning Her Biggest Hits Into Lifetime Movies – Yahoo

    Major airline to offer new in-flight entertainment options for passengers – PennLive.com

    Major airline to offer new in-flight entertainment options for passengers – PennLive.com

    Penn State-Themed Restaurant and Entertainment Spot Happy Valley Live Set to Open in State College – StateCollege.com

    Penn State-Themed Restaurant and Entertainment Spot Happy Valley Live Set to Open in State College – StateCollege.com

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    What the Recent Price Surge Means for Figure Technology Solutions After SEC Settlement – Yahoo Finance

    What the Recent Price Surge Reveals About Figure Technology Solutions Following SEC Settlement

    MAC Brings iPad Technology to Football Sidelines Across All 13 Member Schools – Sports Video Group

    MAC Brings iPad Technology to Football Sidelines Across All 13 Member Schools – Sports Video Group

    Technology Is Becoming More Important Than Humans In CX – No Jitter

    Technology Is Becoming More Important Than Humans In CX – No Jitter

    A Tech Expo Shows What China Can Make, but Not Who’ll Buy It All – The New York Times

    Inside China’s Tech Expo: Cutting-Edge Innovations Face Uncertain Demand

    Steampunk Metal Oval Technology Sense Sunglasses Personality Handmade Chain Multicolor Sunglasses UV400 – The San Joaquin Valley Sun

    Steampunk Metal Oval Sunglasses with Handmade Multicolor Chain – Bold UV400 Protection and Unique Style

    STELLA Automotive AI Appoints Fred Seidelman as Chief Technology Officer – Yahoo Finance

    STELLA Automotive AI Appoints Fred Seidelman as New Chief Technology Officer

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Health

ChatGPT Takes on the Neuro Boards

December 9, 2023
in Health
ChatGPT Takes on the Neuro Boards
Share on FacebookShare on Twitter

ChatGPT significantly outperformed humans on a mock version of the American Board of Psychiatry and Neurology (ABPN) boards.

ChatGPT-4, the newer version of Open AI’s large language model, bested the mean human score on a question bank approved by the ABPN, answering 85% of questions correctly versus a human score of 73.8%, according to Varun Venkataramani, MD, PhD, of University Hospital Heidelberg in Germany, and co-authors.

An older model, ChatGPT-3.5, answered only 66.8% of questions correctly. “Both models used confident or very confident language, even when incorrect,” Venkataramani and colleagues reported in JAMA Network Open.

The study is a good demonstration of the power and capabilities of large language models like ChatGPT, but its findings could be misinterpreted, noted Lyell Jones Jr., MD, of the Mayo Clinic in Rochester, Minnesota, who wasn’t involved with the study.

“This paper demonstrates that ChatGPT can answer multiple choice questions correctly,” Jones told MedPage Today. “It does not demonstrate that ChatGPT can practice clinical medicine or serve as a substitute for clinical decision-making.”

“Tests, including multiple choice tests, are tools designed to assess medical knowledge, which is only one domain or competency required to practice medicine,” Jones continued. “Transformer technologies like those employed by ChatGPT can predict text but they do not conduct interviews, do a physical exam, generate an assessment and plan, interpret clinical data, and communicate results.”

While it’s a great technical feat for the software to answer many questions correctly, “the error rate was still high, and the tendency to express certainty while still incorrect presents an additional risk or caution in the use of large language model tools,” he added.

Transformer-based natural language processing tools like GPT could enhance neurology clinical care but come with limitations and risks, including fabricated facts. Risks and benefits were addressed in a recent paper in Neurology that showed ChatGPT provided potentially dangerous advice for a young woman with epilepsy who wished to become pregnant. Research involving medical questions in other specialties has suggested that, despite improvements, neither ChatGPT 3.5 nor 4 should be relied on as a sole source of medical knowledge.

In their study, Venkataramani and co-authors used a question bank approved by the ABPN and categorized questions as either lower- or higher-order based on Bloom’s taxonomy. Lower-order questions assessed remembering and basic understanding; higher-order questions measured applying, analyzing, or evaluating information.

The bank of 2,036 questions resembled the neurology board exam and was part of a self-assessment program that could be used for continuing medical education (CME) credit; a score of 70% was the threshold for CME. The researchers excluded 80 questions — those with videos or images, and those based on preceding questions — leaving 1,956 questions in the study.

Both large language models were server-contained and trained on more than 45 terabytes of text data from websites, books, and articles. Neither had the ability to search the internet.

GPT-3.5 matched human users on lower-order questions but lagged on higher-level questions. GPT-4 surpassed humans on both lower- and higher-order questions. GPT-4 had better performance on questions in behavioral, cognitive, and psychological categories (89.8%) compared with questions about epilepsy and seizures (70.9%) or neuromuscular topics (78.8%).

On a 5-point Likert scale, both models consistently rated their confidence in their answers as confident or highly confident, regardless of whether their answer was correct. When prompted with a right answer after a wrong one, both models apologized and agreed with the provided answer in all cases.

A study limitation is that official ABPN board exam questions could not be used due to their confidential and regulated nature, Venkataramani and co-authors said. In addition, the passing grade was an approximation based on the ABPN threshold for CME.

It’s unclear what the clinical or educational utility of these findings are, Jones observed. “It’s a great technical demonstration, but do we need software that can take tests designed for humans?” he asked.

“A more interesting study in this vein would be use of ChatGPT for generation of high-quality multiple-choice questions, educational cases, or other teaching materials,” he suggested. “In any use, the error rates are high enough that any application of transformer technology in clinical or educational settings requires careful human validation and fact-checking.”

Judy George covers neurology and neuroscience news for MedPage Today, writing about brain aging, Alzheimer’s, dementia, MS, rare diseases, epilepsy, autism, headache, stroke, Parkinson’s, ALS, concussion, CTE, sleep, pain, and more. Follow

Disclosures

Venkataramani had no disclosures. A co-author reported a patent for glioma treatment agents.

Jones has received publishing royalties from a publication relating to health care, has noncompensated relationships as a member of the board of directors of the Mayo Clinic Accountable Care Organization and the American Academy of Neurology Institute, and has received personal compensation for serving as an editor for the American Academy of Neurology.

Primary Source

JAMA Network Open

Source Reference: Schubert MC, et al “Performance of large language models on a neurology board–style examination” JAMA Netw Open 2023; DOI: 10.1001/jamanetworkopen.2023.46721.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : MedPageToday – https://www.medpagetoday.com/neurology/generalneurology/107764

Tags: ChatGPThealthtakes
Previous Post

The Dumbbell Goblet Squat Works Way More Than Just Your Legs and Butt

Next Post

Got Raw Milk?

Mitochondrial genomes of Middle Pleistocene horses from the open-air site complex of Schöningen – Nature

Mitochondrial genomes of Middle Pleistocene horses from the open-air site complex of Schöningen – Nature

October 4, 2025
Scientists just cracked the mystery of why cancer immunotherapy fails – ScienceDaily

Scientists just cracked the mystery of why cancer immunotherapy fails – ScienceDaily

October 4, 2025
Global earthquake detection and warning using Android phones – Science | AAAS

Global earthquake detection and warning using Android phones – Science | AAAS

October 4, 2025
What Oil Is Really In Chick-Fil-A’s Fryer? Turns Out, It Depends On What You Order – Yahoo

What Oil Does Chick-Fil-A Really Use in Their Fryers? The Surprising Truth Behind Your Order!

October 4, 2025
What the Recent Price Surge Means for Figure Technology Solutions After SEC Settlement – Yahoo Finance

What the Recent Price Surge Reveals About Figure Technology Solutions Following SEC Settlement

October 4, 2025
Full-length Replay: Indonesia GP – FOX Sports

Experience the Full Thrill: Watch the Complete Replay of the Indonesia GP!

October 4, 2025
How the gathering of Israel is accelerating around the world – Church News

The Global Gathering of Israel: How It’s Accelerating Like Never Before

October 4, 2025
United States Economic Forecast Q3 2025 – Deloitte

United States Economic Forecast Q3 2025 – Deloitte

October 4, 2025
Al Roker Gives Olivia Dean an Unexpected ‘New Job’ on the ‘Today’ Show – Yahoo

Al Roker Shocks Olivia Dean with an Exciting New Role on the ‘Today’ Show

October 4, 2025
Holding Commercial Health Insurers Accountable – American Hospital Association

Holding Commercial Health Insurers Accountable – American Hospital Association

October 4, 2025

Categories

Archives

October 2025
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
2728293031  
« Sep    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (851)
  • Economy (871)
  • Entertainment (21,745)
  • General (17,408)
  • Health (9,914)
  • Lifestyle (884)
  • News (22,149)
  • People (873)
  • Politics (882)
  • Science (16,082)
  • Sports (21,372)
  • Technology (15,854)
  • World (854)

Recent News

Mitochondrial genomes of Middle Pleistocene horses from the open-air site complex of Schöningen – Nature

Mitochondrial genomes of Middle Pleistocene horses from the open-air site complex of Schöningen – Nature

October 4, 2025
Scientists just cracked the mystery of why cancer immunotherapy fails – ScienceDaily

Scientists just cracked the mystery of why cancer immunotherapy fails – ScienceDaily

October 4, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version