* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Thursday, June 12, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Op-Ed: Data Storage and Protection in Today’s Media & Entertainment Industry – Sports Video Group

    How Data Storage and Protection Are Transforming the Media & Entertainment Industry

    The Analyst Verdict: PENN Entertainment In The Eyes Of 7 Experts – Nasdaq

    7 Experts Reveal the Ultimate Verdict on PENN Entertainment

    3 Arts Entertainment Expands Into News With Acquisition of OManagement (Exclusive) – The Hollywood Reporter

    3 Arts Entertainment Expands Into News With Acquisition of OManagement (Exclusive) – The Hollywood Reporter

    Leading Proxy Advisory Firm Glass Lewis Recommends Shareholders Vote “FOR” Both of PENN Entertainment’s Director Nominees on the WHITE Proxy Card – Business Wire

    Glass Lewis Urges Shareholders to Support All PENN Entertainment Director Nominees on the WHITE Proxy Card

    Cisco Partners with Monumental Sports & Entertainment to Power New D.C. Arena – Cisco Newsroom

    Cisco Teams Up with Monumental Sports & Entertainment to Revolutionize the New D.C. Arena Experience

    Middle Eastern Entertainment Headlines at 5:49 a.m. GMT – Yahoo

    Exciting Updates from the Middle Eastern Entertainment Scene!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    MSI Viking and Mahr Host Technology Day – WSPA 7NEWS

    Step Inside the Thrilling World of MSI Viking and Mahr Technology Day!

    6.12pm is the new 8pm – Go Technology – cgastrategy.com

    6.12pm is the new 8pm – Go Technology – cgastrategy.com

    Russian Scientists Develop Sub-Ångström Technology for Next-Gen Quantum Processors – The Quantum Insider

    Russian Scientists Pioneer Sub-Ångström Technology to Revolutionize Next-Gen Quantum Processors

    Study uncovers SiPore Technology’s capacity to regulate blood glucose levels – Nutraceutical Business Review

    Study uncovers SiPore Technology’s capacity to regulate blood glucose levels – Nutraceutical Business Review

    SunHydrogen Unveils Large Hydrogen Reactor in Houston – Fuel Cells Works

    SunHydrogen Launches Groundbreaking Large-Scale Hydrogen Reactor in Houston

    Technology, Labor Rights, and Political Power in Kenya and Across Africa – Tech Policy Press

    How Technology is Shaping Labor Rights and Political Power Across Africa

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Op-Ed: Data Storage and Protection in Today’s Media & Entertainment Industry – Sports Video Group

    How Data Storage and Protection Are Transforming the Media & Entertainment Industry

    The Analyst Verdict: PENN Entertainment In The Eyes Of 7 Experts – Nasdaq

    7 Experts Reveal the Ultimate Verdict on PENN Entertainment

    3 Arts Entertainment Expands Into News With Acquisition of OManagement (Exclusive) – The Hollywood Reporter

    3 Arts Entertainment Expands Into News With Acquisition of OManagement (Exclusive) – The Hollywood Reporter

    Leading Proxy Advisory Firm Glass Lewis Recommends Shareholders Vote “FOR” Both of PENN Entertainment’s Director Nominees on the WHITE Proxy Card – Business Wire

    Glass Lewis Urges Shareholders to Support All PENN Entertainment Director Nominees on the WHITE Proxy Card

    Cisco Partners with Monumental Sports & Entertainment to Power New D.C. Arena – Cisco Newsroom

    Cisco Teams Up with Monumental Sports & Entertainment to Revolutionize the New D.C. Arena Experience

    Middle Eastern Entertainment Headlines at 5:49 a.m. GMT – Yahoo

    Exciting Updates from the Middle Eastern Entertainment Scene!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    MSI Viking and Mahr Host Technology Day – WSPA 7NEWS

    Step Inside the Thrilling World of MSI Viking and Mahr Technology Day!

    6.12pm is the new 8pm – Go Technology – cgastrategy.com

    6.12pm is the new 8pm – Go Technology – cgastrategy.com

    Russian Scientists Develop Sub-Ångström Technology for Next-Gen Quantum Processors – The Quantum Insider

    Russian Scientists Pioneer Sub-Ångström Technology to Revolutionize Next-Gen Quantum Processors

    Study uncovers SiPore Technology’s capacity to regulate blood glucose levels – Nutraceutical Business Review

    Study uncovers SiPore Technology’s capacity to regulate blood glucose levels – Nutraceutical Business Review

    SunHydrogen Unveils Large Hydrogen Reactor in Houston – Fuel Cells Works

    SunHydrogen Launches Groundbreaking Large-Scale Hydrogen Reactor in Houston

    Technology, Labor Rights, and Political Power in Kenya and Across Africa – Tech Policy Press

    How Technology is Shaping Labor Rights and Political Power Across Africa

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Science

Unlocking AI’s Black Box: New Formula Explains How They Detect Relevant Patterns

April 12, 2024
in Science
Unlocking AI’s Black Box: New Formula Explains How They Detect Relevant Patterns
Share on FacebookShare on Twitter

Neural Network Algorithm Art Concept

A UC San Diego team has uncovered a method to decipher neural networks’ learning process, using a statistical formula to clarify how features are learned, a breakthrough that promises more understandable and efficient AI systems. Credit: SciTechDaily.com

The findings can also be applied to enhance the efficiency of various machine learning frameworks.

Neural networks have been powering breakthroughs in artificial intelligence, including the large language models that are now being used in a wide range of applications, from finance, to human resources to healthcare. But these networks remain a black box whose inner workings engineers and scientists struggle to understand. Now, a team led by data and computer scientists at the University of California San Diego has given neural networks the equivalent of an X-ray to uncover how they actually learn.

The researchers found that a formula used in statistical analysis provides a streamlined mathematical description of how neural networks, such as GPT-2, a precursor to ChatGPT, learn relevant patterns in data, known as features. This formula also explains how neural networks use these relevant patterns to make predictions.

“We are trying to understand neural networks from first principles,” said Daniel Beaglehole, a Ph.D. student in the UC San Diego Department of Computer Science and Engineering and co-first author of the study. “With our formula, one can simply interpret which features the network is using to make predictions.”

The team presented their findings in the March 7 issue of the journal Science.

Why does this matter? AI-powered tools are now pervasive in everyday life. Banks use them to approve loans. Hospitals use them to analyze medical data, such as X-rays and MRIs. Companies use them to screen job applicants. But it’s currently difficult to understand the mechanism neural networks use to make decisions and the biases in the training data that might impact this.

“If you don’t understand how neural networks learn, it’s very hard to establish whether neural networks produce reliable, accurate, and appropriate responses,” said Mikhail Belkin, the paper’s corresponding author and a professor at the UC San Diego Halicioglu Data Science Institute. “This is particularly significant given the rapid recent growth of machine learning and neural net technology.”

The study is part of a larger effort in Belkin’s research group to develop a mathematical theory that explains how neural networks work. “Technology has outpaced theory by a huge amount,” he said. “We need to catch up.”

The team also showed that the statistical formula they used to understand how neural networks learn, known as Average Gradient Outer Product (AGOP), could be applied to improve performance and efficiency in other types of machine learning architectures that do not include neural networks.

“If we understand the underlying mechanisms that drive neural networks, we should be able to build machine learning models that are simpler, more efficient, and more interpretable,” Belkin said. “We hope this will help democratize AI.”

The machine learning systems that Belkin envisions would need less computational power, and therefore less power from the grid, to function. These systems also would be less complex and so easier to understand.

Illustrating the new findings with an example

(Artificial) neural networks are computational tools to learn relationships between data characteristics (i.e. identifying specific objects or faces in an image). One example of a task is determining whether in a new image, a person is wearing glasses or not. Machine learning approaches this problem by providing the neural network many example (training) images labeled as images of “a person wearing glasses” or ”a person not wearing glasses.” The neural network learns the relationship between images and their labels, and extracts data patterns, or features, that it needs to focus on to make a determination. One of the reasons AI systems are considered a black box is because it is often difficult to describe mathematically what criteria the systems are actually using to make their predictions, including potential biases. The new work provides a simple mathematical explanation for how the systems are learning these features.

Features are relevant patterns in the data. In the example above, there are a wide range of features that the neural networks learns, and then uses, to determine if in fact a person in a photograph is wearing glasses or not. One feature it would need to pay attention to for this task is the upper part of the face. Other features could be the eye or the nose area where glasses often rest. The network selectively pays attention to the features that it learns are relevant and then discards the other parts of the image, such as the lower part of the face, the hair, and so on.

Feature learning is the ability to recognize relevant patterns in data and then use those patterns to make predictions. In the glasses example, the network learns to pay attention to the upper part of the face. In the new Science paper, the researchers identified a statistical formula that describes how the neural networks are learning features.

Alternative neural network architectures: The researchers went on to show that inserting this formula into computing systems that do not rely on neural networks allowed these systems to learn faster and more efficiently.

“How do I ignore what’s not necessary? Humans are good at this,” said Belkin. “Machines are doing the same thing. Large Language Models, for example, are implementing this ‘selective paying attention’ and we haven’t known how they do it. In our Science paper, we present a mechanism explaining at least some of how the neural nets are ‘selectively paying attention.’”

Reference: “Mechanism for feature learning in neural networks and backpropagation-free machine learning models” by Adityanarayanan Radhakrishnan, Daniel Beaglehole, Parthe Pandit and Mikhail Belkin, 7 March 2024, Science.
DOI: 10.1126/science.adi5639

Study funders included the National Science Foundation and the Simons Foundation for the Collaboration on the Theoretical Foundations of Deep Learning. Belkin is part of NSF-funded and UC San Diego-led The Institute for Learning-enabled Optimization at Scale, or TILOS.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : SciTechDaily – https://scitechdaily.com/unlocking-ais-black-box-new-formula-explains-how-they-detect-relevant-patterns/

Tags: AI’sscienceUnlocking
Previous Post

Sunflower Secrets Unveiled: Multiple Origins of Flower Symmetry Discovered

Next Post

Light-Matter Particle Breakthrough Could Change Displays Forever

Can anything save US science from Donald Trump? – Times Higher Education

Is There Hope for US Science Under Donald Trump?

June 12, 2025
Philly VegFest brings all-things vegan to the community – The Philadelphia Tribune

Philly VegFest brings all-things vegan to the community – The Philadelphia Tribune

June 12, 2025
Making America Backward Again – Rolling Stone

Making America Backward Again – Rolling Stone

June 12, 2025
Op-Ed: Data Storage and Protection in Today’s Media & Entertainment Industry – Sports Video Group

How Data Storage and Protection Are Transforming the Media & Entertainment Industry

June 12, 2025
Covenant Health educating the youth on healthcare opportunities – KCBD

Unlocking Thrilling Healthcare Career Paths for Today’s Youth

June 12, 2025
Republicans to Press Hochul, Walz and Pritzker on Immigration in Hearing – The New York Times

Republicans Intensify Pressure on Hochul, Walz, and Pritzker Ahead of Key Immigration Hearing

June 12, 2025
MSI Viking and Mahr Host Technology Day – WSPA 7NEWS

Step Inside the Thrilling World of MSI Viking and Mahr Technology Day!

June 12, 2025
Connections: Sports Edition hints for June 11, 2025, puzzle No. 261 – The New York Times

Connections: Sports Edition hints for June 11, 2025, puzzle No. 261 – The New York Times

June 12, 2025
Washington Department of Ecology Proposes New Permitting Program for Projects that Alter or ‎Impact Waters of the State – JD Supra

Washington Department of Ecology Unveils New Permitting Program for Projects Affecting State Waters

June 11, 2025
Ssss-ummer fun at Cook Museum of Natural Science – WHNT.com

Ssss-ummer fun at Cook Museum of Natural Science – WHNT.com

June 11, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (682)
  • Economy (697)
  • Entertainment (21,601)
  • General (15,341)
  • Health (9,738)
  • Lifestyle (701)
  • News (22,149)
  • People (697)
  • Politics (704)
  • Science (15,914)
  • Sports (21,198)
  • Technology (15,683)
  • World (680)

Recent News

Can anything save US science from Donald Trump? – Times Higher Education

Is There Hope for US Science Under Donald Trump?

June 12, 2025
Philly VegFest brings all-things vegan to the community – The Philadelphia Tribune

Philly VegFest brings all-things vegan to the community – The Philadelphia Tribune

June 12, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version