* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Sunday, August 3, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Go-to entertainment: why gaming was made for the toilet – The Guardian

    Why Gaming Is the Ultimate Way to Pass Time in the Bathroom

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Sens. Blackburn, Warnock introduce CREATE Act to provide tax relief to music creators – Yahoo Home

    Sens. Blackburn and Warnock Launch CREATE Act to Deliver Tax Relief for Music Creators

    That’s (Political) Entertainment: When Theatre Meets Politics

    Future Script: How Generative AI Is Changing Collective Bargaining in the Entertainment Industry – Jackson Lewis

    Future Script: How Generative AI Is Transforming Collective Bargaining in Entertainment

    The SBA’s live-entertainment bailout was supposed to end two years ago. We still don’t know how $1.5 billion was spent. – Yahoo Home

    $1.5 Billion Live-Entertainment Bailout: Two Years Later, Where Did the Money Go?

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Microsoft Seeks to Extend Access to OpenAI Technology – PYMNTS.com

    Microsoft Aims to Broaden Access to OpenAI Technology

    Livonia police use grappler technology to stop drunk driver – ClickOnDetroit | WDIV Local 4

    Livonia Police Deploy Grappler Technology to Safely Stop Drunk Driver

    Emory orthopaedic surgeons use robotic technology to transform knee replacement surgery – Emory News Center

    How Robotic Technology is Revolutionizing Knee Replacement Surgery

    Cognizant Technology Solutions Corp (CTSH) Q2 2025 Earnings Call Highlights: Strong Revenue … – Yahoo.co

    Cognizant Q2 2025 Earnings: Impressive Revenue Growth and Key Takeaways

    Revving Up The U.S. Technology Engine – Forbes

    Revving Up The U.S. Technology Engine – Forbes

    More than just a hockey player – Rochester Institute of Technology Athletics

    Beyond the Ice: The Inspiring Journey of a Remarkable Athlete from Rochester Institute of Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Go-to entertainment: why gaming was made for the toilet – The Guardian

    Why Gaming Is the Ultimate Way to Pass Time in the Bathroom

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Sens. Blackburn, Warnock introduce CREATE Act to provide tax relief to music creators – Yahoo Home

    Sens. Blackburn and Warnock Launch CREATE Act to Deliver Tax Relief for Music Creators

    That’s (Political) Entertainment: When Theatre Meets Politics

    Future Script: How Generative AI Is Changing Collective Bargaining in the Entertainment Industry – Jackson Lewis

    Future Script: How Generative AI Is Transforming Collective Bargaining in Entertainment

    The SBA’s live-entertainment bailout was supposed to end two years ago. We still don’t know how $1.5 billion was spent. – Yahoo Home

    $1.5 Billion Live-Entertainment Bailout: Two Years Later, Where Did the Money Go?

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Microsoft Seeks to Extend Access to OpenAI Technology – PYMNTS.com

    Microsoft Aims to Broaden Access to OpenAI Technology

    Livonia police use grappler technology to stop drunk driver – ClickOnDetroit | WDIV Local 4

    Livonia Police Deploy Grappler Technology to Safely Stop Drunk Driver

    Emory orthopaedic surgeons use robotic technology to transform knee replacement surgery – Emory News Center

    How Robotic Technology is Revolutionizing Knee Replacement Surgery

    Cognizant Technology Solutions Corp (CTSH) Q2 2025 Earnings Call Highlights: Strong Revenue … – Yahoo.co

    Cognizant Q2 2025 Earnings: Impressive Revenue Growth and Key Takeaways

    Revving Up The U.S. Technology Engine – Forbes

    Revving Up The U.S. Technology Engine – Forbes

    More than just a hockey player – Rochester Institute of Technology Athletics

    Beyond the Ice: The Inspiring Journey of a Remarkable Athlete from Rochester Institute of Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Business

Research Scientist Andrei Barbu Gives Us Input On LLM Design

June 9, 2024
in Business
Research Scientist Andrei Barbu Gives Us Input On LLM Design
Share on FacebookShare on Twitter

Today I heard from MIT research scientist Andrei Barbu about working with LLMs, and how to prevent certain kinds of problems related to data leaks.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

“We’re interested in studying language in particular,” he said of his work, turning to some of the goals of research teams in this area.

Thinking about the duality of human and computer cognition, he pointed out some differences. Humans, he said, teach one another, for example. Another thing humans can do is keep secrets. That might be challenging for our digital counterparts.

“There’s a problem with LLMs,” he noted, explaining their potential for leaks. “They can’t keep a secret.”

LLMs are fundamentally insecure

Andrei Barbu

In outlining how to identify the issue, Barbu talked about prompt injection attacks as a prime example. We heard something a little like this from Adam Chipala just prior, where he mentioned verifiable software principles as a potential solution.

Barbu brought up something that I found interesting, though: a kind of catch-22 for systems that are not very good at sealing in data.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

“Models are as sensitive as the most sensitive piece of data put inside that model,” he explained. “People can interrogate the model. … (on the other hand, models are) as weak and vulnerable to attack as the least sensitive piece that you put in.”

People can poison your model, he suggested, in some cases, fairly easily.

The solution: Barbu talked about a customized model, with fine tuning, and how that may work.

Specifically, he was talking about something called low-rank adaptation or LORA, a fine-tuning method pioneered at Microsoft in 2021.

Fine-tuning LORA

Andrei Barbu

When I looked into it, experts cite two things that LORA does in a sort of proprietary way: it tracks changes to weights rather than updating weights directly, and it makes the large matrix of weight changes into smaller matrices to isolate parameters.

In describing some related methods, Barbu talked about extracting what’s needed from a library of components, and explained that there are lots of ways to approach this. Using a Venn diagram, he noted the difference between adaptive and selective types of methods, and others.

Fine-tuning models

Andrei Barbu

You can think, he suggested, about strategies like turning English into SQL to problem-solve and expedite solutions. At the end of the day, though, the challenge remains.

“Security is binary,” he noted. “You succeed or fail.”

Now, this part of the presentation caught my ear: Barbu talked about some kinds of potential AI tools that could end up taking a lot of the labor out of information security. He described a situation where the tools sit on top of a network, looking for sensitive information, and actually provide input.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

This, he suggested, could solve some rampant HIPAA problems with leaks of protected health data.

“We just don’t have a good solution to this so far,” he said. But with the right tools, we might!

Another good idea that I heard from his talk was around labeling ‘informed perplexity’ and ‘uninformed perplexity’ to see where a problem lies.

Then, he said, we can also improve the secret-keeping capabilities of our LLMs.

“We can build secure LLMs,” he added, “models that are completely immune to any kind of attack, because we simply don’t connect the parameters that the user should have access to, so there’s literally nothing that they can possibly do…”

Look, there was a lot more in this demo – for example, Barbu talked a good bit about the scenario of keeping data on alien landings in a database – just as an example! So that part was notable, too. You’ll have to delve into the video to really see all of it in detail. But I’m going to keep bringing the highlights from this conference to you, almost in real time!

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Forbes – https://www.forbes.com/sites/johnwerner/2024/06/08/research-scientist-andrei-barbu-gives-us-input-on-llm-design

Tags: businessResearchScientist
Previous Post

To Iprove VAR, Premier League Should Adopt These 3 MLS Practices

Next Post

2 Ways To Bridge The ‘Desire Gap’ In Relationships—By A Psychologist

Study reveals China’s ecological red lines offer blueprint for biodiversity protection – Phys.org

Study reveals China’s ecological red lines offer blueprint for biodiversity protection – Phys.org

August 3, 2025
What do TSA bag scanners actually see? – Popular Science

What do TSA bag scanners actually see? – Popular Science

August 3, 2025
Why does your mind goes ‘blank’? New brain scans reveal the surprising answer – Live Science

Why does your mind goes ‘blank’? New brain scans reveal the surprising answer – Live Science

August 3, 2025
U.S. POINTER Study shows lifestyle program improves cognition in older adults – University of California – Davis Health

Lifestyle Program Boosts Cognitive Health in Older Adults, New Study Finds

August 3, 2025
World Championships, Day Eight Finals: Kliment Kolesnikov Blazes to Title in 50 Backstroke; Tie for Silver – Swimming World

Kliment Kolesnikov Blazes to Victory in 50 Backstroke as Day Eight of World Championships Ends with a Silver Medal Tie

August 3, 2025
Bond investors warm to risk, with Fed staying put in ‘Goldilocks’ economy – Reuters

Bond Investors Take Bold Steps as Fed Maintains Steady Course in a ‘Goldilocks’ Economy

August 3, 2025
Go-to entertainment: why gaming was made for the toilet – The Guardian

Why Gaming Is the Ultimate Way to Pass Time in the Bathroom

August 3, 2025
Covenant Health offers immunizations, activities for kids at Back to School Bash – KCBD

Covenant Health’s Back to School Bash: A Fun-Filled Immunization and Activities Event for Kids

August 3, 2025
Trump tells Schumer to ‘go to hell’ as Senate heads home after failed attempt to strike deal on nominees – CNN

Trump tells Schumer to ‘go to hell’ as Senate heads home after failed attempt to strike deal on nominees – CNN

August 3, 2025
Microsoft Seeks to Extend Access to OpenAI Technology – PYMNTS.com

Microsoft Aims to Broaden Access to OpenAI Technology

August 3, 2025

Categories

Archives

August 2025
MTWTFSS
 123
45678910
11121314151617
18192021222324
25262728293031
« Jul    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (752)
  • Economy (777)
  • Entertainment (21,654)
  • General (16,263)
  • Health (9,814)
  • Lifestyle (785)
  • News (22,149)
  • People (777)
  • Politics (786)
  • Science (15,990)
  • Sports (21,272)
  • Technology (15,754)
  • World (758)

Recent News

Study reveals China’s ecological red lines offer blueprint for biodiversity protection – Phys.org

Study reveals China’s ecological red lines offer blueprint for biodiversity protection – Phys.org

August 3, 2025
What do TSA bag scanners actually see? – Popular Science

What do TSA bag scanners actually see? – Popular Science

August 3, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version