* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Sunday, August 24, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Drake Appears in Teaser for Bobbi Althoff’s New Podcast ‘Not This Again’ – yahoo.com

    Drake Drops a Surprise Cameo in Bobbi Althoff’s Thrilling New Podcast Teaser ‘Not This Again

    From polka to Poison, Corn Palace adjusts entertainment offerings with the times – Mitchell Republic

    From polka to Poison, Corn Palace adjusts entertainment offerings with the times – Mitchell Republic

    How to watch ‘F1: The Movie’ on Prime Video – About Amazon

    Experience the Thrill: How to Stream ‘F1: The Movie’ on Prime Video

    FOX One is now available on Prime Video: Here’s everything to know – About Amazon

    FOX One is now available on Prime Video: Here’s everything to know – About Amazon

    What Are Our Predictions for Taylor Swift’s ‘Life of a Showgirl’ Based on What She’s Told Us So Far? – yahoo.com

    Uncover the Hidden Surprises in Taylor Swift’s ‘Life of a Showgirl’ – Can You Decode Her Clues?

    Bama Dining Serving Up New Food, Entertainment – UA News Center

    Bama Dining Launches Thrilling New Food and Entertainment Experiences

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    UNLV Responds to Workforce Need with Microcredential in Nuclear Technology – University of Nevada, Las Vegas | UNLV

    UNLV Unveils Cutting-Edge Microcredential Program to Fuel Growth in Nuclear Technology

    Why Technology Will Never Take Over Completely – Patheos

    Why Technology Will Never Completely Control Our Lives

    Alcorn State awarded grant to boost STEM with VR technology – WJTV

    Alcorn State Secures Grant to Transform STEM Education Through Cutting-Edge VR Technology

    Hyundai: The Only Way To Beat China Is To Embrace Technology – InsideEVs

    Hyundai’s Bold Strategy to Outpace China with Cutting-Edge Technology

    Teaching older adults how to use technology – WWNY

    Empowering Older Adults to Master Technology with Confidence

    Denver man receives pacemaker using new technology – CBS News

    Denver Man’s Life Transformed by Revolutionary Pacemaker Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Drake Appears in Teaser for Bobbi Althoff’s New Podcast ‘Not This Again’ – yahoo.com

    Drake Drops a Surprise Cameo in Bobbi Althoff’s Thrilling New Podcast Teaser ‘Not This Again

    From polka to Poison, Corn Palace adjusts entertainment offerings with the times – Mitchell Republic

    From polka to Poison, Corn Palace adjusts entertainment offerings with the times – Mitchell Republic

    How to watch ‘F1: The Movie’ on Prime Video – About Amazon

    Experience the Thrill: How to Stream ‘F1: The Movie’ on Prime Video

    FOX One is now available on Prime Video: Here’s everything to know – About Amazon

    FOX One is now available on Prime Video: Here’s everything to know – About Amazon

    What Are Our Predictions for Taylor Swift’s ‘Life of a Showgirl’ Based on What She’s Told Us So Far? – yahoo.com

    Uncover the Hidden Surprises in Taylor Swift’s ‘Life of a Showgirl’ – Can You Decode Her Clues?

    Bama Dining Serving Up New Food, Entertainment – UA News Center

    Bama Dining Launches Thrilling New Food and Entertainment Experiences

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    UNLV Responds to Workforce Need with Microcredential in Nuclear Technology – University of Nevada, Las Vegas | UNLV

    UNLV Unveils Cutting-Edge Microcredential Program to Fuel Growth in Nuclear Technology

    Why Technology Will Never Take Over Completely – Patheos

    Why Technology Will Never Completely Control Our Lives

    Alcorn State awarded grant to boost STEM with VR technology – WJTV

    Alcorn State Secures Grant to Transform STEM Education Through Cutting-Edge VR Technology

    Hyundai: The Only Way To Beat China Is To Embrace Technology – InsideEVs

    Hyundai’s Bold Strategy to Outpace China with Cutting-Edge Technology

    Teaching older adults how to use technology – WWNY

    Empowering Older Adults to Master Technology with Confidence

    Denver man receives pacemaker using new technology – CBS News

    Denver Man’s Life Transformed by Revolutionary Pacemaker Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Business

Research Scientist Andrei Barbu Gives Us Input On LLM Design

June 9, 2024
in Business
Research Scientist Andrei Barbu Gives Us Input On LLM Design
Share on FacebookShare on Twitter

Today I heard from MIT research scientist Andrei Barbu about working with LLMs, and how to prevent certain kinds of problems related to data leaks.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

“We’re interested in studying language in particular,” he said of his work, turning to some of the goals of research teams in this area.

Thinking about the duality of human and computer cognition, he pointed out some differences. Humans, he said, teach one another, for example. Another thing humans can do is keep secrets. That might be challenging for our digital counterparts.

“There’s a problem with LLMs,” he noted, explaining their potential for leaks. “They can’t keep a secret.”

LLMs are fundamentally insecure

Andrei Barbu

In outlining how to identify the issue, Barbu talked about prompt injection attacks as a prime example. We heard something a little like this from Adam Chipala just prior, where he mentioned verifiable software principles as a potential solution.

Barbu brought up something that I found interesting, though: a kind of catch-22 for systems that are not very good at sealing in data.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

“Models are as sensitive as the most sensitive piece of data put inside that model,” he explained. “People can interrogate the model. … (on the other hand, models are) as weak and vulnerable to attack as the least sensitive piece that you put in.”

People can poison your model, he suggested, in some cases, fairly easily.

The solution: Barbu talked about a customized model, with fine tuning, and how that may work.

Specifically, he was talking about something called low-rank adaptation or LORA, a fine-tuning method pioneered at Microsoft in 2021.

Fine-tuning LORA

Andrei Barbu

When I looked into it, experts cite two things that LORA does in a sort of proprietary way: it tracks changes to weights rather than updating weights directly, and it makes the large matrix of weight changes into smaller matrices to isolate parameters.

In describing some related methods, Barbu talked about extracting what’s needed from a library of components, and explained that there are lots of ways to approach this. Using a Venn diagram, he noted the difference between adaptive and selective types of methods, and others.

Fine-tuning models

Andrei Barbu

You can think, he suggested, about strategies like turning English into SQL to problem-solve and expedite solutions. At the end of the day, though, the challenge remains.

“Security is binary,” he noted. “You succeed or fail.”

Now, this part of the presentation caught my ear: Barbu talked about some kinds of potential AI tools that could end up taking a lot of the labor out of information security. He described a situation where the tools sit on top of a network, looking for sensitive information, and actually provide input.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

This, he suggested, could solve some rampant HIPAA problems with leaks of protected health data.

“We just don’t have a good solution to this so far,” he said. But with the right tools, we might!

Another good idea that I heard from his talk was around labeling ‘informed perplexity’ and ‘uninformed perplexity’ to see where a problem lies.

Then, he said, we can also improve the secret-keeping capabilities of our LLMs.

“We can build secure LLMs,” he added, “models that are completely immune to any kind of attack, because we simply don’t connect the parameters that the user should have access to, so there’s literally nothing that they can possibly do…”

Look, there was a lot more in this demo – for example, Barbu talked a good bit about the scenario of keeping data on alien landings in a database – just as an example! So that part was notable, too. You’ll have to delve into the video to really see all of it in detail. But I’m going to keep bringing the highlights from this conference to you, almost in real time!

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Forbes – https://www.forbes.com/sites/johnwerner/2024/06/08/research-scientist-andrei-barbu-gives-us-input-on-llm-design

Tags: businessResearchScientist
Previous Post

To Iprove VAR, Premier League Should Adopt These 3 MLS Practices

Next Post

2 Ways To Bridge The ‘Desire Gap’ In Relationships—By A Psychologist

Third annual event highlights cultural, ecological importance of Tawas Lake – Iosco County News Herald

Explore the Vibrant Culture and Stunning Ecology of Tawas Lake at This Year’s Exciting Third Annual Event!

August 24, 2025
UNT Ph.D. Grad Gives $2M to Launch Data Science Innovation Lab – Dallas Innovates

UNT Ph.D. Grad Gives $2M to Launch Data Science Innovation Lab – Dallas Innovates

August 24, 2025
Center to advance hunting and conservation looks to tradition, science – NBC Montana

Center Pioneers New Era in Hunting and Conservation by Merging Tradition with Science

August 24, 2025
‘Hidden gem’ – the lifestyle village beating the property slump – Stuff

‘Hidden gem’ – the lifestyle village beating the property slump – Stuff

August 24, 2025
UNLV Responds to Workforce Need with Microcredential in Nuclear Technology – University of Nevada, Las Vegas | UNLV

UNLV Unveils Cutting-Edge Microcredential Program to Fuel Growth in Nuclear Technology

August 24, 2025
Women’s football moves mountains in Pakistan – EL PAÍS English

Women’s football moves mountains in Pakistan – EL PAÍS English

August 24, 2025
Lifeguard, 82, Sets Impressive Guinness World Record After More Than 60 Years Lifeguarding – People.com

82-Year-Old Lifeguard Breaks Guinness World Record After Over 60 Years on Duty

August 24, 2025
Powell’s Rate Cut Signal Reflects Economy’s Delicate Position – Hindustan Times

Powell’s Rate Cut Signal Reflects Economy’s Delicate Position – Hindustan Times

August 24, 2025
Drake Appears in Teaser for Bobbi Althoff’s New Podcast ‘Not This Again’ – yahoo.com

Drake Drops a Surprise Cameo in Bobbi Althoff’s Thrilling New Podcast Teaser ‘Not This Again

August 24, 2025
Hamilton County school board rejects mental health center contract – Chattanooga Times Free Press

Hamilton County School Board Rejects Contract for New Mental Health Center

August 24, 2025

Categories

Archives

August 2025
MTWTFSS
 123
45678910
11121314151617
18192021222324
25262728293031
« Jul    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (787)
  • Economy (807)
  • Entertainment (21,686)
  • General (16,641)
  • Health (9,847)
  • Lifestyle (820)
  • News (22,149)
  • People (809)
  • Politics (816)
  • Science (16,019)
  • Sports (21,306)
  • Technology (15,788)
  • World (788)

Recent News

Third annual event highlights cultural, ecological importance of Tawas Lake – Iosco County News Herald

Explore the Vibrant Culture and Stunning Ecology of Tawas Lake at This Year’s Exciting Third Annual Event!

August 24, 2025
UNT Ph.D. Grad Gives $2M to Launch Data Science Innovation Lab – Dallas Innovates

UNT Ph.D. Grad Gives $2M to Launch Data Science Innovation Lab – Dallas Innovates

August 24, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version