* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Sunday, June 1, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Why Starz Entertainment Stock Soared Today – The Motley Fool

    Unpacking the Surge: What Fueled Starz Entertainment’s Stock Explosion Today!

    Unveiling the Enigmatic: First Looks at Destruction and Puck in ‘The Sandman

    Jackie Chan Reveals This Family Member ‘Never Watched’ The Whole Of Any Of His Movies – Yahoo

    Jackie Chan Reveals This Family Member ‘Never Watched’ The Whole Of Any Of His Movies – Yahoo

    Mavs CEO holds firm on new arena, entertainment district in Dallas – Dallas News

    Mavs CEO Stands Strong on Vision for New Arena and Entertainment District in Dallas

    Entertainment: On Your Marks, Get Set, Beer Run! – Urban Milwaukee

    Get Ready to Race: The Ultimate Beer Run Experience Awaits!

    Rachel Guttman Launches Entertainment Law Firm Gutt Law, PLLC [Exclusive] – MusicRow.com

    Rachel Guttman Unveils Exciting New Entertainment Law Firm: Gutt Law, PLLC!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    This giant microwave may change the future of war – MIT Technology Review

    Revolutionizing Warfare: The Impact of a Game-Changing Giant Microwave

    Bajeed Pattan Joins Forbes Technology Council as Innovation Leader – PRWeb

    Bajeed Pattan Takes the Helm as Innovation Leader at Forbes Technology Council!

    Lafayette Regional Technology Council – Tech Leadership That’s Homegrown and Future-Focused – Discover Lafayette

    Lafayette Regional Technology Council – Tech Leadership That’s Homegrown and Future-Focused – Discover Lafayette

    Drone technology demo in Cambria County showcases future of lifesaving medical deliveries – local21news.com

    Revolutionizing Healthcare: Drone Technology Takes Flight for Lifesaving Medical Deliveries in Cambria County

    Revolutionary Harvesting Technology Promises to Slash CAR-T Manufacturing Costs!

    Stop the Machines: The Rise of Anti-Technology Extremism – International Centre for Counter-Terrorism – ICCT

    Unplugged: The Surge of Anti-Technology Extremism

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Why Starz Entertainment Stock Soared Today – The Motley Fool

    Unpacking the Surge: What Fueled Starz Entertainment’s Stock Explosion Today!

    Unveiling the Enigmatic: First Looks at Destruction and Puck in ‘The Sandman

    Jackie Chan Reveals This Family Member ‘Never Watched’ The Whole Of Any Of His Movies – Yahoo

    Jackie Chan Reveals This Family Member ‘Never Watched’ The Whole Of Any Of His Movies – Yahoo

    Mavs CEO holds firm on new arena, entertainment district in Dallas – Dallas News

    Mavs CEO Stands Strong on Vision for New Arena and Entertainment District in Dallas

    Entertainment: On Your Marks, Get Set, Beer Run! – Urban Milwaukee

    Get Ready to Race: The Ultimate Beer Run Experience Awaits!

    Rachel Guttman Launches Entertainment Law Firm Gutt Law, PLLC [Exclusive] – MusicRow.com

    Rachel Guttman Unveils Exciting New Entertainment Law Firm: Gutt Law, PLLC!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    This giant microwave may change the future of war – MIT Technology Review

    Revolutionizing Warfare: The Impact of a Game-Changing Giant Microwave

    Bajeed Pattan Joins Forbes Technology Council as Innovation Leader – PRWeb

    Bajeed Pattan Takes the Helm as Innovation Leader at Forbes Technology Council!

    Lafayette Regional Technology Council – Tech Leadership That’s Homegrown and Future-Focused – Discover Lafayette

    Lafayette Regional Technology Council – Tech Leadership That’s Homegrown and Future-Focused – Discover Lafayette

    Drone technology demo in Cambria County showcases future of lifesaving medical deliveries – local21news.com

    Revolutionizing Healthcare: Drone Technology Takes Flight for Lifesaving Medical Deliveries in Cambria County

    Revolutionary Harvesting Technology Promises to Slash CAR-T Manufacturing Costs!

    Stop the Machines: The Rise of Anti-Technology Extremism – International Centre for Counter-Terrorism – ICCT

    Unplugged: The Surge of Anti-Technology Extremism

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Business

Research Scientist Andrei Barbu Gives Us Input On LLM Design

June 9, 2024
in Business
Research Scientist Andrei Barbu Gives Us Input On LLM Design
Share on FacebookShare on Twitter

Today I heard from MIT research scientist Andrei Barbu about working with LLMs, and how to prevent certain kinds of problems related to data leaks.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

“We’re interested in studying language in particular,” he said of his work, turning to some of the goals of research teams in this area.

Thinking about the duality of human and computer cognition, he pointed out some differences. Humans, he said, teach one another, for example. Another thing humans can do is keep secrets. That might be challenging for our digital counterparts.

“There’s a problem with LLMs,” he noted, explaining their potential for leaks. “They can’t keep a secret.”

LLMs are fundamentally insecure

Andrei Barbu

In outlining how to identify the issue, Barbu talked about prompt injection attacks as a prime example. We heard something a little like this from Adam Chipala just prior, where he mentioned verifiable software principles as a potential solution.

Barbu brought up something that I found interesting, though: a kind of catch-22 for systems that are not very good at sealing in data.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

“Models are as sensitive as the most sensitive piece of data put inside that model,” he explained. “People can interrogate the model. … (on the other hand, models are) as weak and vulnerable to attack as the least sensitive piece that you put in.”

People can poison your model, he suggested, in some cases, fairly easily.

The solution: Barbu talked about a customized model, with fine tuning, and how that may work.

Specifically, he was talking about something called low-rank adaptation or LORA, a fine-tuning method pioneered at Microsoft in 2021.

Fine-tuning LORA

Andrei Barbu

When I looked into it, experts cite two things that LORA does in a sort of proprietary way: it tracks changes to weights rather than updating weights directly, and it makes the large matrix of weight changes into smaller matrices to isolate parameters.

In describing some related methods, Barbu talked about extracting what’s needed from a library of components, and explained that there are lots of ways to approach this. Using a Venn diagram, he noted the difference between adaptive and selective types of methods, and others.

Fine-tuning models

Andrei Barbu

You can think, he suggested, about strategies like turning English into SQL to problem-solve and expedite solutions. At the end of the day, though, the challenge remains.

“Security is binary,” he noted. “You succeed or fail.”

Now, this part of the presentation caught my ear: Barbu talked about some kinds of potential AI tools that could end up taking a lot of the labor out of information security. He described a situation where the tools sit on top of a network, looking for sensitive information, and actually provide input.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

This, he suggested, could solve some rampant HIPAA problems with leaks of protected health data.

“We just don’t have a good solution to this so far,” he said. But with the right tools, we might!

Another good idea that I heard from his talk was around labeling ‘informed perplexity’ and ‘uninformed perplexity’ to see where a problem lies.

Then, he said, we can also improve the secret-keeping capabilities of our LLMs.

“We can build secure LLMs,” he added, “models that are completely immune to any kind of attack, because we simply don’t connect the parameters that the user should have access to, so there’s literally nothing that they can possibly do…”

Look, there was a lot more in this demo – for example, Barbu talked a good bit about the scenario of keeping data on alien landings in a database – just as an example! So that part was notable, too. You’ll have to delve into the video to really see all of it in detail. But I’m going to keep bringing the highlights from this conference to you, almost in real time!

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Forbes – https://www.forbes.com/sites/johnwerner/2024/06/08/research-scientist-andrei-barbu-gives-us-input-on-llm-design

Tags: businessResearchScientist
Previous Post

To Iprove VAR, Premier League Should Adopt These 3 MLS Practices

Next Post

2 Ways To Bridge The ‘Desire Gap’ In Relationships—By A Psychologist

Looking Back at the Good Old Days of Growth Under Biden – Bloomberg.com

Looking Back at the Good Old Days of Growth Under Biden – Bloomberg.com

June 1, 2025
Why Starz Entertainment Stock Soared Today – The Motley Fool

Unpacking the Surge: What Fueled Starz Entertainment’s Stock Explosion Today!

June 1, 2025
White House acknowledges problems in RFK Jr.’s ‘Make America Healthy Again’ report – AP News

White House Admits Flaws in RFK Jr.’s ‘Make America Healthy Again’ Report

June 1, 2025
N.Y. landlords, lawmakers to face off over expanding upstate rent control – Spectrum News

Showdown Ahead: N.Y. Landlords and Lawmakers Clash Over Expanding Rent Control Upstate!

June 1, 2025
This giant microwave may change the future of war – MIT Technology Review

Revolutionizing Warfare: The Impact of a Game-Changing Giant Microwave

June 1, 2025
EA SPORTS™ College Football 26 Launches Worldwide on July 10 Celebrating Emerging Stars, Real-world Coaches and the Spirit of College Football – Electronic Arts Home Page

Get Ready for EA SPORTS™ College Football 26: Launching Worldwide on July 10 to Celebrate Rising Stars and the Heart of College Football!

June 1, 2025
Some birds are left behind in a race to beat the heat – Nature

Some birds are left behind in a race to beat the heat – Nature

June 1, 2025
A passing star could fling Earth out of orbit – Science News

A passing star could fling Earth out of orbit – Science News

June 1, 2025
John Hancock Multimanager Lifestyle Moderate Portfolio Q1 2025 Commentary (JALMX) – Seeking Alpha

Unlocking Potential: Insights from the John Hancock Multimanager Lifestyle Moderate Portfolio Q1 2025

June 1, 2025
Editorial: The world promised by AI isn’t necessarily a better one – Pittsburgh Post-Gazette

Editorial: The world promised by AI isn’t necessarily a better one – Pittsburgh Post-Gazette

June 1, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (656)
  • Economy (672)
  • Entertainment (21,578)
  • General (15,254)
  • Health (9,714)
  • Lifestyle (673)
  • News (22,149)
  • People (672)
  • Politics (680)
  • Science (15,891)
  • Sports (21,176)
  • Technology (15,659)
  • World (659)

Recent News

Looking Back at the Good Old Days of Growth Under Biden – Bloomberg.com

Looking Back at the Good Old Days of Growth Under Biden – Bloomberg.com

June 1, 2025
Why Starz Entertainment Stock Soared Today – The Motley Fool

Unpacking the Surge: What Fueled Starz Entertainment’s Stock Explosion Today!

June 1, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version