* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Monday, June 23, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    Safety concerns in Deep Ellum create apprehension as the entertainment district gains visitors – CBS News

    Safety Concerns Surge Amid Deep Ellum’s Booming Popularity and Growing Crowds

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Technology Convergence Report 2025 – The World Economic Forum

    Technology Convergence Report 2025 – The World Economic Forum

    How AI can help make cities work better for residents – MIT Technology Review

    How AI can help make cities work better for residents – MIT Technology Review

    Tech Champions with Leo Bletnitsky of Healthy Technology Solutions – Buzz Media Group

    Meet Tech Champion Leo Bletnitsky of Healthy Technology Solutions

    Crypto’s true revolution is about humanity, not technology – Cointelegraph

    Crypto’s Real Revolution: Transforming Humanity Beyond Technology

    $1 Billion Problem: New Technology Could Save Your Daily Cup of Coffee – SciTechDaily

    The $1 Billion Challenge: How New Technology Could Rescue Your Daily Cup of Coffee

    Canada’s construction industry gets serious about investing in technology as pressure mounts to do more with less – Yahoo Finance

    Canada’s Construction Industry Accelerates Tech Investments to Overcome Growing Challenges and Boost Efficiency

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    Safety concerns in Deep Ellum create apprehension as the entertainment district gains visitors – CBS News

    Safety Concerns Surge Amid Deep Ellum’s Booming Popularity and Growing Crowds

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Technology Convergence Report 2025 – The World Economic Forum

    Technology Convergence Report 2025 – The World Economic Forum

    How AI can help make cities work better for residents – MIT Technology Review

    How AI can help make cities work better for residents – MIT Technology Review

    Tech Champions with Leo Bletnitsky of Healthy Technology Solutions – Buzz Media Group

    Meet Tech Champion Leo Bletnitsky of Healthy Technology Solutions

    Crypto’s true revolution is about humanity, not technology – Cointelegraph

    Crypto’s Real Revolution: Transforming Humanity Beyond Technology

    $1 Billion Problem: New Technology Could Save Your Daily Cup of Coffee – SciTechDaily

    The $1 Billion Challenge: How New Technology Could Rescue Your Daily Cup of Coffee

    Canada’s construction industry gets serious about investing in technology as pressure mounts to do more with less – Yahoo Finance

    Canada’s Construction Industry Accelerates Tech Investments to Overcome Growing Challenges and Boost Efficiency

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Business

Research Scientist Andrei Barbu Gives Us Input On LLM Design

June 9, 2024
in Business
Research Scientist Andrei Barbu Gives Us Input On LLM Design
Share on FacebookShare on Twitter

Today I heard from MIT research scientist Andrei Barbu about working with LLMs, and how to prevent certain kinds of problems related to data leaks.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

“We’re interested in studying language in particular,” he said of his work, turning to some of the goals of research teams in this area.

Thinking about the duality of human and computer cognition, he pointed out some differences. Humans, he said, teach one another, for example. Another thing humans can do is keep secrets. That might be challenging for our digital counterparts.

“There’s a problem with LLMs,” he noted, explaining their potential for leaks. “They can’t keep a secret.”

LLMs are fundamentally insecure

Andrei Barbu

In outlining how to identify the issue, Barbu talked about prompt injection attacks as a prime example. We heard something a little like this from Adam Chipala just prior, where he mentioned verifiable software principles as a potential solution.

Barbu brought up something that I found interesting, though: a kind of catch-22 for systems that are not very good at sealing in data.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

“Models are as sensitive as the most sensitive piece of data put inside that model,” he explained. “People can interrogate the model. … (on the other hand, models are) as weak and vulnerable to attack as the least sensitive piece that you put in.”

People can poison your model, he suggested, in some cases, fairly easily.

The solution: Barbu talked about a customized model, with fine tuning, and how that may work.

Specifically, he was talking about something called low-rank adaptation or LORA, a fine-tuning method pioneered at Microsoft in 2021.

Fine-tuning LORA

Andrei Barbu

When I looked into it, experts cite two things that LORA does in a sort of proprietary way: it tracks changes to weights rather than updating weights directly, and it makes the large matrix of weight changes into smaller matrices to isolate parameters.

In describing some related methods, Barbu talked about extracting what’s needed from a library of components, and explained that there are lots of ways to approach this. Using a Venn diagram, he noted the difference between adaptive and selective types of methods, and others.

Fine-tuning models

Andrei Barbu

You can think, he suggested, about strategies like turning English into SQL to problem-solve and expedite solutions. At the end of the day, though, the challenge remains.

“Security is binary,” he noted. “You succeed or fail.”

Now, this part of the presentation caught my ear: Barbu talked about some kinds of potential AI tools that could end up taking a lot of the labor out of information security. He described a situation where the tools sit on top of a network, looking for sensitive information, and actually provide input.

MIT Research Scientist Andrei Barbu presenting at CSAIL+Imagination in Action AI Summit

John Werner

This, he suggested, could solve some rampant HIPAA problems with leaks of protected health data.

“We just don’t have a good solution to this so far,” he said. But with the right tools, we might!

Another good idea that I heard from his talk was around labeling ‘informed perplexity’ and ‘uninformed perplexity’ to see where a problem lies.

Then, he said, we can also improve the secret-keeping capabilities of our LLMs.

“We can build secure LLMs,” he added, “models that are completely immune to any kind of attack, because we simply don’t connect the parameters that the user should have access to, so there’s literally nothing that they can possibly do…”

Look, there was a lot more in this demo – for example, Barbu talked a good bit about the scenario of keeping data on alien landings in a database – just as an example! So that part was notable, too. You’ll have to delve into the video to really see all of it in detail. But I’m going to keep bringing the highlights from this conference to you, almost in real time!

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Forbes – https://www.forbes.com/sites/johnwerner/2024/06/08/research-scientist-andrei-barbu-gives-us-input-on-llm-design

Tags: businessResearchScientist
Previous Post

To Iprove VAR, Premier League Should Adopt These 3 MLS Practices

Next Post

2 Ways To Bridge The ‘Desire Gap’ In Relationships—By A Psychologist

Top economist who previously sounded the alarm on tariffs sees a possible scenario where Trump ‘outsmarted all of us’ – Fortune

Top Economist Raises Alarming Question: Did Trump Outsmart Everyone on Tariffs?

June 23, 2025
Universal Health Services, Inc.’s (NYSE:UHS) Intrinsic Value Is Potentially 34% Above Its Share Price – Yahoo Finance

Universal Health Services’ True Value Could Be 34% Higher Than Its Current Share Price

June 22, 2025
Millennials taking control in Prince George’s County politics – WTOP

Millennials taking control in Prince George’s County politics – WTOP

June 22, 2025
Technology Convergence Report 2025 – The World Economic Forum

Technology Convergence Report 2025 – The World Economic Forum

June 22, 2025
Kingsley Coman reveals desire to stay at Bayern Munich – Yahoo Sports

Kingsley Coman reveals desire to stay at Bayern Munich – Yahoo Sports

June 22, 2025
What role will Pope Leo XIV play in the future of Laudato Si’ ecological action? – National Catholic Reporter

What role will Pope Leo XIV play in the future of Laudato Si’ ecological action? – National Catholic Reporter

June 22, 2025
Opinion: What if MAGA Has a Point About Science? – Undark Magazine

What If MAGA Is Right About Science?

June 22, 2025
Are We Ready To Redefine the Second? Scientists Just Took a Major Step – SciTechDaily

Are We Ready to Redefine the Second? Scientists Achieve a Groundbreaking Breakthrough

June 22, 2025
What’s your ‘biological age’? And here’s how to lower it… – BreakingNews.ie

What’s your ‘biological age’? And here’s how to lower it… – BreakingNews.ie

June 22, 2025
Club World Cup trophy won’t make up for last season – Guardiola – BBC

Guardiola: Club World Cup Trophy Can’t Erase Last Season’s Disappointment

June 22, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (697)
  • Economy (712)
  • Entertainment (21,611)
  • General (15,514)
  • Health (9,753)
  • Lifestyle (716)
  • News (22,149)
  • People (714)
  • Politics (719)
  • Science (15,930)
  • Sports (21,208)
  • Technology (15,697)
  • World (691)

Recent News

Top economist who previously sounded the alarm on tariffs sees a possible scenario where Trump ‘outsmarted all of us’ – Fortune

Top Economist Raises Alarming Question: Did Trump Outsmart Everyone on Tariffs?

June 23, 2025
Universal Health Services, Inc.’s (NYSE:UHS) Intrinsic Value Is Potentially 34% Above Its Share Price – Yahoo Finance

Universal Health Services’ True Value Could Be 34% Higher Than Its Current Share Price

June 22, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version