* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Saturday, May 10, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    The Weeknd made the apocalypse sexy at his 2025 tour launch in Arizona – Yahoo

    The Weeknd Turns Up the Heat at His 2025 Tour Launch in Arizona!

    Flutter Entertainment eyes U.S. prediction markets amid growing interest – Sports Business Journal

    Flutter Entertainment Sets Its Sights on U.S. Prediction Markets as Interest Soars

    SXSW Rom-Com ‘I Really Love My Husband’ Acquired for U.S. Release – Variety

    Heartfelt Romance: ‘I Really Love My Husband’ Set to Captivate U.S. Audiences!

    Georgia Entertainment CEO says large-scale production is slowing down – Decaturish

    Georgia Entertainment CEO Warns of Slowdown in Large-Scale Productions

    Zugalu Entertainment Welcomes Crimson Herring Studios to Its Family!

    Fall 2025 TV Schedule: Your Guide to the Complete Lineup – Wyoming News Now

    Get Ready for Fall 2025: Your Ultimate Guide to the Exciting TV Lineup!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Comings and goings: MPT hires VP of technology, NPR announces changes to Business Desk – Current – For people in public media

    Exciting Leadership Changes: MPT Welcomes New VP of Technology and NPR Revamps Business Desk!

    Harnessing emerging technologies to power a small business – The Oaklandside

    Unlocking Success: How Emerging Technologies Can Transform Your Small Business

    Artificial intelligence (AI) – The Guardian

    Unlocking the Future: How Artificial Intelligence is Transforming Our World

    Technology Innovation to Take Center Stage at The 2025 National Restaurant Association Show – Restaurant Technology News

    Get Ready for a Tech Revolution: The 2025 National Restaurant Association Show Unveils Cutting-Edge Innovations!

    Newmont signs deal to use Chrysos Corporation technology – Capital Brief

    Newmont Partners with Chrysos Corporation to Revolutionize Mining Technology

    Air Force Invests in Whisper’s Ultraquiet Propulsion Technology – FLYING Magazine

    Air Force Invests in Whisper’s Ultraquiet Propulsion Technology – FLYING Magazine

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    The Weeknd made the apocalypse sexy at his 2025 tour launch in Arizona – Yahoo

    The Weeknd Turns Up the Heat at His 2025 Tour Launch in Arizona!

    Flutter Entertainment eyes U.S. prediction markets amid growing interest – Sports Business Journal

    Flutter Entertainment Sets Its Sights on U.S. Prediction Markets as Interest Soars

    SXSW Rom-Com ‘I Really Love My Husband’ Acquired for U.S. Release – Variety

    Heartfelt Romance: ‘I Really Love My Husband’ Set to Captivate U.S. Audiences!

    Georgia Entertainment CEO says large-scale production is slowing down – Decaturish

    Georgia Entertainment CEO Warns of Slowdown in Large-Scale Productions

    Zugalu Entertainment Welcomes Crimson Herring Studios to Its Family!

    Fall 2025 TV Schedule: Your Guide to the Complete Lineup – Wyoming News Now

    Get Ready for Fall 2025: Your Ultimate Guide to the Exciting TV Lineup!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Comings and goings: MPT hires VP of technology, NPR announces changes to Business Desk – Current – For people in public media

    Exciting Leadership Changes: MPT Welcomes New VP of Technology and NPR Revamps Business Desk!

    Harnessing emerging technologies to power a small business – The Oaklandside

    Unlocking Success: How Emerging Technologies Can Transform Your Small Business

    Artificial intelligence (AI) – The Guardian

    Unlocking the Future: How Artificial Intelligence is Transforming Our World

    Technology Innovation to Take Center Stage at The 2025 National Restaurant Association Show – Restaurant Technology News

    Get Ready for a Tech Revolution: The 2025 National Restaurant Association Show Unveils Cutting-Edge Innovations!

    Newmont signs deal to use Chrysos Corporation technology – Capital Brief

    Newmont Partners with Chrysos Corporation to Revolutionize Mining Technology

    Air Force Invests in Whisper’s Ultraquiet Propulsion Technology – FLYING Magazine

    Air Force Invests in Whisper’s Ultraquiet Propulsion Technology – FLYING Magazine

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Training /= chatting: ChatGPT and other LLMs don’t remember everything you say

May 29, 2024
in Technology
Share on FacebookShare on Twitter

29th May 2024

I’m beginning to suspect that one of the most common misconceptions about LLMs such as ChatGPT involves how “training” works.

A common complaint I see about these tools is that people don’t want to even try them out because they don’t want to contribute to their training data.

This is by no means an irrational position to take, but it does often correspond to an incorrect mental model about how these tools work.

Short version: ChatGPT and other similar tools do not directly learn from and memorize everything that you say to them.

This can be quite unintuitive: these tools imitate a human conversational partner, and humans constantly update their knowledge based on what you say to to them. Computers have much better memory than humans, so surely ChatGPT would remember every detail of everything you ever say to it. Isn’t that what “training” means?

That’s not how these tools work.

LLMs are stateless functions

From a computer science point of view, it’s best to think of LLMs as stateless function calls. Given this input text, what should come next?

In the case of a “conversation” with a chatbot such as ChatGPT or Claude or Google Gemini, that function input consists of the current conversation (everything said by both the human and the bot) up to that point, plus the user’s new prompt.

Every time you start a new chat conversation, you clear the slate. Each conversation is an entirely new sequence, carried out entirely independently of previous conversations from both yourself and other users.

Understanding this is key to working effectively with these models. Every time you hit “new chat” you are effectively wiping the short-term memory of the model, starting again from scratch.

This has a number of important consequences:

There is no point at all in “telling” a model something in order to improve its knowledge for future conversations. I’ve heard from people who have invested weeks of effort pasting new information into ChatGPT sessions to try and “train” a better bot. That’s a waste of time!
Understanding this helps explain why the “context length” of a model is so important. Different LLMs have different context lengths, expressed in terms of “tokens”—a token is about 3/4s of a word. This is the number that tells you how much of a conversation the bot can consider at any one time. If your conversation goes past this point the model will “forget” details that occurred at the beginning of the conversation.
Sometimes it’s a good idea to start a fresh conversation in order to deliberately reset the model. If a model starts making obvious mistakes, or refuses to respond to a valid question for some weird reason that reset might get it back on the right track.
Tricks like Retrieval Augmented Generation and ChatGPT’s “memory” make sense only once you understand this fundamental limitation to how these models work.
If you’re excited about local models because you can be certain there’s no way they can train on your data, you’re mostly right: you can run them offline and audit your network traffic to be absolutely sure your data isn’t being uploaded to a server somewhere. But…
… if you’re excited about local models because you want something on your computer that you can chat to and it will learn from you and then better respond to your future prompts, that’s probably not going to work.

So what is “training” then?

When we talk about model training, we are talking about the process that was used to build these models in the first place.

As a big simplification, there are two phases to this. The first is to pile in several TBs of text—think all of Wikipedia, a scrape of a large portion of the web, books, newspapers, academic papers and more—and spend months of time and potentially millions of dollars in electricity crunching through that “pre-training” data identifying patterns in how the words relate to each other.

This gives you a model that can complete sentences, but not necessarily in a way that will delight and impress a human conversational partner. The second phase aims to fix that—this can incorporate instruction tuning or Reinforcement Learning from Human Feedback (RLHF) which has the goal of teaching the model to pick the best possible sequences of words to have productive conversations.

The end result of these phases is the model itself—an enormous (many GB) blob of floating point numbers that capture both the statistical relationships between the words and some version of “taste” in terms of how best to assemble new words to reply to a user’s prompts.

Once trained, the model remains static and unchanged—sometimes for months or even years.

Here’s a note from Jason D. Clinton, an engineer who works on Claude 3 at Anthropic:

The model is stored in a static file and loaded, continuously, across 10s of thousands of identical servers each of which serve each instance of the Claude model. The model file never changes and is immutable once loaded; every shard is loading the same model file running exactly the same software.

These models don’t change very often!

Reasons to worry anyway

A frustrating thing about this issue is that it isn’t actually possible to confidently state “don’t worry, ChatGPT doesn’t train on your input”.

Many LLM providers have terms and conditions that allow them to improve their models based on the way you are using them. Even when they have opt-out mechanisms these are often opted-in by default.

When OpenAI say “We may use Content to provide, maintain, develop, and improve our Services” it’s not at all clear what they mean by that!

Are they storing up everything anyone says to their models and dumping that into the training run for their next model versions every few months?

I don’t think it’s that simple: LLM providers don’t want random low-quality text or privacy-invading details making it into their training data. But they are notoriously secretive, so who knows for sure?

The opt-out mechanisms are also pretty confusing. OpenAI try to make it as clear as possible that they won’t train on any content submitted through their API (so you had better understand what an “API” is), but lots of people don’t believe them! I wrote about the AI trust crisis last year: the pattern where many people actively disbelieve model vendors and application developers (such as Dropbox and Slack) that claim they don’t train models on private data.

People also worry that those terms might change in the future. There are options to protect against that: if you’re spending enough money you can sign contracts with OpenAI and other vendors that freeze the terms and conditions.

If your mental model is that LLMs remember and train on all input, it’s much easier to assume that developers who claim they’ve disabled that ability may not be telling the truth. If you tell your human friend to disregard a juicy piece of gossip you’ve mistakenly passed on to them you know full well that they’re not going to forget it!

The other major concern is the same as with any cloud service: it’s reasonable to assume that your prompts are still logged for a period of time, for compliance and abuse reasons, and if that data is logged there’s always a chance of exposure thanks to an accidental security breach.

What about “memory” features?

To make things even more confusing, some LLM tools are introducing features that attempt to work around this limitation.

ChatGPT recently added a memory feature where it can “remember” small details and use them in follow-up conversations.

As with so many LLM features this is a relatively simple prompting trick: during a conversation the bot can call a mechanism to record a short note—your name, is a preference you have expressed—which will then be invisibly included in the chat context passed in future conversations.

You can review (and modify) the list of remembered fragments at any time, and ChatGPT shows a visible UI element any time it adds to its memory.

Bad policy based on bad mental models

One of the most worrying results of this common misconception concerns people who make policy decisions for how LLM tools should be used.

Does your company ban all use of LLMs because they don’t want their private data leaked to the model providers?

They’re not 100% wrong—see reasons to worry anyway—but if they are acting based on the idea that everything said to a model is instantly memorized and could be used in responses to other users they’re acting on faulty information.

Even more concerning is what happens with lawmakers. How many politicians around the world are debating and voting on legislation involving these models based on a science fiction idea of what they are and how they work?

If people believe ChatGPT is a machine that instantly memorizes and learns from everything anyone says to it there is a very real risk they will support measures that address invented as opposed to genuine risks involving this technology.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Hacker News – https://simonwillison.net/2024/May/29/training-not-chatting/

Tags: chattingtechnologytraining
Previous Post

Three.js Shading Language

Next Post

ProjectPro (YC IK12) Is Hiring

Coupling coordination development of water resources-economy-ecology system in Shanxi Province based on system dynamics – Nature

Coupling coordination development of water resources-economy-ecology system in Shanxi Province based on system dynamics – Nature

May 10, 2025
Yolk’s on you – eggs break less when they land sideways – theregister.com

Egg-cellent Discovery: Why Eggs Break Less When They Land on Their Side!

May 10, 2025
How Science and Culture Are Under Attack—and What We Can Do About It – Greater Good: The Science of a Meaningful Life

Defending Science and Culture: Strategies for a Resilient Future

May 10, 2025
Lifestyle choices can help keep memory exercised, functioning – St. Louis Jewish Light

Boost Your Memory: How Lifestyle Choices Can Enhance Brain Function!

May 10, 2025
2025 IIHF Men’s World Championship Preview – NHL.com

Get Ready for the Thrills: A Sneak Peek at the 2025 IIHF Men’s World Championship!

May 10, 2025
Germany’s new economy boss has a plan — and it starts with risk, speed and big bets – CNBC

Germany’s New Economy Chief Unveils Bold Strategy: Embracing Risk, Speed, and Ambitious Investments!

May 10, 2025
The Weeknd made the apocalypse sexy at his 2025 tour launch in Arizona – Yahoo

The Weeknd Turns Up the Heat at His 2025 Tour Launch in Arizona!

May 10, 2025
‘Alias’ Actor Is Unrecognizable After Unexpected Health Diagnosis – parade.com

Shocking Transformation: ‘Alias’ Actor Unrecognizable After Surprising Health Diagnosis!

May 10, 2025
Opinion | The Politics of Medicaid Reform – WSJ

Navigating the Complex Landscape of Medicaid Reform: A Critical Perspective

May 10, 2025
Comings and goings: MPT hires VP of technology, NPR announces changes to Business Desk – Current – For people in public media

Exciting Leadership Changes: MPT Welcomes New VP of Technology and NPR Revamps Business Desk!

May 10, 2025

Categories

Archives

May 2025
MTWTFSS
 1234
567891011
12131415161718
19202122232425
262728293031 
« Apr    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (598)
  • Economy (609)
  • Entertainment (21,522)
  • General (15,210)
  • Health (9,651)
  • Lifestyle (614)
  • News (22,149)
  • People (612)
  • Politics (616)
  • Science (15,831)
  • Sports (21,119)
  • Technology (15,599)
  • World (599)

Recent News

Coupling coordination development of water resources-economy-ecology system in Shanxi Province based on system dynamics – Nature

Coupling coordination development of water resources-economy-ecology system in Shanxi Province based on system dynamics – Nature

May 10, 2025
Yolk’s on you – eggs break less when they land sideways – theregister.com

Egg-cellent Discovery: Why Eggs Break Less When They Land on Their Side!

May 10, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version