* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Saturday, July 19, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Theater at Santa Fe’s San Isidro Plaza will be converted into IMAX, family entertainment venue – Santa Fe New Mexican

    Santa Fe’s San Isidro Plaza Theater Transforms into Exciting IMAX Family Entertainment Venue

    B&B Theatres will open massive entertainment complex in Texas – The Business Journals

    B&B Theatres will open massive entertainment complex in Texas – The Business Journals

    Rough times for broadcast networks illustrate changing media landscape – New Haven Register

    Broadcast Networks Confront Turbulent Times in a Rapidly Changing Media Landscape

    Black River Entertainment Adds Traci Hite As Director Of Promotion, Southeast – MusicRow.com

    Black River Entertainment Welcomes Traci Hite as New Director of Southeast Promotion

    Entertainment Business Master’s Grad Launched Nonprofit to Nurture Emerging Artists – Full Sail University

    Entertainment Business Master’s Grad Launched Nonprofit to Nurture Emerging Artists – Full Sail University

    Review: At the Huntington, the New Hollywood String Quartet recalls legendary studio musicians – Los Angeles Times

    Review: At the Huntington, the New Hollywood String Quartet recalls legendary studio musicians – Los Angeles Times

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    A major AI training data set contains millions of examples of personal data – MIT Technology Review

    A major AI training data set contains millions of examples of personal data – MIT Technology Review

    Simpson College to purchase medical simulation technology with grant funds – Iowa Capital Dispatch

    Simpson College to purchase medical simulation technology with grant funds – Iowa Capital Dispatch

    SailGP Technologies officially launches new center of excellence in technology & innovation – Sail-World.com

    SailGP Technologies officially launches new center of excellence in technology & innovation – Sail-World.com

    Victorville’s new gunfire-detecting technology already making strides, city says – NBC Los Angeles

    Victorville’s New Gunfire-Detecting Technology Is Already Making a Difference, City Officials Say

    Guest columnist: China cutting corners on technology – The State Journal

    China’s Rapid Tech Advances Spark Worries About Cutting Corners

    Sentrycs’ Cyber Over RF technology integrated into Rafael’s combat-proven Drone Dome system – Defence Industry Europe

    Sentrycs’ Cyber Over RF Technology Boosts Rafael’s Battle-Tested Drone Dome System

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Theater at Santa Fe’s San Isidro Plaza will be converted into IMAX, family entertainment venue – Santa Fe New Mexican

    Santa Fe’s San Isidro Plaza Theater Transforms into Exciting IMAX Family Entertainment Venue

    B&B Theatres will open massive entertainment complex in Texas – The Business Journals

    B&B Theatres will open massive entertainment complex in Texas – The Business Journals

    Rough times for broadcast networks illustrate changing media landscape – New Haven Register

    Broadcast Networks Confront Turbulent Times in a Rapidly Changing Media Landscape

    Black River Entertainment Adds Traci Hite As Director Of Promotion, Southeast – MusicRow.com

    Black River Entertainment Welcomes Traci Hite as New Director of Southeast Promotion

    Entertainment Business Master’s Grad Launched Nonprofit to Nurture Emerging Artists – Full Sail University

    Entertainment Business Master’s Grad Launched Nonprofit to Nurture Emerging Artists – Full Sail University

    Review: At the Huntington, the New Hollywood String Quartet recalls legendary studio musicians – Los Angeles Times

    Review: At the Huntington, the New Hollywood String Quartet recalls legendary studio musicians – Los Angeles Times

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    A major AI training data set contains millions of examples of personal data – MIT Technology Review

    A major AI training data set contains millions of examples of personal data – MIT Technology Review

    Simpson College to purchase medical simulation technology with grant funds – Iowa Capital Dispatch

    Simpson College to purchase medical simulation technology with grant funds – Iowa Capital Dispatch

    SailGP Technologies officially launches new center of excellence in technology & innovation – Sail-World.com

    SailGP Technologies officially launches new center of excellence in technology & innovation – Sail-World.com

    Victorville’s new gunfire-detecting technology already making strides, city says – NBC Los Angeles

    Victorville’s New Gunfire-Detecting Technology Is Already Making a Difference, City Officials Say

    Guest columnist: China cutting corners on technology – The State Journal

    China’s Rapid Tech Advances Spark Worries About Cutting Corners

    Sentrycs’ Cyber Over RF technology integrated into Rafael’s combat-proven Drone Dome system – Defence Industry Europe

    Sentrycs’ Cyber Over RF Technology Boosts Rafael’s Battle-Tested Drone Dome System

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

SlowLlama: Finetune llama2-70B and codellama on MacBook Air without quantization

October 6, 2023
in Technology
SlowLlama: Finetune llama2-70B and codellama on MacBook Air without quantization
Share on FacebookShare on Twitter

slowllama

Fine-tune Llama2 and CodeLLama models, including 70B/35B on Apple M1/M2 devices (for example, Macbook Air or Mac Mini) or consumer nVidia GPUs.

slowllama is not using any quantization. Instead, it offloads parts of model to SSD or main memory on both forward/backward passes. In contrast with training large models from scratch (unattainable) or inference, where we are likely to care about interactivity, we can still get something finetuned if you let it run for a while.

Current version is using LoRA to limit the updates to a smaller set of parameters. First version supported full finetuning as well, but I decided to remove it for now, more on that below.

Finetuning is the only focus, there’s nothing special done for inference, consider llama.cpp.

For CUDA-specific experiments, see report on a10.

Example

Tests were done on Apple M1 with 16Gb memory and Apple M2 with 24Gb memory.

In order to fine-tune llama2 model we need to:

Install dependencies: pip install torch sentencepiece numpy. Optional: install pip install fewlines for weight/gradient distribution logging.
Clone llama2 and follow instructions to download the models. The script will download tokenizer as well. tokenizer.model should be put into the same directory as llama model itself. Use codellama for CodeLLama models. Example folder structure could look like:

/parent/
/slowllama/… #
>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Hacker News – https://github.com/okuvshynov/slowllama

Tags: FinetuneSlowLlamatechnology
Previous Post

Up to tenth of Amazon shoppers in GB ‘bribed’ by sellers to offer good review

Next Post

US science agencies on track to hit 25-year funding low

A major AI training data set contains millions of examples of personal data – MIT Technology Review

A major AI training data set contains millions of examples of personal data – MIT Technology Review

July 18, 2025
Dave Portnoy unites FOX Sports and Barstool with new football, basketball coverage deal – Fox News

Dave Portnoy unites FOX Sports and Barstool with new football, basketball coverage deal – Fox News

July 18, 2025
To see and not be seen: Carangids hide behind sharks to prey on fish – Cattano – 2025 – Ecology – ESA Journals

Mastering the Art of Stealth: How Carangids Turn Sharks into Living Shields to Outsmart Their Prey

July 18, 2025
Science labs move ‘a hammer blow’, says MP – Yahoo

Science labs move ‘a hammer blow’, says MP – Yahoo

July 18, 2025
American science to soon face its largest brain drain in history – Big Think

America’s Science Community Confronts Its Biggest Brain Drain in History

July 18, 2025
Longhorns Daily News: Austin’s fast-paced lifestyle helped inspire former Texas WR Brenen Thompson to transfer to new school – Burnt Orange Nation

Longhorns Daily News: Austin’s fast-paced lifestyle helped inspire former Texas WR Brenen Thompson to transfer to new school – Burnt Orange Nation

July 18, 2025
China’s path to world dominance is being laid by President Trump’s policies, including in Alaska – Alaska Beacon

China’s path to world dominance is being laid by President Trump’s policies, including in Alaska – Alaska Beacon

July 18, 2025
Wall Street’s Big 7 Are Now Bigger Than China’s Entire Economy – MSN

Wall Street’s 7 Biggest Titans Now Outpace the Entire Chinese Economy

July 18, 2025
Bad Bunny, Travis Scott, Saweetie, and All the Songs You Need to Know This Week – Yahoo

Bad Bunny, Travis Scott, Saweetie, and This Week’s Must-Listen Hits

July 18, 2025
‘I just couldn’t stop crying’: How prison affects Black men’s mental health long after they’ve been released – The Conversation

I Just Couldn’t Stop Crying’: The Deep and Lasting Impact of Prison on Black Men’s Mental Health

July 18, 2025

Categories

Archives

July 2025
MTWTFSS
 123456
78910111213
14151617181920
21222324252627
28293031 
« Jun    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (727)
  • Economy (750)
  • Entertainment (21,635)
  • General (15,970)
  • Health (9,788)
  • Lifestyle (758)
  • News (22,149)
  • People (752)
  • Politics (760)
  • Science (15,967)
  • Sports (21,248)
  • Technology (15,733)
  • World (734)

Recent News

A major AI training data set contains millions of examples of personal data – MIT Technology Review

A major AI training data set contains millions of examples of personal data – MIT Technology Review

July 18, 2025
Dave Portnoy unites FOX Sports and Barstool with new football, basketball coverage deal – Fox News

Dave Portnoy unites FOX Sports and Barstool with new football, basketball coverage deal – Fox News

July 18, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version