* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Thursday, August 28, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    ‘SNL’ Parts Ways With Emil Wakim Amid Rumored Season 51 Cast Shakeup – yahoo.com

    SNL Shakes Up Season 51 Cast with Emil Wakim’s Surprising Exit

    Do you have a favorable or an unfavorable opinion of Taylor Swift? – YouGov

    Do You Love Taylor Swift or Not? Share Your Thoughts!

    Upload Season 4 Review – yahoo.com

    Upload Season 4 Review: A Thrilling New Chapter Unveiled

    ‘The Roses’ review: Olivia Colman, Benedict Cumberbatch sparkle in dark comedy – Yakima Herald-Republic

    The Roses’ Review: Olivia Colman and Benedict Cumberbatch Shine in Dark Comedy Delight

    ‘When Calls the Heart’ Fans All Want the Same Thing After Seeing the Show’s Latest Update – yahoo.com

    When Calls the Heart’ Fans Rally Together in Excitement Over Exciting New Update!

    Quotes of the Week: Peacemaker, Project Runway, Countdown and More – yahoo.com

    This Week’s Most Memorable Quotes from Peacemaker, Project Runway, Countdown, and More!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    ITSWC 2025: Thursday sessions guide – Traffic Technology Today

    Your Ultimate Guide to Thursday Sessions at ITSWC 2025

    MC Machinery Technology Summit Showcases Manufacturing Innovations – Modern Machine Shop

    MC Machinery Technology Summit Unveils Cutting-Edge Manufacturing Innovations

    US-ROK Technology Cooperation Faces Rising Tensions – The National Interest

    Rising Tensions Put US-South Korea Technology Partnership to the Test

    The Role of AI and Technology in Shaping the Future of Interactive Entertainment – Technology Org

    How AI and Technology Are Transforming the Future of Interactive Entertainment

    Ten upcoming sports stadiums where technology takes to the field – Dezeen

    10 Futuristic Sports Stadiums Revolutionizing the Game with Cutting-Edge Technology

    Figure Technology Solutions, Inc. Files Registration Statement for Proposed Initial Public Offering – Business Wire

    Figure Technology Solutions, Inc. Unveils Exciting Plans for Its Upcoming Initial Public Offering

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    ‘SNL’ Parts Ways With Emil Wakim Amid Rumored Season 51 Cast Shakeup – yahoo.com

    SNL Shakes Up Season 51 Cast with Emil Wakim’s Surprising Exit

    Do you have a favorable or an unfavorable opinion of Taylor Swift? – YouGov

    Do You Love Taylor Swift or Not? Share Your Thoughts!

    Upload Season 4 Review – yahoo.com

    Upload Season 4 Review: A Thrilling New Chapter Unveiled

    ‘The Roses’ review: Olivia Colman, Benedict Cumberbatch sparkle in dark comedy – Yakima Herald-Republic

    The Roses’ Review: Olivia Colman and Benedict Cumberbatch Shine in Dark Comedy Delight

    ‘When Calls the Heart’ Fans All Want the Same Thing After Seeing the Show’s Latest Update – yahoo.com

    When Calls the Heart’ Fans Rally Together in Excitement Over Exciting New Update!

    Quotes of the Week: Peacemaker, Project Runway, Countdown and More – yahoo.com

    This Week’s Most Memorable Quotes from Peacemaker, Project Runway, Countdown, and More!

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    ITSWC 2025: Thursday sessions guide – Traffic Technology Today

    Your Ultimate Guide to Thursday Sessions at ITSWC 2025

    MC Machinery Technology Summit Showcases Manufacturing Innovations – Modern Machine Shop

    MC Machinery Technology Summit Unveils Cutting-Edge Manufacturing Innovations

    US-ROK Technology Cooperation Faces Rising Tensions – The National Interest

    Rising Tensions Put US-South Korea Technology Partnership to the Test

    The Role of AI and Technology in Shaping the Future of Interactive Entertainment – Technology Org

    How AI and Technology Are Transforming the Future of Interactive Entertainment

    Ten upcoming sports stadiums where technology takes to the field – Dezeen

    10 Futuristic Sports Stadiums Revolutionizing the Game with Cutting-Edge Technology

    Figure Technology Solutions, Inc. Files Registration Statement for Proposed Initial Public Offering – Business Wire

    Figure Technology Solutions, Inc. Unveils Exciting Plans for Its Upcoming Initial Public Offering

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Giga ML wants to help companies deploy LLMs offline

December 29, 2023
in Technology
Giga ML wants to help companies deploy LLMs offline
Share on FacebookShare on Twitter

AI is all the rage — particularly text-generating AI, also known as large language models (think models along the lines of ChatGPT). In one recent survey of ~1,000 enterprise organizations, 67.2% say that they see adopting large language models (LLMs) as a top priority by early 2024.

But barriers stand in the way. According to the same survey, a lack of customization and flexibility, paired with the inability to preserve company knowledge and IP, were — and are — preventing many businesses from deploying LLMs into production.

That got Varun Vummadi and Esha Manideep Dinne thinking: What might a solution to the enterprise LLM adoption challenge look like? In search of one, they founded Giga ML, a startup building a platform that lets companies deploy LLMs on-premise — ostensibly cutting costs and preserving privacy in the process.

“Data privacy and customizing LLMs are some of the biggest challenges faced by enterprises when adopting LLMs to solve problems,” Vummadi told TechCrunch in an email interview. “Giga ML addresses both of these challenges.”

Giga ML offers its own set of LLMs, the “X1 series,” for tasks like generating code and answering common customer questions (e.g. “When can I expect my order to arrive?”). The startup claims the models, built atop Meta’s Llama 2, outperform popular LLMs on certain benchmarks, particularly the MT-Bench test set for dialogs. But it’s tough to say how X1 compares qualitatively; this reporter tried Giga ML’s online demo but ran into technical issues. (The app timed out no matter what prompt I typed.)

Even if Giga ML’s models are superior in some aspects, though, can they really make a splash in the ocean of open source, offline LLMs?

In talking to Vummadi, I got the sense that Giga ML isn’t so much trying to create the best-performing LLMs out there but instead building tools to allow businesses to fine-tune LLMs locally without having to rely on third-party resources and platforms.

“Giga ML’s mission is to help enterprises safely and efficiently deploy LLMs on their own on-premises infrastructure or virtual private cloud,” Vummadi said. “Giga ML simplifies the process of training, fine-tuning and running LLMs by taking care of it through an easy-to-use API, eliminating any associated hassle.”

Vummadi emphasized the privacy advantages of running models offline — advantages likely to be persuasive for some businesses.

Predibase, the low-code AI dev platform, found that less than a quarter of enterprises are comfortable using commercial LLMs because of concerns over sharing sensitive or proprietary data with vendors. Nearly 77% of respondents to the survey said that they either don’t use or don’t plan to use commercial LLMs beyond prototypes in production — citing issues relating to privacy, cost and lack of customization.

“IT managers at the C-suite level find Giga ML’s offerings valuable because of the secure on-premise deployment of LLMs, customizable models tailored to their specific use case and fast inference, which ensures data compliance and maximum efficiency,” Vummadi said. 

Giga ML, which has raised ~$3.74 million in VC funding to date from Nexus Venture Partners, Y Combinator, Liquid 2 Ventures, 8vdx and several others, plans in the near term to grow its two-person team and ramp up product R&D. A portion of the capital is going toward supporting Giga ML’s customer base, as well, Vummadi said, which currently includes unnamed “enterprise” companies in finance and healthcare.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : TechCrunch – https://techcrunch.com/2023/12/28/giga-ml-wants-to-help-companies-deploy-llms-offline/

Tags: companiestechnologywants
Previous Post

Australia astounded by the DRS on day four against Pakistan

Next Post

Sanna Marin, the popular former prime minister of Finland, on Putin, powerful women and legislating in the age of AI

Ecological Concerns – The Portugal News

Rising Ecological Concerns Threaten Portugal’s Natural Heritage

August 28, 2025
Scientists warn ocean-based climate fixes lack rules and oversight – Mongabay

Scientists warn ocean-based climate fixes lack rules and oversight – Mongabay

August 28, 2025
Posco student volunteers take science projects abroad – The Korea Herald

Posco Student Volunteers Ignite Curiosity with Science Projects in Communities Abroad

August 28, 2025
Mediterranean diet with lifestyle changes lowers diabetes risk by 31% – News-Medical

Adopting a Mediterranean Diet and Lifestyle Cuts Diabetes Risk by 31%

August 28, 2025
ITSWC 2025: Thursday sessions guide – Traffic Technology Today

Your Ultimate Guide to Thursday Sessions at ITSWC 2025

August 28, 2025
Real Madrid Graduate School Universidad Europea and UNO Launch Dual Degree in Sports Management – University of Nebraska Omaha

Real Madrid Graduate School and UNO Launch Exciting New Dual Degree in Sports Management

August 28, 2025
Hamburg Township baton twirlers capture world championship title in Italy – WXYZ Channel 7

Hamburg Township Baton Twirlers Triumph as World Champions in Italy

August 28, 2025
Diversification helps Minnesota farm navigate ag economy slump – Brownfield Ag News

How Diversification is Powering a Minnesota Farm’s Success During Tough Agricultural Times

August 28, 2025
‘SNL’ Parts Ways With Emil Wakim Amid Rumored Season 51 Cast Shakeup – yahoo.com

SNL Shakes Up Season 51 Cast with Emil Wakim’s Surprising Exit

August 28, 2025
CDC Director Susan Monarez ousted, four other leaders quit health agency – CNBC

Top Health Officials Resign Amid Controversy as CDC Director Susan Monarez Is Ousted

August 28, 2025

Categories

Archives

August 2025
MTWTFSS
 123
45678910
11121314151617
18192021222324
25262728293031
« Jul    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (794)
  • Economy (813)
  • Entertainment (21,692)
  • General (16,717)
  • Health (9,854)
  • Lifestyle (827)
  • News (22,149)
  • People (814)
  • Politics (821)
  • Science (16,023)
  • Sports (21,312)
  • Technology (15,794)
  • World (795)

Recent News

Ecological Concerns – The Portugal News

Rising Ecological Concerns Threaten Portugal’s Natural Heritage

August 28, 2025
Scientists warn ocean-based climate fixes lack rules and oversight – Mongabay

Scientists warn ocean-based climate fixes lack rules and oversight – Mongabay

August 28, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version