* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Friday, June 6, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    9 things to do this weekend in Lake County plus a look ahead – Leesburg Daily Commercial

    Discover 9 Exciting Weekend Adventures in Lake County and What’s Coming Up!

    Shows to Watch – The Advocate

    Must-See Shows You Can’t Miss!

    Fox News Entertainment Newsletter: Celebrities mentioned during Diddy’s high-profile sex trafficking trial – Fox News

    Fox News Entertainment Newsletter: Celebrities mentioned during Diddy’s high-profile sex trafficking trial – Fox News

    ‘Sinners,’ starring Michael B. Jordan, is now streaming on Prime Video – About Amazon

    Experience the Thrills of ‘Sinners’ Starring Michael B. Jordan – Now Streaming on Prime Video!

    California Mid-State Fair announces entertainment lineups for Frontier and Mission stages – KSBY News

    Exciting Entertainment Lineup Unveiled for California Mid-State Fair’s Frontier and Mission Stages!

    Spotify & OpenAI: Will Gen AI ‘Hollow Out’ Entertainment? – Technology Magazine

    Will Generative AI Transform the Future of Entertainment

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Property Technology Magazine Unveils “PropTech Top 50 Index” and the “2025 PropTech Trends Report – The Great Rebuild.” – Business Wire

    Property Technology Magazine Unveils “PropTech Top 50 Index” and the “2025 PropTech Trends Report – The Great Rebuild.” – Business Wire

    Micron Technology (NASDAQ:MU) Stock Price Expected to Rise, UBS Group Analyst Says – MarketBeat

    UBS Analyst Predicts Surge in Micron Technology Stock Price!

    Domo to Participate in the D.A. Davidson Technology Summit – Business Wire

    Domo Set to Shine at the D.A. Davidson Technology Summit!

    When fiction becomes fact: 3 pieces of modern technology inspired by Star Trek – Redshirts Always Die

    From Screen to Reality: 3 Modern Technologies Inspired by Star Trek

    The Isfahan Center for Nuclear Technology – UCF, ZPP, and IRR10 – Alma Research and Education Center

    Exploring the Isfahan Center for Nuclear Technology: Innovations and Insights from UCF, ZPP, and IRR10

    Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

    Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    9 things to do this weekend in Lake County plus a look ahead – Leesburg Daily Commercial

    Discover 9 Exciting Weekend Adventures in Lake County and What’s Coming Up!

    Shows to Watch – The Advocate

    Must-See Shows You Can’t Miss!

    Fox News Entertainment Newsletter: Celebrities mentioned during Diddy’s high-profile sex trafficking trial – Fox News

    Fox News Entertainment Newsletter: Celebrities mentioned during Diddy’s high-profile sex trafficking trial – Fox News

    ‘Sinners,’ starring Michael B. Jordan, is now streaming on Prime Video – About Amazon

    Experience the Thrills of ‘Sinners’ Starring Michael B. Jordan – Now Streaming on Prime Video!

    California Mid-State Fair announces entertainment lineups for Frontier and Mission stages – KSBY News

    Exciting Entertainment Lineup Unveiled for California Mid-State Fair’s Frontier and Mission Stages!

    Spotify & OpenAI: Will Gen AI ‘Hollow Out’ Entertainment? – Technology Magazine

    Will Generative AI Transform the Future of Entertainment

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Property Technology Magazine Unveils “PropTech Top 50 Index” and the “2025 PropTech Trends Report – The Great Rebuild.” – Business Wire

    Property Technology Magazine Unveils “PropTech Top 50 Index” and the “2025 PropTech Trends Report – The Great Rebuild.” – Business Wire

    Micron Technology (NASDAQ:MU) Stock Price Expected to Rise, UBS Group Analyst Says – MarketBeat

    UBS Analyst Predicts Surge in Micron Technology Stock Price!

    Domo to Participate in the D.A. Davidson Technology Summit – Business Wire

    Domo Set to Shine at the D.A. Davidson Technology Summit!

    When fiction becomes fact: 3 pieces of modern technology inspired by Star Trek – Redshirts Always Die

    From Screen to Reality: 3 Modern Technologies Inspired by Star Trek

    The Isfahan Center for Nuclear Technology – UCF, ZPP, and IRR10 – Alma Research and Education Center

    Exploring the Isfahan Center for Nuclear Technology: Innovations and Insights from UCF, ZPP, and IRR10

    Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

    Inside the tedious effort to tally AI’s energy appetite – MIT Technology Review

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Business

Storage: The unsung hero of AI deployments

July 11, 2024
in Business
Storage: The unsung hero of AI deployments
Share on FacebookShare on Twitter

Many enterprises focus on computing power and networking when rolling out AI projects. But they may be overlooking the bigger picture of their needs for massive storage.

As enterprises begin to deploy and use AI, many realize they’ll need access to massive computing power and fast networking capabilities, but storage needs may be overlooked.

Spinning up a chatbot or adopting an AI assistant aren’t likely to tax most enterprises’ storage capacities, but large AI projects with access to millions of data points may require many terabytes of new storage, potentially costing tens of millions of dollars, some AI and storage experts say.

A handful of storage options exist, and for some AI functions, cloud storage or traditional hard drives may be adequate, says Jeffrey Necciai, CTO of Duos Technologies, which uses AI with imaging to inspect railroad cars in motion.

But for AI systems that need to provide instantaneous responses or information, HDs and cloud storage that sits hundreds of miles away from the location of the AI workloads may be too slow, Necciai and other experts say.

For example, Duos Technologies provides notice on rail cars within 60 seconds of the car being scanned, Necciai says. In that case, Duos needs super-fast storage that works alongside its AI computing units.

“If you have a broken wheel, you want to know right now,” he says. “We don’t necessarily process anything in the cloud, because obviously, we don’t want the latency. We need to get that information out as quickly as possible.”

Not just the size of the drive

Enterprises considering large AI projects need to consider both the amount of storage they need and the ability of their storage to handle multiple tasks at the same time, Necciai says.

“We need to write to the storage rapidly at the same time for multiple threads, and we need to read from the story storage rapidly for multiple threads,” he adds. “It’s that ability to do things simultaneously to that storage that was so important to us.”

Last year, Duos scanned 8.5 million rail cars, with each scan potentially generating more than 1,050 images. The Duos Railcar Inspection Portal uses four high-performance storage arrays, each containing 16 NVMe drives, for a total capacity of about 500 terabytes.

The company also uses about 25 terabytes of more traditional storage for training and developing its AI in house, with less need for instantaneous results. “We want to leverage all of it to do what we need to do,” Necciai says. “It really comes down to using the right tool for the right job.”

Intense data needs  

Like Duos, some other enterprises running huge AI projects are turning to high-capacity SSDs or NAND flash memory for their storage needs.

High-speed memory options are significantly more expensive than HDs, costing up to $1,000 per gigabyte, but they provide other advantages. For example, they can be nearly three times more power efficient and take less space than racks of servers and hard drives, says Roger Corell, senior director of leadership marketing at enterprise SSD maker Solidigm.

As enterprises adopt more complex, multimodal AI projects, and more employees begin to use AI tools, the demand for high-capacity, multi-thread storage options will only increase, he says.

“AI is so intense in terms of the amount of data that needs to be stored, and how rapidly these massive data sets need to be accessed,” Corell adds.

Furthermore, in addition to SSD or NAND options, some companies are using private clouds or co-location facilities for their storage needs, says Ugur Tigli, CTO at MinIO, an object store for AI and ML projects.

MinIO clients adopting AI are typically increasing their storage capacity by four to 10 times, he says, and he encourages large-scale AI users to look beyond the public cloud for their storage needs because the cost to use the private cloud or co-location services can be 60% lower than the public cloud.

“At the scale of hundreds of petabytes or an exabyte or two, the economics don’t work in the public cloud,” he says. “The overall cost would be in the tens to hundreds of millions of dollars per year depending on capacity, tiering, and data access profiles.”

Instead of the public cloud, enterprise users can build privately and “burst” to the cloud for additional GPU use, Tigli adds. “The key here is that compute is elastic but data has gravity and is growing at a predictable — albeit accelerated — rate, so it needs to be architected accordingly,” he says.

Storage as a platform

Another option involves petabyte-scale storage platforms, adds Priyanka Karan, field CTO at digital transformation firm AHEAD. Petabyte-scale storage platforms “aim to reduce the data movement challenges of bringing data from where it initially landed to places where it can be leveraged for AI training,” she says. “The goal is not to create a new storage silo.”

Some storage platforms available are built on NAND flash, which offers high throughput and low latency, essential for feeding data to GPUs and TPUs, she says.

With several options out there, some AI users and experts say the amount and kind of storage needed depends on the AI project an organization is deploying.

Offline batch processing has lower memory requirements than real-time workloads, Karan says. In some cases, secondary storage options can be used to hold vast amounts of data needed for training and running AI models, she adds.

Choosing the right storage option also depends on the often-mentioned data gravity — the size of the data set, whether it can be moved to the cloud for processing, or whether it makes sense to bring the processing to the data. In some AI projects, the data storage is co-located in a data center with the AI compute, in another public cloud, or at the edge where the data is created.

Enterprises have many other factors to consider, including security, and regulatory or compliance challenges. With cloud storage, “networking, distance, and latency are factors here, but they must consider the added cost variable,” Karan says.

In addition, beyond the cost of storage itself, there may be data transfer fees, access fees, and management fees for off-premises storage. On the other hand, on-premises storage options can involve huge upfront investments, as well as maintenance, power and cooling, and staff salaries.

“Organizations must evaluate their specific needs, including performance, cost, and scalability, to choose the best solution for their AI initiatives,” Karan says.

SUBSCRIBE TO OUR NEWSLETTER

From our editors straight to your inbox

Get started by entering your email address below.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : CIO – https://www.cio.com/article/2511331/storage-the-unsung-hero-of-ai-deployments.html

Tags: businessstorageUnsung
Previous Post

How top IT leaders create first-mover advantage

Next Post

Accuracy concerns slow manufacturers’ Gen AI adoption

Ecological Restoration Service Market to Reach USD 87.9 Bn by 2031, Growing at 9.4% CAGR – openPR.com

Ecological Restoration Service Market Set to Soar to $87.9 Billion by 2031 with a Robust 9.4% Growth Rate!

June 6, 2025
Boise State moves forward with plans for new science building, signaling an investment in STEM majors – The Arbiter | Boise State

Boise State Unveils Ambitious Plans for Cutting-Edge Science Building, Boosting STEM Education!

June 6, 2025
The Science Of De-Extinction Is Providing Hope For Nature’s Future – Forbes

Reviving the Past: How De-Extinction Science Offers New Hope for Our Planet’s Future

June 6, 2025
Cardi B Slams Offset For Allegedly Not Helping With Kids’ Six-Figure Lifestyle – HOT 97

Cardi B Calls Out Offset for Failing to Support Their Kids’ Luxurious Lifestyle!

June 6, 2025
Hollywood legend Tom Cruise becomes record holder for his fiery Mission Impossible stunt – Guinness World Records

Tom Cruise Sets the Bar High with Record-Breaking Fiery Stunt in Mission Impossible!

June 6, 2025
India could become third largest economy in the world this year: Borge Brende – MSN

India Poised to Become the World’s Third Largest Economy This Year!

June 6, 2025
9 things to do this weekend in Lake County plus a look ahead – Leesburg Daily Commercial

Discover 9 Exciting Weekend Adventures in Lake County and What’s Coming Up!

June 6, 2025
Property Technology Magazine Unveils “PropTech Top 50 Index” and the “2025 PropTech Trends Report – The Great Rebuild.” – Business Wire

Property Technology Magazine Unveils “PropTech Top 50 Index” and the “2025 PropTech Trends Report – The Great Rebuild.” – Business Wire

June 6, 2025
Graphics: China’s ecological, environmental quality keeps improving steadily – news.cgtn.com

Graphics: China’s ecological, environmental quality keeps improving steadily – news.cgtn.com

June 5, 2025
The Forgotten History (and Slippery Science) of Canola Oil – Eater

The Forgotten History (and Slippery Science) of Canola Oil – Eater

June 5, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (670)
  • Economy (684)
  • Entertainment (21,590)
  • General (15,267)
  • Health (9,725)
  • Lifestyle (687)
  • News (22,149)
  • People (685)
  • Politics (691)
  • Science (15,902)
  • Sports (21,187)
  • Technology (15,669)
  • World (669)

Recent News

Ecological Restoration Service Market to Reach USD 87.9 Bn by 2031, Growing at 9.4% CAGR – openPR.com

Ecological Restoration Service Market Set to Soar to $87.9 Billion by 2031 with a Robust 9.4% Growth Rate!

June 6, 2025
Boise State moves forward with plans for new science building, signaling an investment in STEM majors – The Arbiter | Boise State

Boise State Unveils Ambitious Plans for Cutting-Edge Science Building, Boosting STEM Education!

June 6, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version