* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Wednesday, July 9, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Monumental Sports & Entertainment’s Samantha Brady on the Power of the RSN’s Direct-to-Consumer Streaming Service Monumental+ – Sports Video Group

    Samantha Brady Reveals How Monumental+ is Transforming Sports Streaming with Direct-to-Consumer Access

    Moses Singer Welcomes Entertainment and Intellectual Property Partner Frederick Bimbler – Yahoo Finance

    Moses Singer Expands Team with New Entertainment and Intellectual Property Partner Frederick Bimbler

    Longhua District and Max-Matching Entertainments, supported by RWS Global forge strategic partnership to develop international IP-themed entertainment complex – Amusement Today

    Longhua District and Max-Matching Entertainments, supported by RWS Global forge strategic partnership to develop international IP-themed entertainment complex – Amusement Today

    Government whip to withdraw Entertainment Complex Bill on July 9 – Nation Thailand

    Government whip to withdraw Entertainment Complex Bill on July 9 – Nation Thailand

    Magicians and Battlebots light up Las Vegas entertainment scene – KSNV

    Magicians and Battlebots Take Las Vegas Entertainment by Storm

    Max-Matching Entertainments & Longhua District form partnership for new entertainment complex – Blooloop

    Max-Matching Entertainments and Longhua District Unite to Launch Thrilling New Entertainment Complex

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Kaseya Extends Community Investment with Addition of Technology Marketing Toolkit – Kaseya

    Kaseya Extends Community Investment with Addition of Technology Marketing Toolkit – Kaseya

    AI and the Trust Revolution: How Technology Is Transforming Human Connections – Foreign Affairs

    AI and the Trust Revolution: How Technology Is Transforming Human Connections – Foreign Affairs

    Technology And Construction Names Join Top Stock Lists: Check Out Additions To IBD 50, Big Cap 20 And More – Investor’s Business Daily

    Technology and Construction Leaders Surge Into Top Stock Rankings: See the Latest Additions to IBD 50, Big Cap 20, and More

    Column: Teach kupuna new technology skills – Honolulu Star-Advertiser

    Empowering Kupuna: Unlocking New Technology Skills for a Connected Future

    EIFO invests $5 million in D3, the Ukraine-focused defence technology venture fund – sUAS News

    EIFO Pledges $5 Million to Supercharge Ukraine-Focused Defense Technology Fund

    New Technology for Water Efficiency and Working with Mexico on Screwworm – AG INFORMATION NETWORK OF THE WEST

    Revolutionary Water Efficiency Technology and Cross-Border Collaboration to Defeat Screwworm

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Monumental Sports & Entertainment’s Samantha Brady on the Power of the RSN’s Direct-to-Consumer Streaming Service Monumental+ – Sports Video Group

    Samantha Brady Reveals How Monumental+ is Transforming Sports Streaming with Direct-to-Consumer Access

    Moses Singer Welcomes Entertainment and Intellectual Property Partner Frederick Bimbler – Yahoo Finance

    Moses Singer Expands Team with New Entertainment and Intellectual Property Partner Frederick Bimbler

    Longhua District and Max-Matching Entertainments, supported by RWS Global forge strategic partnership to develop international IP-themed entertainment complex – Amusement Today

    Longhua District and Max-Matching Entertainments, supported by RWS Global forge strategic partnership to develop international IP-themed entertainment complex – Amusement Today

    Government whip to withdraw Entertainment Complex Bill on July 9 – Nation Thailand

    Government whip to withdraw Entertainment Complex Bill on July 9 – Nation Thailand

    Magicians and Battlebots light up Las Vegas entertainment scene – KSNV

    Magicians and Battlebots Take Las Vegas Entertainment by Storm

    Max-Matching Entertainments & Longhua District form partnership for new entertainment complex – Blooloop

    Max-Matching Entertainments and Longhua District Unite to Launch Thrilling New Entertainment Complex

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Kaseya Extends Community Investment with Addition of Technology Marketing Toolkit – Kaseya

    Kaseya Extends Community Investment with Addition of Technology Marketing Toolkit – Kaseya

    AI and the Trust Revolution: How Technology Is Transforming Human Connections – Foreign Affairs

    AI and the Trust Revolution: How Technology Is Transforming Human Connections – Foreign Affairs

    Technology And Construction Names Join Top Stock Lists: Check Out Additions To IBD 50, Big Cap 20 And More – Investor’s Business Daily

    Technology and Construction Leaders Surge Into Top Stock Rankings: See the Latest Additions to IBD 50, Big Cap 20, and More

    Column: Teach kupuna new technology skills – Honolulu Star-Advertiser

    Empowering Kupuna: Unlocking New Technology Skills for a Connected Future

    EIFO invests $5 million in D3, the Ukraine-focused defence technology venture fund – sUAS News

    EIFO Pledges $5 Million to Supercharge Ukraine-Focused Defense Technology Fund

    New Technology for Water Efficiency and Working with Mexico on Screwworm – AG INFORMATION NETWORK OF THE WEST

    Revolutionary Water Efficiency Technology and Cross-Border Collaboration to Defeat Screwworm

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Business

Storage: The unsung hero of AI deployments

July 11, 2024
in Business
Storage: The unsung hero of AI deployments
Share on FacebookShare on Twitter

Many enterprises focus on computing power and networking when rolling out AI projects. But they may be overlooking the bigger picture of their needs for massive storage.

As enterprises begin to deploy and use AI, many realize they’ll need access to massive computing power and fast networking capabilities, but storage needs may be overlooked.

Spinning up a chatbot or adopting an AI assistant aren’t likely to tax most enterprises’ storage capacities, but large AI projects with access to millions of data points may require many terabytes of new storage, potentially costing tens of millions of dollars, some AI and storage experts say.

A handful of storage options exist, and for some AI functions, cloud storage or traditional hard drives may be adequate, says Jeffrey Necciai, CTO of Duos Technologies, which uses AI with imaging to inspect railroad cars in motion.

But for AI systems that need to provide instantaneous responses or information, HDs and cloud storage that sits hundreds of miles away from the location of the AI workloads may be too slow, Necciai and other experts say.

For example, Duos Technologies provides notice on rail cars within 60 seconds of the car being scanned, Necciai says. In that case, Duos needs super-fast storage that works alongside its AI computing units.

“If you have a broken wheel, you want to know right now,” he says. “We don’t necessarily process anything in the cloud, because obviously, we don’t want the latency. We need to get that information out as quickly as possible.”

Not just the size of the drive

Enterprises considering large AI projects need to consider both the amount of storage they need and the ability of their storage to handle multiple tasks at the same time, Necciai says.

“We need to write to the storage rapidly at the same time for multiple threads, and we need to read from the story storage rapidly for multiple threads,” he adds. “It’s that ability to do things simultaneously to that storage that was so important to us.”

Last year, Duos scanned 8.5 million rail cars, with each scan potentially generating more than 1,050 images. The Duos Railcar Inspection Portal uses four high-performance storage arrays, each containing 16 NVMe drives, for a total capacity of about 500 terabytes.

The company also uses about 25 terabytes of more traditional storage for training and developing its AI in house, with less need for instantaneous results. “We want to leverage all of it to do what we need to do,” Necciai says. “It really comes down to using the right tool for the right job.”

Intense data needs  

Like Duos, some other enterprises running huge AI projects are turning to high-capacity SSDs or NAND flash memory for their storage needs.

High-speed memory options are significantly more expensive than HDs, costing up to $1,000 per gigabyte, but they provide other advantages. For example, they can be nearly three times more power efficient and take less space than racks of servers and hard drives, says Roger Corell, senior director of leadership marketing at enterprise SSD maker Solidigm.

As enterprises adopt more complex, multimodal AI projects, and more employees begin to use AI tools, the demand for high-capacity, multi-thread storage options will only increase, he says.

“AI is so intense in terms of the amount of data that needs to be stored, and how rapidly these massive data sets need to be accessed,” Corell adds.

Furthermore, in addition to SSD or NAND options, some companies are using private clouds or co-location facilities for their storage needs, says Ugur Tigli, CTO at MinIO, an object store for AI and ML projects.

MinIO clients adopting AI are typically increasing their storage capacity by four to 10 times, he says, and he encourages large-scale AI users to look beyond the public cloud for their storage needs because the cost to use the private cloud or co-location services can be 60% lower than the public cloud.

“At the scale of hundreds of petabytes or an exabyte or two, the economics don’t work in the public cloud,” he says. “The overall cost would be in the tens to hundreds of millions of dollars per year depending on capacity, tiering, and data access profiles.”

Instead of the public cloud, enterprise users can build privately and “burst” to the cloud for additional GPU use, Tigli adds. “The key here is that compute is elastic but data has gravity and is growing at a predictable — albeit accelerated — rate, so it needs to be architected accordingly,” he says.

Storage as a platform

Another option involves petabyte-scale storage platforms, adds Priyanka Karan, field CTO at digital transformation firm AHEAD. Petabyte-scale storage platforms “aim to reduce the data movement challenges of bringing data from where it initially landed to places where it can be leveraged for AI training,” she says. “The goal is not to create a new storage silo.”

Some storage platforms available are built on NAND flash, which offers high throughput and low latency, essential for feeding data to GPUs and TPUs, she says.

With several options out there, some AI users and experts say the amount and kind of storage needed depends on the AI project an organization is deploying.

Offline batch processing has lower memory requirements than real-time workloads, Karan says. In some cases, secondary storage options can be used to hold vast amounts of data needed for training and running AI models, she adds.

Choosing the right storage option also depends on the often-mentioned data gravity — the size of the data set, whether it can be moved to the cloud for processing, or whether it makes sense to bring the processing to the data. In some AI projects, the data storage is co-located in a data center with the AI compute, in another public cloud, or at the edge where the data is created.

Enterprises have many other factors to consider, including security, and regulatory or compliance challenges. With cloud storage, “networking, distance, and latency are factors here, but they must consider the added cost variable,” Karan says.

In addition, beyond the cost of storage itself, there may be data transfer fees, access fees, and management fees for off-premises storage. On the other hand, on-premises storage options can involve huge upfront investments, as well as maintenance, power and cooling, and staff salaries.

“Organizations must evaluate their specific needs, including performance, cost, and scalability, to choose the best solution for their AI initiatives,” Karan says.

SUBSCRIBE TO OUR NEWSLETTER

From our editors straight to your inbox

Get started by entering your email address below.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : CIO – https://www.cio.com/article/2511331/storage-the-unsung-hero-of-ai-deployments.html

Tags: businessstorageUnsung
Previous Post

How top IT leaders create first-mover advantage

Next Post

Accuracy concerns slow manufacturers’ Gen AI adoption

Academics critique Farming Simulator’s portrayal of ‘good farming’ and praise modders for agro-ecology add-ons – PC Gamer

Academics critique Farming Simulator’s portrayal of ‘good farming’ and praise modders for agro-ecology add-ons – PC Gamer

July 9, 2025
Why is the Earth spinning faster? Is time speeding up? Australia’s experts give us their second opinion – The Guardian

Why is the Earth spinning faster? Is time speeding up? Australia’s experts give us their second opinion – The Guardian

July 9, 2025
200 million year-old jawbone revealed as new species – BBC

200 million year-old jawbone revealed as new species – BBC

July 9, 2025
Off-grid homeowner dispels common misconceptions about his lifestyle: ‘Doesn’t mean I live primitively’ – Yahoo

Off-Grid Living Uncovered: How One Homeowner Thrives Without Sacrificing Modern Comforts

July 9, 2025
Fluminense Is the Big Winner of the Controversial 2025 Club World Cup – Sportico.com

Fluminense Is the Big Winner of the Controversial 2025 Club World Cup – Sportico.com

July 9, 2025
A Masterclass on Status, Power, & the Economy with Tressie M… – Kottke.org

Unlocking Status, Power, and the Economy: A Masterclass with Tressie M

July 9, 2025
Monumental Sports & Entertainment’s Samantha Brady on the Power of the RSN’s Direct-to-Consumer Streaming Service Monumental+ – Sports Video Group

Samantha Brady Reveals How Monumental+ is Transforming Sports Streaming with Direct-to-Consumer Access

July 9, 2025
Tuesday’s Station Research Advancing Crew Health as Crew Unpacks Cargo – NASA (.gov)

Tuesday’s Station Research Advancing Crew Health as Crew Unpacks Cargo – NASA (.gov)

July 9, 2025
Musk says he is forming new political party after fallout with Trump – CNN

Musk says he is forming new political party after fallout with Trump – CNN

July 9, 2025
Kaseya Extends Community Investment with Addition of Technology Marketing Toolkit – Kaseya

Kaseya Extends Community Investment with Addition of Technology Marketing Toolkit – Kaseya

July 9, 2025

Categories

Archives

July 2025
MTWTFSS
 123456
78910111213
14151617181920
21222324252627
28293031 
« Jun    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (712)
  • Economy (737)
  • Entertainment (21,625)
  • General (15,793)
  • Health (9,774)
  • Lifestyle (742)
  • News (22,149)
  • People (737)
  • Politics (745)
  • Science (15,954)
  • Sports (21,235)
  • Technology (15,720)
  • World (718)

Recent News

Academics critique Farming Simulator’s portrayal of ‘good farming’ and praise modders for agro-ecology add-ons – PC Gamer

Academics critique Farming Simulator’s portrayal of ‘good farming’ and praise modders for agro-ecology add-ons – PC Gamer

July 9, 2025
Why is the Earth spinning faster? Is time speeding up? Australia’s experts give us their second opinion – The Guardian

Why is the Earth spinning faster? Is time speeding up? Australia’s experts give us their second opinion – The Guardian

July 9, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version