Avi Shetty

"efficiency is one of the most important things across the spectrum. We talk about AI, you absolutely need to feed the GPU. That's the most expensive commodity in your whole data center. And anytime a GPU is idle, that's revenue lost."

"The most expensive part of that ecosystem or the data center is the GPU. And you want to maximize your GPU utilization and having inefficient networking or storage just doesn't pair well."

"last year when I spoke to you guys, GPU and HBM were the favorite child. And over the last year, we've seen storage put itself in its place where you've seen usages and certain solutions which have exposed the need for having high performing, reliant, scalable, high dense storage solutions"

"the industry's finally come to talk about storage being a very critical factor in the whole AI data pipeline, as well as AI factories. The first wave was all about GPUs, what's my GPU utilization? Then came about, "Hey, how do I maximize? How much HBM do I put?" But essentially, what happens with every memory hierarchy is get the first few nodes get stressed and the next layer or the next node needs to be created, and that's why we are here"

"I feel you'll see more usages, RAG offload, KV cache, pushing a storage-centric design architecture where you are looking at storage when you're designing inference data centers or core data centers with storage in mind, with flash in mind. It has to be the case going forward."

"Jensen at CES talked about the inference context, TAM expansion. This entire market didn't exist, and it's going to be as big as the storage market of today in five to six years. That's the change we're talking about, right? With inference kicking off, there will be a huge storage demand which needs to be at the edge, at the data center, and everywhere in between."

"earlier this year at GTC, Solidigm launched their first, world's first liquid cooled SSD for storage."

"Storage historically throttles when put under sustained workloads. Those were the old traditional ways of air cooling the storage. And as a result, new innovations have to be done. And Solidigm brought in the first world was liquid cooled SSD, which essentially wants the GPU to be fed consistently and for longer by ensuring that the sustained bandwidth is maintained."