Pushing the Limits of Density: Dell and Kioxia's 10PB 2RU Storage Server

The demand for massive datasets to fuel AI/ML workloads is pushing hardware engineering to its absolute limits. In a recent collaboration, Dell and Kioxia have demonstrated a significant leap in storage density, cramming nearly 10 petabytes (PB) of all-flash storage into a slim 2RU server. This development represents more than just a feat of "packing"; it highlights a broader industry trend toward replacing traditional spinning disks with ultra-high-capacity solid-state drives (SSDs) for nearline storage.

The Hardware Breakdown: PowerEdge R7725xd

At the heart of this density milestone is the Dell PowerEdge R7725xd server, powered by AMD EPYC 9005 processors. To achieve the 9.8 PB total capacity, Dell utilized 40 of Kioxia's LC9 high-capacity QLC SSDs.

Key technical specifications include:

• Drive Capacity: Each LC9 SSD provides 245.76 TB of storage.
• Form Factor: The drives use the E3.L EDSFF (Enterprise and Data Center SSD Form Factor), which is designed specifically for higher capacity and better thermal management than traditional U.2 drives.
• Throughput: To prevent the storage from becoming a bottleneck, the system supports up to five 400 Gbps NICs, ensuring that data can be ingested and shipped at speeds commensurate with the flash media.

From a rack-level perspective, the implications are staggering. A single rack fitted with twenty of these servers could theoretically house 196 PB of all-flash storage, drastically reducing the physical footprint required for massive data lakes.

The Strategic Shift: From HDD to "HDD Killers"

For years, Hard Disk Drives (HDDs) were the only viable option for bulk, nearline storage due to their superior cost-per-gigabyte. However, the emergence of 256 TB-class SSDs is beginning to challenge this hegemony. Kioxia is not alone in this race; Micron (with the 6600 ION), Sandisk (UltraQLC SN670), and SK Hynix (AIN D) are all developing similar high-capacity drives.

Perhaps most ambitious is the roadmap coming from Samsung. Reports indicate that Samsung is developing nearline-class SSDs that could reach 1 PB per drive, explicitly positioned as "HDD killers."

Technical Challenges and Market Realities

While the raw numbers are impressive, the community of engineers and architects has raised several critical points regarding the practical implementation of such dense systems.

The PCIe Bottleneck

One primary concern is the interface limit. Current systems are heavily reliant on PCIe 5.0. As density increases, the ratio of storage capacity to interface bandwidth shifts. Some observers note that we are reaching a point where the network and bus speeds may struggle to keep up with the sheer volume of data stored in a single chassis. The transition to PCIe 7.0 and 8.0 will be essential to realize the full potential of exabyte-scale racks.

Thermals and Reliability

Packing 40 high-capacity QLC drives into a 2RU space creates significant thermal challenges. While the E3.L form factor helps, the heat dissipation required to maintain these drives during heavy ingestion is a non-trivial engineering hurdle. Furthermore, there are concerns regarding the long-term repairability and recyclability of such highly integrated, dense hardware.

The Cost Barrier

Despite the technical achievement, the financial barrier remains high. Community analysis suggests that the drives alone for a single 10 PB server could cost between $500,000 and $1 million.

"Let's build a compact, hugely data-dense server that absolutely no one can afford!"

Consequently, this technology is currently reserved for hyperscalers, high-end defense research, and massive AI labs. For the average enterprise or consumer, the "SSD NAS" dream remains a distant prospect, though some hope that the current AI investment bubble will eventually lead to a glut of memory that crashes prices for the broader market.

Conclusion

The Dell and Kioxia 10 PB server is a lighthouse project. It proves that the physical constraints of the data center are shifting. As we move toward 1 PB individual drives and PCIe 7.0, the era of "spinning rust" for bulk storage may finally be entering its twilight, replaced by a world where petabytes of data can be managed in a fraction of the space.