DGX+Parallel Storage Building Blocks for Scale Out AI
DGX-POD is an NVIDIA-validated building block of AI Compute & Storage for scale-out deployments.
Designed for the largest datasets, DGX POD solutions enable training at vastly improved performance compared to single systems. DGX-POD also includes the AI data-plane/storage with the capacity for training datasets, expandability for growth, and the speed that can keep up with AI workloads.
Why DGX-POD?
Fully Integrated Deployment
DGX-POD solutions come with the DGX AI Appliance and Parallel storage fully integrated together
Extendable
Build complete racks with multiple DGX-POD configurations
Validated Configuration
DGX-POD solutions have been validated to deliver high storage throughput
Performance Improves Over Time
DGX-POD automatically receives performance improvements from NVIDIA
Mid-Scale and Single Rack Solutions
1:1 DGX A100 POD with AI200X
1 NVIDIA DGX A100 with DDN AI200X
First Deployment of AI Compute & AI Ready-Parallel Storage
Specifications
- 5 PFLOPS of AI Performance
- DDN AI200X appliance with throughput up to 24GB/sec and 1.5 million IOPS (various data capacities available)
- Total of 320GB or 640GB of GPU memory
- Mellanox 200Gb HDR InfiniBand
- NGC Containers with NVIDIA-optimized performance
- Full parallel filesystem and DDN Management GUI
- Seamless AI compute scaling: add DGX systems to increase AI performance (existing DDN AI200X has headroom to continue to scale data throughput)
- Seamless storage throughput & capacity scaling: add AI200X appliances to double data bandwidth or grow data capacity (DDN EXAScaler Lustre filesystem is already built for expansion)
- Superior Performance with GPUDirect Storage: realize a direct data path from storage to GPU over InfiniBand. Delivers faster performance for multiple users on a single DGX and on scale-out multi-DGX deployments
- Validated Configuration: Scale-out AI performance of design is validated by NVIDIA and DDN
2:1 DGX A100 POD with AI400X
2 NVIDIA DGX A100s with DDN AI400X
Scale-Up AI Compute & AI Ready-Parallel Storage
Specifications
- 10 PFLOPS of AI Performance
- DDN AI400X appliance with throughput up to 48GB/sec and 3 million IOPS (various data capacities available)
- Total of 640GB or 1280GB of GPU memory
- Mellanox 200Gb HDR InfiniBand
- NGC Containers with NVIDIA-optimized performance
- Full parallel filesystem and DDN Management GUI
- Seamless AI compute scaling: add DGX systems to increase AI performance (existing DDN AI400X has headroom to continue to scale data throughput)
- Seamless storage throughput & capacity scaling: add AI400X appliances to double data bandwidth or grow data capacity (DDN EXAScaler Lustre filesystem is already built for expansion)
- Superior Performance with GPUDirect Storage: realize a direct data path from storage to GPU over InfiniBand. Delivers faster performance for multiple users on a single DGX and on scale-out multi-DGX deployments
- Validated Configuration: Scale-out AI performance of design is validated by NVIDIA and DDN
4:2 DGX A100 POD with AI400X
4 NVIDIA DGX A100s with 2 DDN AI400X
Full Rack AI Compute & AI Ready-Parallel Storage
Specifications
- 20 Tensor PFLOPS of AI Performance
- DDN AI400X appliances with throughput up to 96GB/sec and 6 million IOPS (various data capacities available)
- Total of 1.25TB or 2.5TB of GPU memory
- Mellanox 200Gb HDR InfiniBand
- NGC Containers with NVIDIA-optimized performance
- Full parallel filesystem and DDN Management GUI
- Seamless AI compute scaling: add DGX systems to increase AI performance (existing DDN AI400X systems have headroom to continue to scale data throughput)
- Seamless storage throughput & capacity scaling: add AI400X appliances to increase bandwidth or grow data capacity (DDN EXAScaler Lustre filesystem is already built for expansion)
- Superior Performance with GPUDirect Storage: realize a direct data path from storage to GPU over InfiniBand. Delivers faster performance for multiple users on a single DGX and on scale-out multi-DGX deployments
- Validated Configuration: Scale-out AI performance of design is validated by NVIDIA and DDN
Something else?
Custom Parallel Storage Solutions
Looking for another filesystem (Spectrum Scale/GPFS, BeeGFS), scale, or capacity? Let us design a system that meets your needs.
Key Capabilities
- Capacities to 1PB or beyond
- Throughput >100-500GB/sec
- Dynamic capacity expansion
- Lustre, BeeGFS, or Spectrum Scale (formerly GPFS)
Multi-Rack Solutions and DGX SuperPOD
8:4 DGX A100 POD with AI400X
8 DGX A100 Systems with 4 DDN AI400X
Dual Rack of AI Compute & Ultra-High Throughput Parallel Storage
Specifications
- 40 PFLOPS of AI Performance
- DDN AI400X appliances with throughput up to 192GB/sec and 12 million IOPS (various data capacities available)
- Total of 2.5TB or 5TB of GPU memory
- Mellanox 200Gb HDR InfiniBand
- NGC Containers with NVIDIA-optimized performance
- Full parallel filesystem and DDN Management GUI
- Superior Performance with GPUDirect Storage: realize a direct data path from storage to GPU over InfiniBand. Delivers faster performance for multiple users on a single DGX and on scale-out multi-DGX deployments
- Validated Configuration: Scale-out AI performance of design is validated by NVIDIA and DDN
DGX SuperPOD 20 Node Deployment
20 NVIDIA DGX A100 AI Systems, 7 DDN AI400X
Record-Breaking, Large AI Cluster Building Block
Specifications
- 100 PFLOPS of AI Performance
- 7 DDN AI400X appliances with aggregate throughput up to 336GB/sec and 21 million IOPS (various data capacities available)
- Total of 6.25TB or 12.5TB of GPU memory
- Mellanox 200Gb HDR InfiniBand
- NGC Containers with NVIDIA-optimized performance
- Full parallel filesystem and DDN Management GUI
- Record Breaking Building Block: Scale-out AI performance of design is the basis of NVIDIA’s World Record Breaking, DGX SuperPOD Deployment
- Scales up to Massive Deployments deploy multiple 20 node building blocks for immense AI + storage deployments
Something else?
Custom Parallel Storage Solutions
Looking for another filesystem (Spectrum Scale/GPFS, BeeGFS), scale, or capacity? Let us design a system that meets your needs.
Key Capabilities
- Multi-PB Storage Capacities
- Throughput >500GB/sec
- Dynamic capacity expansion
- Lustre, Spectrum Scale (formerly GPFS), or BeeGFS
