GPU Tray

CS-Storm 500NX 1U server GPU tray components and numbering.

The CS-Storm 500NX 1U server supports 8 NVIDIA Tesla P100 or V100 GPUs. The GPUs are installed on SXM modules on GPU board mounted in the GPU tray.
Figure: GPU Tray - CS-Storm 500NX 1U Server

GPU Numbering

Numbering of the GPUs varies depending on the interface (bus number). GPU numbers are silk screened on the SXM board, displayed when using Intelligent Platform Management Interface (IPMI) commands, and referenced by the operating system. The different numbering systems are listed below.

Important: All GPU numbers shown in text and figures throughout this document follow the operating system (OS) numbering scheme.
Table 1. CS-Storm 500NX 1U GPU Numbering Scheme
Bus Number09:00.00A:00.004:00.005:00.089:00.08A:00.085:00.086:00.0
SXM2 BoardGPU 0GPU 1GPU 2GPU 3GPU 4GPU 5GPU 6GPU 7
IPMIGPU 1GPU 2GPU 3GPU 4GPU 5GPU 6GPU 7GPU 8
OSGPU 2GPU 3GPU 0GPU 1GPU 6GPU 7GPU 4GPU 5

NVIDIA Tesla GPUs

NVIDIA Tesla GPUs use the NVLink™ high-speed GPU interconnect to provide data transfers between GPUs. The NVLink connection provides GPU-to-GPU data transfers at up to 160 Gb/s of bidirectional bandwidth—5x the bandwidth of PCIe Gen 3 x16. The GPUs still communicate using the PCI-e protocol when transferring data to and from the CPUs, memory, and expansion slots.

Figure: NVIDIA SXM2 GPU Module

NVIDIA Pascal GP100 Specifications

GPU Architecture:NVIDIA Pascal
Performance:
  • 5.3 TFLOPS of double precision floating point (FP64) performance
  • 10.6 TFLOPS of single precision (FP32) performance
  • 21.2 TFLOPS of half-precision (FP16) performance
NVIDIA CUDA® Cores:3584
GPU Memory:16 GB CoWoS HBM2
Memory Bandwidth:732 GB/s
Interconnect:NVIDIA NVLink
Max Power Consumption:300 W
Thermal Solution:Passive heatsink
Form Factor:SXM2

NVIDIA Volta GV100 Specifications

GPU Architecture:NVIDIA Volta
Performance:
  • 7.8 TFLOPS of double precision floating point (FP64) performance
  • 15.7 TFLOPS of single precision (FP32) performance
  • 125 TFLOPS of half-precision (FP16) performance
NVIDIA CUDA® Cores:5376
GPU Memory:16 GB CoWoS HBM2
Memory Bandwidth:900 GB/s
Interconnect:NVIDIA NVLink
Max Power Consumption:400 W
Thermal Solution:Passive heatsink
Form Factor:SXM2