Key Architecture Highlights
- GPU Architecture: NVIDIA Ampere
- GPU memory specifications: GPU memory: 24GB HBM2 GPU memory ECC: Enabled (default; can be turned off by software)
- GPU memory bandwidth: 933GB/s
Applications
- AI training and inference
- High-performance computing
- Analysis of data
Engineering Parameters
| GPU Architecture | NVIDIA Ampere |
|---|---|
| GPU memory specifications | GPU memory: 24GB HBM2 GPU memory ECC: Enabled (default; can be turned off by software) |
| GPU memory bandwidth | 933GB/s |
| GPU memory bus width | 3072 bit |
| General-purpose compute performance | FP32: 10.3 teraFLOPS FP64: 5.2 teraFLOPS FP64 Tensor Core: 10.3 teraFLOPS |
| Tensor Compute performance | TF32 Tensor Core: common: 82 teraFLOPS; sparse: 165 teraFLOPS FP16 Tensor Core: common: 165 teraFLOPS; sparse:330 teraFLOPS BF16 Tensor Core: common: 165 teraFLOPS; sparse:330 teraFLOPS |
| Integer compute performance | INT8 Tensor Core: Normal: 330 TOPS; Sparse: 661 TOPS INT4 Tensor Core: Normal: 661 TOPS; Sparse: 1321 TOPS |
| PCIe Interface | PCIe Gen4 x16 |
| NVLink / Interconnection | Interconnect Capability: PCIe Gen4: 64GB/s Third-gen NVLINK: 200GB/s (NVLink Bridge. Up to Two. GPU) |
| MIG Division | 4x6GB/2x12GB/1x24GB (three different ways to divide) |
| Video decoding | 1 units OFA ／ 1 units JPEG Decoding/ 4 units NVDEC |
| Board power | 165 W |
| Power input Interface | 1 CPU 8-pin power input interface |
| Card form factor / cooling | card form factor: Full length (FHFL) 10.5 ton, double-slit cooling method: passive cooling (requires server wind tunnel) |
| GPU Frequency | Base: 930 MHz Boost: 1440 MHz |
| Operating temperature | 0 °C to 55 °C |
Warranty
manufacturer's public product information does not specify the warranty period for this model in its supply channel; applicable region, channel and actual warranty service confirmed by the supply contract.
Manufacturer information
Manufacturer informationVerified Documentation & Datasheets
Official products page
Download DocumentPB-10418-001_v03 | March 2022 NVIDIA A30 GPU Accelerator Product Brief
Download Document