Category top banner badge image
The most powerful end-to-end AI supercomputing platform.

NVIDIA HGX Solutions for AI & HPC featuring B200, H200, & H100

value propositon

Extreme HPC Performance

NVIDIA HGX H100/H200 8-GPU delivers exceptional FP64 performance for HPC and industry leading FP16 and FP8 performance for AI.

value propositon

Fourth-Gen NVLink

The NVIDIA HGX H100/H200 utilizes 4th Gen NVLink for up to 900GB/ of GPU-to-GPU interconnect, almost 10X higher than PCIe Gen4.

value propositon

Third Gen NVIDIA NVSwitch

NVIDIA NVSwitchâ„¢ creates a unified networking fabric that allows the entire node of multiple HGX systems to function as a single cohesive GPU.

New NVIDIA HGX B200 Platforms Shipping Now

Solution image

NVIDIA HGX B200 (8 GPU) Dual Intel Xeon 4th/5th10U

TS4-124903244

Highlights
CPU2x 4th/5th Gen Intel Xeon Scalable CPU
GPUNVIDIA HGX B200 - 8x NVIDIA B200 SXM5 192GB HBM3e (1.536TB) + NVLink
MEM32x DDR5 Memory Slots (up to 6TB)
STO10x 2.5" Hot-swap NVMe + 8x Optional E1.S Hot-swap NVMe
NET2x 10GBASE-T with Optional NICs
Solution image

NVIDIA HGX B200 (8 GPU) Dual Intel Xeon 690010U

TS4-169219634

Starting at

$380,316.20

Highlights
CPU2x 6 Gen Intel Xeon 6900 Series with P-cores
GPUNVIDIA HGX B200 - 8x NVIDIA B200 SXM5 192GB HBM3e (1.536TB) + NVLink
MEM32x DDR5 Memory Slots (up to 6TB)
STO10x 2.5" Hot-swap NVMe + 8x Optional E1.S Hot-swap NVMe
NET2x 10GBASE-T with Optional NICs

NVIDIA HGX H200 Platforms

Solution image

NVIDIA HGX H200 (4 GPU) Dual Xeon Scalable3U

TS4-147416516

Starting at

$134,009.70

Highlights
CPU2x 4th/5th Gen Intel Xeon Scalable CPU
GPUNVIDIA HGX H200 - 4x NVIDIA H200 SXM5 141GB HBM3e (564GB) + NVLink
MEM16x DDR5 ECC DIMMs (up to 4TB)
STO8x 2.5" NVMe & SATA Hotswap
NET2x 10GBASE-T Ethernet & 6x PCIe 5.0 LP for NICs
Solution image

NVIDIA HGX H200 (8 GPU) Dual Xeon Scalable6U

TS4-127744315

Starting at

$266,768.33

Highlights
CPU2x 4th/5th Gen Intel Xeon Scalable CPU
GPUNVIDIA HGX H200 - 8x NVIDIA H200 SXM5 141GB HBM3e (1.1TB) + NVLink
MEM32x DDR5 ECC DIMMs (up to 8TB)
STO12x 2.5" Hot-swap Drives (8x NVMe, 4x SATA)
NET2x 1GBASE-T Ethernet & 8x PCIe 5.0 LP for NICs
Solution image

NVIDIA HGX H200 (8 GPU) Dual EPYC 90048U

TS4-118380266

Starting at

$259,227.10

Highlights
CPU2x AMD EPYC 9004 CPU
GPUNVIDIA HGX H200 - 8x H200 SXM5 141GB HBM3e (1.1TB) + NVLink
MEM24x DDR5 ECC DIMMs (up to 6TB)
STO24x 2.5" Hotswap (16x NVMe, 8x SATA)
NET8x PCIe 5.0 LP for NICs & optional 2x 10GBASE-T

NVIDIA HGX H100 Platforms

Solution image

NVIDIA HGX 4x H100 Dual Intel Xeon Scalable4U

TS4-101818584

Starting at

$140,114.21

Highlights
CPU2x 4th/5th Gen Intel Xeon Scalable CPU
GPUNVIDIA H100 HGX - 4x NVIDIA H100 SXM5 80GB + NVLink Switch System
MEMUp to 8TB DDR5 ECC Memory
STO6x 2.5" NVMe & SATA Hotswap
NET2x 10GBASE-T or 25Gbe SFP28
Solution image

NVIDIA HGX 8x H100 Dual AMD EPYC 90048U

TS4-193475697

Starting at

$259,155.60

Highlights
CPU2x AMD EPYC 9004 CPU
GPUNVIDIA H100 HGX - 8x NVIDIA H100 SXM5 80GB + NVLink Switch System
MEMUp to 6TB DDR5 ECC Memory
STO24x 2.5" Hotswap (16x NVMe, 8x SATA)
NET8x PCIe 5 LP slots Connected to PLX
Solution image

NVIDIA HGX 8x H100 Dual Intel Xeon Scalable8U

TS4-117847628

Starting at

$268,215.20

Highlights
CPU2x 4th/5th Gen Intel Xeon Scalable CPU
GPUNVIDIA H100 HGX - 8x NVIDIA H100 SXM5 80GB + NVLink Switch System
MEMUp to 8TB DDR5 ECC Memory
STO24x 2.5" Hotswap (16x NVMe, 8x SATA)
NET8x PCIe 5 LP slots Connected to PLX

Build your ideal system

Need a bit of help? Contact our sales engineers directly.

High-Performance Computing with NVIDIA H100

To unlock next-generation discoveries, scientists look to high performance computing to understand complex molecules for drug discovery, simulation of mechanical and fluid dynamics, parse through length genome sequences, extrapolate data science research, and train next generation generative AI.

H100 continues to deliver high performance innovation, tripling the FLOPS in double precision FP64 Tensor Cores over the A100. AI-fused HPC applications can also leverage H100’s TF32 precision to achieve one petaflop of throughput for single-precision matrix-multiply operations, with zero code changes. 

  1. Fine-tuning LoRA (GPT-40GB) 8 GPUs: global trian batch size 128 (sequences), seq-length 256 (tokens)
  2. Small Model Training (GPT-7B, GPT-13B) 8-GPU averaged: global train batch size: 512 (sequences), seq-length: 2048 (tokens)
  3. Large Model Training (GPT- 175B) 256 GPUs (32x Nodes): global train batch size: 2048 (sequences), seq-length: 2048 (tokens)
  1. 3D fast Fourier transform (FFT) (4K^3) throughput. HGX A100 8-GPU with HDR IB network vs HGX H100 8-GPU NVLink Switch System NDR IB.
  2. Genome Sequencing (Smith-Waterman): 1x A100 vs 1x H100

HGX B200, H200, H100 Specifications

AI can Accelerate the Workflow of any Industry

Start Training Your Own AI Model Today

NVIDIA AI Enterprise enables users to harness the power of AI through an optimized and streamlined development and deployment framework. Coupled with NVIDIA Enterprise Support and Training Services, developers can leverage a professional to assist and teach the best AI practices. Train and deploy the best AI model, tailored for your deep learning goals today.

logo

Partnerships

nvidia
pny
panasas
ansys
WEKA
BeeGFS