Product Description
PNY Nvidia H100 Nvl Pcie Retail - NVH100NVLTCGPU-KIT
NVIDIA® H100 NVL supercharges large language model inference in mainstream PCIe-based server systems. With increased raw performance, bigger, faster HBM3 memory, and NVIDIA NVLink™ connectivity via bridges, mainstream systems with H100 NVL outperform NVIDIA A100 Tensor Core systems by up to 5X on Llama 2 70B. H100 NVL also includes NVIDIA Enterprise software.
- FP64 -30 teraFLOPS
- FP64 Tensor Core - 60 teraFLOPS
- FP32 - 60 teraFLOPS
- TF32 Tensor Core - 835 teraFLOPS
- BFLOAT16 Tensor Core - 1,671 teraFLOPS
- FP16 Tensor Core - 1,671 teraFLOPS
- FP8 Tensor Core - 3,341 teraFLOPS
- INT8 Tensor Core - 3,341 teraFLOPS
- GPU Memory - 94GB
- GPU Memory Bandwidth - 3.9TB/s
- Decoders 7 NVDEC / 7 JPEG
- Max Thermal Design Power (TDP)- 350-400W (configurable)
- Form Factor - PCIe dual-slot air-cooled
- Interconnect - NVIDIA NVLINK: 600GB/s
- PCIe Gen5 - 128GB/s
- Server Options Partner and NVIDIA
- NVIDIA Enterprise Included
Other Details
(Manufacturer Standard Warranty) - Not Clear what product you need, or can't find your specific product/service part number? Call us +1 888 988 5472 | Fax: +1 888 920 3445. You can also use the quote request pageProduct Videos
Custom Field
MPN NVH100NVLTCGPU-KIT
NOTE Images may not be exact, please check specifications.
Required A Volume Purchase Contact us for a volume pricing | volumeorders@hssl.us