NVIDIA H100 NVL 94GB PCIe Gen5
900-21010-0020-000
FP32
67 TFLOPS
FP64
34 TFLOPS
PCIe
PCIe Gen5
VRAM
94 GB HBM3 with ECC
Memory Bandwidth: 3.9 TB/s
Memory Bandwidth: 3.9 TB/s
TDP
300-350W (configurable)
Warranty
3 Years Warranty
The next frontier for innovation
The rise of generative AI is seen as the next milestone in many industries - from tech companies to banking and media. We support you in optimising your productivity and processes with AI-based solutions, as well as making strategic decisions and improving the customer experience.
Versatile application possibilities of AI
Whether AI-powered applications and business models, intelligent human-like chatbots for customer service or AI to support code generation and content creation, companies can leverage open-source frameworks, libraries and pre-trained AI models and customise them with their own data sets for unique use cases. With the introduction of AI infrastructures, Supermicro's GPU-optimised systems offer an open and modular architecture, vendor diversity and easy deployment and upgrade paths for fast-moving technologies.
AI inferencing cards & platforms
NVIDIA L40
900-2G133-0010-000
CUDA Cores
18176
Tensor Cores
568
NVIDIA RT Cores
142
PCIe
PCI Express PCIe 4.0 x16
VRAM
48 GB GDDR6 with ECC
Memory Bandwidth: 864 GB/s
Memory Bandwidth: 864 GB/s
TDP
300 W
Warranty
3 Years Warranty
NVIDIA L40S
900-2G133-0080-000
CUDA Cores
18176
Tensor Cores
568
NVIDIA RT Cores
142
PCIe
PCI Express PCIe 4.0 x16
VRAM
48 GB GDDR6 with ECC
Memory Bandwidth: 864 GB/s
Memory Bandwidth: 864 GB/s
TDP
350 W
Warranty
3 Years Warranty
NVIDIA L4
900-2G193-0000-001
CUDA Cores
7680
Tensor Cores
240
NVIDIA RT Cores
60
PCIe
PCI Express Gen 4 x 16
VRAM
24 GB GDDR6 with ECC
Memory Bandwidth: 300 GB/s
Memory Bandwidth: 300 GB/s
TDP
72W
Warranty
3 Years Warranty
NVIDIA Jetson AGX Orin development kit 64GB
945-13730-0055-000
GPU
2048-core NVIDIA Ampere architecture GPU with 64 Tensor Cores
CPU
12-core Arm Cortex-A78AE v8.2 64-bit CPU
Deep-Learning Accelerator
2x NVDLA v2
Memory
64GB 256-bit LPDDR5
Storage
64GB eMMC 5.1
Warranty
includes 3 Years Parts Warranty
NVIDIA Jetson AGX Orin Industrial 64GB
900-13701- 0080-000
GPU
2048-core NVIDIA Ampere architecture GPU with 64 Tensor Cores
CPU
12-core Arm Cortex-A78AE v8.2 64-bit CPU
Deep-Learning Accelerator
2x NVDLA v2
Memory
64GB 256-bit LPDDR5
Storage
64GB eMMC 5.1
Warranty
includes 3 Years Parts Warranty
NVIDIA Jetson AGX Orin 64GB Module
900-13701-0050-000
GPU
2048-core NVIDIA Ampere architecture GPU with 64 Tensor Cores
CPU
12-core Arm Cortex-A78AE v8.2 64-bit CPU
Deep-Learning Accelerator
2x NVDLA v2
RAM
64GB 256-bit LPDDR5
Storage
64GB eMMC 5.1
Warranty
includes 3 Years Parts Warranty
NVIDIA Jetson Orin NX 16GB
900-13767-0000-000
GPU
1024-core NVIDIA Ampere architecture GPU with 32 Tensor Cores
CPU
8-core Arm Cortex-A78AE v8.2 64-bit CPU
Deep-Learning Accelerator
2x NVDLA v2
RAM
16GB 128-bit LPDDR5
Warranty
includes 3 Years Parts Warranty
NVIDIA Jetson Orin Nano 8GB Development Kit
945-13766-0005-000
GPU
1024-core NVIDIA Ampere architecture GPU with 32 Tensor Cores
CPU
6-core Arm Cortex-A78AE v8.2 64-bit CPU
RAM
8GB 128-bit LPDDR5
Warranty
includes 3 Years Parts Warranty
NVIDIA Jetson Orin Nano 8GB
900-13767-0030-000
GPU
1024-core NVIDIA Ampere architecture GPU with 32 Tensor Cores
CPU
6-core Arm Cortex-A78AE v8.2 64-bit CPU
RAM
8GB 128-bit LPDDR5
Warranty
includes 3 Years Parts Warranty
NVIDIA Jetson Orin NX 8GB
900-13767-0010-000
GPU
1024-core NVIDIA Ampere architecture GPU with 32 Tensor Cores
Deep-Learning Accelerator
1x NVDLA v2.0
CPU
6-core Arm Cortex-A78AE v8.2 64-bit CPU
RAM
8GB 128-bit LPDDR5
Warranty
includes 3 Years Parts Warranty
NVIDIA Jetson Orin Nano 4GB
900-13767-0040-000
GPU
512-core NVIDIA Ampere architecture GPU with 16 Tensor Cores
CPU
6-core Arm Cortex-A78AE v8.2 64-bit CPU
RAM
4GB 64-bit LPDDR5
Warranty
includes 3 Years Parts Warranty
NVIDIA Jetson AGX ORIN Module 32GB
900-13701-0040-000
GPU
1792-core NVIDIA Ampere architecture GPU with 56 tensor cores
Deep Learning Accelerator
2x NVDLA v2.0
CPU
8-core Arm Cortex-A78AE v8.2 64-bit CPU
RAM
32GB 256-bit LPDDR5
Storage
64GB eMMC 5.1
Warranty
includes 3 Years Parts Warranty
NVIDIA Jetson Nano Module
900-13448-0020-000
GPU
128-core NVIDIA Maxwell GPU
CPU
Quad-core ARM A57 CPU
RAM
4 GB 64-bit LPDDR4
Storage
16 GB eMMC 5.1
Warranty
includes 3 Years Parts Warranty
Optimum performance with NVIDIA
NVIDIA pursues a full-stack architecture approach that ensures that AI-supported applications can be operated with optimum cost efficiency. The result is faster results with reduced operating costs. NVIDIA AI Enterprise, an enterprise-grade inference platform, includes best-in-class software, reliable management, security and API stability to ensure performance and high availability.
Further questions about AI Inferencing?
Contact sysGen now
FAQ - AI Inferencing & Generative AI
- What is generative AI?
Generative AI is a technology that creates new content from existing data, be it text, images, video or other forms of data.
- How can my company benefit from AI?
AI can increase productivity, optimise processes, enable data-driven decisions and improve the customer experience.
- Which NVIDIA GPUs are suitable for AI inferencing?
NVIDIA offers a range of GPUs such as H100 NVL, H200 NVL, L40S, L40 and L4, which are specially optimised for AI inferencing and training.