NVIDIA GPU-Vergleich

       
 NVIDIA Data Center GPUs
 B200B100H200
H100
L40S
L40
DesignHighest Perf AI, HPC, DAHighest Perf AI, HPC, DAHighest Perf AI, HPC, DA
Mainstream, Training and HPHighest Perf UniversalPowerful Graphics + AI
Form Factor
SXM5SXM5SXM5PCIe Gen5 x16 2 Slot FHFL 
3 NVLink Bridge
SXM5

PCIe Gen5 x16 2 Slot FHFL 
3 NVLink Bridge

NVL 2x PCIe Gen5 x16 2x 2 Slot FHFL NVLink BridgedPCIe Gen4 x16 2 Slot FHFL
PCIe Gen4 x16 2 Slot FHFL
Max Power1200W | 1000W700W700W600W700W350W2x 400W350W300W
FP64 TC | FP32 TFLOPS40 | 80 (no-sparse)30 | 60 (no-sparse)67 | 67
60 | 6067 | 67
51 | 51
134 | 134
NA | 91.6
NA | 90
TF32 TC | FP16 TC TFLOPS
2200 | 45001800 | 3500
989 | 1979
835 | 1671989 | 1979
756 | 1513
1979 | 3958
366 | 733
181 | 362
FP8/FP6 TC | INT8 TC TFLOPS/TOPS
9000 | 90007000 | 70003958 | 39583341 | 33413958 | 39583026 | 3026
7916 | 7916
1466 | 1466724 | 724
FP4 TC
1800014000-------
GPU Memory
Up to 192 GB
Up to 8000 GB/s
Up to 192 GB
Up to 8000 GB/s
141 GB HBM3e 4800GB/s
141 GB HBM3e 4800GB/s80 GB HBM3 3350GB/s
80 GB HBM2e 2000GB/s
188 GB HBM2e 7800GB/s
48 GB GDDR6 864GB/s
48 GB GDDR6 864GB/s
Multi-Instance GPU (MIG)
Up to 7Up to 7Up to 7Up to 7Up to 7Up to 7Up to 14
--
NVLink Connectivity
Up to 256Up to 256Up to 256Up to 256Up to 2562 cards2 cards
--
Media Acceleration
7 JPEG Decoder
7 Video Decoder
7 JPEG Decoder
7 Video Decoder
7 JPEG Decoder
7 Video Decoder
7 JPEG Decoder
7 Video Decoder
7 JPEG Decoder
7 Video Decoder
7 JPEG Decoder
7 Video Decoder
14 JPEG Decoder
14 Video Decoder
3 Video Encoder
3 Video Decoder
4 JPEG Decoder
3 Video Encoder
3 Video Decoder
4 JPEG Decoder
Ray Tracing
-------YesYes
Transformer Engine
YesYesYesYesYesYesYesYesYes
DPX Instructions
??YesYesYesYesYes--
Graphics
(no vPC or RTX vWS)(no vPC or RTX vWS)(no vPC or RTX vWS)(no vPC or RTX vWS)(no vPC or RTX vWS)(no vPC or RTX vWS)(no vPC or RTX vWS)Top-of-LineTop-of-Line
vGPU
YesYesYesYesYesYesYesYesYes
Hardware Root of Trust
Internal and ExternalInternal and ExternalInternal and ExternalInternal and ExternalInternal and ExternalInternal and ExternalInternal and ExternalInternal and ExternalInternal
Confidential Computing
YesYesYesYesYesYesYes--
NVIDIA AI Enterprise
Add-onAdd-onAdd-onAdd-onAdd-onIncludedIncludedAdd-onAdd-on
Last Generation GPUsInfoInfoInfoInfoInfoPreisPreisPreisPreis
      Preis Edu/StartupPreis Edu/StartupPreis Edu/StartupPreis Edu/Startup
    
 NVIDIA RTX PRO GPUs
 

RTX PRO 4000

RTX PRO 4500RTX PRO 5000

RTX PRO 6000

Max-Q

RTX PRO 6000 

Server Edition

RTX PRO 6000 

Workstation Edition

GPU Architecture
BlackwellBlackwellBlackwellBlackwell
Blackwell
Blackwell
CUDA Cores
8960104961408024064
Tensor Cores
280 (5. Gen)
328 (5. Gen)
400 (5. Gen)
752 (5. Gen)
RT Cores
70 (4. Gen)
82 (4. Gen)
100 (4. Gen)
188 (4. Gen)
Peak Single-Precision Performance
---110 TFLOPS
39.6 TFLOPS
65.3 TFLOPS
Peak Double-Precision Performance
------
AI TOPS---3511 AI TOPS-4000 AI TOPS
RT Core Performance
---
333 TFLOPS352.3 TFLOPS380 TFLOPS
Memory Size
24 GB GDDR732 GB GDDR748 GB GDDR796 GB GDDR7
Memory Bandwidth
TBD896 GB/s
1344 GB/s
1792 GB/s
1600 GB/s
1792 GB/s
NVLink
Not supported
Thermal SolutionBlower Active FanBlower Active FanBlower Active Fan 
Blower Active Fan  Passive 
Double Flow Through 
NVENC | NVDEC | JPEG2x | 2x | 1x2x | 2x | 1x  2x | 2x | 1x4x | 4x | 4x 
MIG Support-

2x 24GB
1x 48GB

4x 24GB
2x 48GB
1x 96GB

4x 24GB
2x 48GB
1x 96GB

4x 24GB
2x 48GB
1x 96GB

Display Connectors
4x DP 2.1b
Form Factor
4.4"H x 9.5"L, Single Slot
4.4"H x 10.5"L, Dual Slot5.4"H x 12"L, XHFL Dual Slot
Max Power Consumption
140 W200 W300 W300 W400 - 600 W600 W
Graphics Bus
PCIe Gen 5 x16
Last Generation GPUs 

 

     
 Last NVIDIA Data Center GPUs
 A100/A800A30A40
A10
A16
A2
DesignHighest Perf ComputeMainstream Compute
High Perf Graphics
Mainstream & Video with AI
High Density Virtual Desktop
Entry-Level Small Footprint
Form Factor
SXM4PCIe Gen4 x16 2 Slot FHFL 3 NVLink Bridge
PCIe Gen4 x16 2 Slot FHFL 1 NVLink Bridge
PCIe Gen4 x16 2 Slot FHFL 1 NVLink BridgePCIe Gen4 x16 1 Slot FHFLPCIe Gen4 x16 2 Slot FHFLPCIe Gen4 x8 1 Slot LP
Max Power500W300W165W300W150W250W60W
FP64 TC | FP32 TFLOPS19.5 | 19.5
19.5 | 19.5
10 | 10
NA | 37
NA | 31
NA | 4x 4.5
NA | 4.5
TF32 TC | FP16 TC TFLOPS
312 | 624312 | 624165 | 330
150 | 300
125 | 250
4x 18 | 4x 36
18 | 36
FP8/FP6 TC | INT8 TC TFLOPS/TOPS
NA | 1248NA | 1248NA | 661NA | 600NA | 500NA | 4x 72
NA | 72
FP4 TC
-------
GPU Memory
80 GB HBM2e
80 GB HBM2e
24 GB HBM2
48 GB GDDR6
24 GB GDDR6
4x 16 GB GDDR6
16 GB GDDR6
Multi-Instance GPU (MIG)
Up to 7Up to 7Up to 4----
NVLink Connectivity
Up to 8
2 cards
2 cards
2 cards
-
-
-
Media Acceleration
1 JPEG Decoder
5 Video Decoder
1 JPEG Decoder
5 Video Decoder
1 JPEG Decoder
4 Video Decoder
1 Video Encoder
2 Video Decoder
(+AV1 decode)
1 Video Encoder
2 Video Decoder
(+AV1 decode)
4 Video Encoder
8 Video Decoder
(+AV1 decode)
1 Video Encoder
2 Video Decoder
(+AV1 decode)
Ray Tracing
---YesYesYesYes
Transformer Engine
-------
DPX Instructions
-------
Graphics
For-in-situ viz
(no vPC or RTX vWS)
For-in-situ viz
(no vPC or RTX vWS)
For-in-situ viz
(no vPC or RTX vWS)
BestBetterGoodGood
vGPU
YesYesYesYesYesYesYes
Hardware Root of Trust
Internal with Option for External
Internal with Option for External
Internal with Option for External
Internal with Option for External
Internal with Option for External
Internal with Option for External
Internal with Option for External
Confidential Computing
(1)------
NVIDIA AI Enterprise
Add-onAdd-onAdd-onAdd-onAdd-onAdd-onAdd-on
   PreisPreis PreisPreis
     
 Last NVIDIA RTX Desktop GPUs
 RTX A400
RTX A1000
RTX 2000 Ada
RTX 4000 Ada
RTX 4500 Ada
RTX 5000 Ada
RTX 6000 Ada
GPU Architecture
AmpereAmpereAda-Lovelace
Ada-Lovelace
Ada-Lovelace
Ada-Lovelace
Ada-Lovelace
CUDA Cores
76823042816614476801280018176
Tensor Cores
24 (3. Gen)
72 (3. Gen)
88 (4. Gen)
192 (4. Gen)
240 (4. Gen)
400 (4. Gen)
568 (4. Gen)
RT Cores
6 (2. Gen)
18 (2. Gen)
22 (3. Gen)
48 (3. Gen)
60  (3. Gen)
100  (3. Gen)
142 (3. Gen)
Peak Single-Precision Performance
2.7 TFLOPS
6.7 TFLOPS
12 TFLOPS
26.7 TFLOPS
39.6 TFLOPS
65.3 TFLOPS
91.1 TFLOPS
Peak Double-Precision Performance
-------
Tensor Performance
21.7 TFLOPS
53.8 TFLOPS
191.9 TFLOPS
327.6 TFLOPS
634.0 TFLOPS
1044.4 TFLOPS
1457.0 TFLOPS
RT Core Performance
5.4 TFLOPS
13.2 TFLOPS
27.7 TFLOPS
61.8 TFLOPS
91.6 TFLOPS
151.0 TFLOPS
210.6 TFLOPS
Memory Size
4 GB
8 GB
16 GB GDDR6
20 GB GDDR6
24 GB GDDR6
32 GB GDDR6
48 GB GDDR6
Memory Bandwidth
96 GB/s
192 GB/s
224 GB/s
360 GB/s
432 GB/s
576 GB/s
960 GB/s
NVLink
Not supported
Not supported
Not supported
Not supported
Not supported
Not supported
Not supported
VR Ready
NoNoYesYesYesYesYes
Virtual Workstation
NoNoNoNoNoYesYes
Display Connectors
4x mDP 1.4a4x mDP 1.4a4x mDP 1.4a4x DP 1.4a4x DP 1.4a4x DP 1.4a4x DP 1.4a
Form Factor
2.7"H x 6.4"L, Single Slot
2.7"H x 6.4"L, Single Slot
2.7"H x 6.4"L, Single Slot
4.4"H x 9.5"L, Single Slot
4.4"H x 10.5"L, Dual Slot
4.4"H x 10.5"L, Dual Slot
4.4"H x 10.5"L, Dual Slot
Max Power Consumption
50 W50 W70 W130 W210 W250 W300 W
Graphics Bus
PCIe Gen 4 x8 *
PCIe Gen 4 x8 *
PCIe Gen 4 x8 *
PCIe Gen 4 x16
PCIe Gen 4 x16
PCIe Gen 4 x16
PCIe Gen 4 x16
   PreisPreisPreis PreisPreis
      Preis Edu/StartupPreis Edu/Startup

 

Haben Sie Fragen zu den NVIDIA GPU Modellen, helfen oder geben wir Ihnen dazu gerne eine Auskunft. 

Kontakt:   
Tel: +49 40 300672 - 0    |   Fax: +49 40 300672 - 11   |   E-Mail: info[at]delta.de