Two columns deserve a second look. The first is per GPU hour. The eight-GPU node costs €5.2500$6.0900 per card there and is thus only slightly above a single H100 with €2.6575$3.0827. It provides 76% more graphics memory per card and NVLink between all eight.
The second is per 100 TFLOPS. Measured against the manufacturer's specification for computing power, the H100 is the cheapest row in the table at €0.27$0.31. The L40S is the best compromise without HBM at €0.38$0.44 — the stacked high-performance memory that only the H100 class carries. The RTX PRO 6000, on the other hand, buys graphics memory, not throughput at €1.49$1.73: 96 GB for models that would otherwise require two cards. If you need computing power instead of memory, you should know this order before reaching for the largest number.
The path remains the same in both cases. First check whether the model fits into the memory. Then compare the price per computing power. And only then select the card by name.
Calculation basis
- Term in the example
- 72 h
- Billing cycle
- per second
- Location
- Frankfurt am Main (fra1)
- Price factor
- 1.00
- Cap per month
- 730 h
- Included
- Instance, local NVMe, traffic
Billing is per second at the hourly rate, capped at the monthly price — you will never be charged for more than 730 hours a month. The hourly rate is calculated on 730 hours, the average month. A month with 31 days has 744 — we do not charge for the additional hours.