All 6 data centres operational

Paid in crypto · No identity check · Root access in under 5 minutes

Comparison · The generational jump, on the same board

H100 SXM5 or A100 SXM4?

Both are dedicated, both are monthly, both open without an identity check. What separates them is memory, bandwidth and $1,666 a month — and which of those matters depends entirely on what you intend to run.

  • $6,061/moH100 SXM5, one card
  • $4,395/moA100 SXM4, one card
  • 80 vs 80 GBmemory per card
  • 1.6×bandwidth gap

The short answer

Which one, and when

Pick the H100 SXM5
when throughput matters. Same 80 GB, but 64% more memory bandwidth — which is what sets generation speed — for $1,666/month more.
Pick the A100 SXM4
when the H100 SXM5 offers you nothing you need. Same memory, comparable bandwidth, $1,666/month cheaper.
Neither, if
your model does not fit on a single card of either. Sharding costs synchronisation at every layer — see the interconnect guide before buying a multi-GPU node.

Side by side

H100 SXM5 compared with A100 SXM4
H100 SXM5 A100 SXM4 Difference
ArchitectureHopperAmpere Hopper is a different generation
Memory per card 80 GB HBM3 80 GB HBM2e Identical
Memory bandwidthPredicts generation speed 3,350 GB/s 2,039 GB/s 1.64× in favour of the H100 SXM5
Form factor SXM on an HGX board SXM on an HGX board Same
Node sizes 4×, 8× 4×, 8× Up to 640 GB in one node
From, per month $6,061 $4,395 $1,666/month apart

Price at every node size

Monthly price of both cards at each available node size
NodeH100 SXM5A100 SXM4Total VRAM
4 × GPU $6,061/mo $4,395/mo 320 GB / 320 GB H100 SXM5 A100 SXM4
8 × GPU $11,509/mo $8,355/mo 640 GB / 640 GB H100 SXM5 A100 SXM4

What each one holds on a single card

At 8k context, best precision that fits. This is the difference that decides a purchase — not the specification sheet.

Only the H100 SXM5

Nothing. Every model the H100 SXM5 holds on one card, the A100 SXM4 holds too — the difference between them is speed, not capability.

Only the A100 SXM4

Nothing. The H100 SXM5 holds everything the A100 SXM4 does.

The same model on both: Llama 3.3 70B. On the H100 SXM5, roughly 43 tokens/second at 4-bit (AWQ, GPTQ); on the A100 SXM4, roughly 26. Single-stream and deliberately conservative — with continuous batching the aggregate is several times higher on both. Treat the ratio as the useful number, not the absolute.

Cost per GB and per TB/s

Two ratios that cut through the specification sheet. The first tells you what memory costs; the second what speed costs.

Cost per gigabyte of VRAM and per terabyte per second of bandwidth
Card$/GB of VRAM, per month$/TB per second, per monthBetter at
H100 SXM5 $75.76 $1,809 Bandwidth
A100 SXM4 $54.94 $2,155 Memory

These ratios rank cards; they do not choose one. A card that is cheaper per gigabyte is worthless if it has too few gigabytes to hold your model at all — capacity is a threshold, not a slope. Use them to break a tie between two cards that both fit.

H100 SXM5 against A100 SXM4, in short

Is the H100 SXM5 worth the extra money over the A100 SXM4?
It costs $1,666 more a month — 38% — for 64% more memory bandwidth. Both hold the same set of models on a single card, so the difference is speed rather than capability.
Which one is faster for LLM inference?
Generation speed is bounded by memory bandwidth, because each token requires re-reading the active weights. The H100 SXM5 has 3,350 GB/s against 2,039 GB/s, so the H100 SXM5 leads by roughly 64% on a model both of them hold.
Do both come as multi-GPU nodes?
H100 SXM5: 4×, 8×. A100 SXM4: 4×, 8×. SXM cards live on an HGX board of four or eight — never two, never ten — and are joined by NVLink rather than PCIe.
Can I rent either without an identity check?
Yes, both, on the same terms. No document, no selfie, no phone number and no company registration, at any level of spend. Payment is in cryptocurrency, each invoice gets its own address, and root access arrives under 5 minutes after the first confirmation.

Other comparisons

Both are racked and waiting, in all 6 data centres.

Whichever you pick, it is monthly, paid in crypto, opened without an identity check and delivered in under 5 minutes.

Open the configuratorRead the guides

Sign in

Console, invoices and out-of-band access.

No account yet?

There is no separate sign-up. Your account is created while you place your first order — you choose the email and the password on the payment step, and the console is open by the time the machine is.

Configure a server

Language