B200 SXM6 or H200 SXM5?
Both are dedicated, both are monthly, both open without an identity check. What separates them is memory, bandwidth and $3,385 a month — and which of those matters depends entirely on what you intend to run.
- $11,790/moB200 SXM6, one card
- $8,405/moH200 SXM5, one card
- 180 vs 141 GBmemory per card
- 1.7×bandwidth gap
The short answer
Which one, and when
- Pick the B200 SXM6
- when your model needs more than 141 GB on a single card. That is a threshold, not a preference — below it, the extra $3,385/month buys you nothing.
- Pick the H200 SXM5
- when 141 GB holds your model. It saves $3,385/month, and memory you do not use is memory you paid for.
- Neither, if
- your model does not fit on a single card of either. Sharding costs synchronisation at every layer — see the interconnect guide before buying a multi-GPU node.
Side by side
| B200 SXM6 | H200 SXM5 | Difference | |
|---|---|---|---|
| Architecture | Blackwell | Hopper | Blackwell is newer |
| Memory per card | 180 GB HBM3e | 141 GB HBM3e | 39 GB in favour of the B200 SXM6 |
| Memory bandwidth | 8,000 GB/s | 4,800 GB/s | 1.67× in favour of the B200 SXM6 |
| Form factor | SXM on an HGX board | SXM on an HGX board | Same |
| Node sizes | 4×, 8× | 4×, 8× | Up to 1440 GB in one node |
| From, per month | $11,790 | $8,405 | $3,385/month apart |
Price at every node size
| Node | B200 SXM6 | H200 SXM5 | Total VRAM | |
|---|---|---|---|---|
| 4 × GPU | $11,790/mo | $8,405/mo | 720 GB / 564 GB | B200 SXM6 H200 SXM5 |
| 8 × GPU | $22,351/mo | $15,945/mo | 1440 GB / 1128 GB | B200 SXM6 H200 SXM5 |
What each one holds on a single card
At 8k context, best precision that fits. This is the difference that decides a purchase — not the specification sheet.
Only the B200 SXM6
Nothing. Every model the B200 SXM6 holds on one card, the H200 SXM5 holds too — the difference between them is speed, not capability.
Only the H200 SXM5
Nothing. The B200 SXM6 holds everything the H200 SXM5 does.
Cost per GB and per TB/s
Two ratios that cut through the specification sheet. The first tells you what memory costs; the second what speed costs.
| Card | $/GB of VRAM, per month | $/TB per second, per month | Better at |
|---|---|---|---|
| B200 SXM6 | $65.50 | $1,474 | Bandwidth |
| H200 SXM5 | $59.61 | $1,751 | Memory |
These ratios rank cards; they do not choose one. A card that is cheaper per gigabyte is worthless if it has too few gigabytes to hold your model at all — capacity is a threshold, not a slope. Use them to break a tie between two cards that both fit.
B200 SXM6 against H200 SXM5, in short
Is the B200 SXM6 worth the extra money over the H200 SXM5?
Which one is faster for LLM inference?
Do both come as multi-GPU nodes?
Can I rent either without an identity check?
Other comparisons
Both are racked and waiting, in all 6 data centres.
Whichever you pick, it is monthly, paid in crypto, opened without an identity check and delivered in under 5 minutes.