L40S or RTX A6000?
Both are dedicated, both are monthly, both open without an identity check. What separates them is memory, bandwidth and $428 a month — and which of those matters depends entirely on what you intend to run.
- $714/moL40S, one card
- $286/moRTX A6000, one card
- 48 vs 48 GBmemory per card
- 1.1×bandwidth gap
The short answer
Which one, and when
- Pick the L40S
- when throughput matters. Same 48 GB, but 13% more memory bandwidth — which is what sets generation speed — for $428/month more.
- Pick the RTX A6000
- when the L40S offers you nothing you need. Same memory, comparable bandwidth, $428/month cheaper.
- Neither, if
- your model does not fit on a single card of either. Sharding costs synchronisation at every layer — see the interconnect guide before buying a multi-GPU node.
Side by side
| L40S | RTX A6000 | Difference | |
|---|---|---|---|
| Architecture | Ada Lovelace | Ampere | Ada Lovelace is a different generation |
| Memory per card | 48 GB GDDR6 ECC | 48 GB GDDR6 ECC | Identical |
| Memory bandwidth | 864 GB/s | 768 GB/s | 1.13× in favour of the L40S |
| Form factor | PCIe add-in card | PCIe add-in card | Same |
| Node sizes | 1×, 2×, 4×, 8× | 1×, 2×, 4×, 8× | Up to 384 GB in one node |
| From, per month | $714 | $286 | $428/month apart |
Price at every node size
| Node | L40S | RTX A6000 | Total VRAM | |
|---|---|---|---|---|
| 1 × GPU | $714/mo | $286/mo | 48 GB / 48 GB | L40S RTX A6000 |
| 2 × GPU | $1,427/mo | $597/mo | 96 GB / 96 GB | L40S RTX A6000 |
| 4 × GPU | $2,754/mo | $1,163/mo | 192 GB / 192 GB | L40S RTX A6000 |
| 8 × GPU | $5,251/mo | $2,239/mo | 384 GB / 384 GB | L40S RTX A6000 |
What each one holds on a single card
At 8k context, best precision that fits. This is the difference that decides a purchase — not the specification sheet.
Only the L40S
Nothing. Every model the L40S holds on one card, the RTX A6000 holds too — the difference between them is speed, not capability.
Only the RTX A6000
Nothing. The L40S holds everything the RTX A6000 does.
Cost per GB and per TB/s
Two ratios that cut through the specification sheet. The first tells you what memory costs; the second what speed costs.
| Card | $/GB of VRAM, per month | $/TB per second, per month | Better at |
|---|---|---|---|
| L40S | $14.88 | $714 | Neither |
| RTX A6000 | $5.96 | $286 | Both ratios |
These ratios rank cards; they do not choose one. A card that is cheaper per gigabyte is worthless if it has too few gigabytes to hold your model at all — capacity is a threshold, not a slope. Use them to break a tie between two cards that both fit.
L40S against RTX A6000, in short
Is the L40S worth the extra money over the RTX A6000?
Which one is faster for LLM inference?
Do both come as multi-GPU nodes?
Can I rent either without an identity check?
Other comparisons
Both are racked and waiting, in all 6 data centres.
Whichever you pick, it is monthly, paid in crypto, opened without an identity check and delivered in under 5 minutes.