DGX Spark vs RTX 5090 for local LLMs
Pick the DGX Spark if you want to run bigger models (it runs 45 of the top 60 vs 43); pick the RTX 5090 if the models you use already fit in it and you want more tokens per second.
- The DGX Spark runs more of the 60 most-downloaded models fully in memory at 4-bit or better: 45 vs 43, because it has more usable memory (about 109 GB vs 30 GB).
- At near-lossless 8-bit or better, the DGX Spark runs 44 of them vs 34.
- At the same quant, the RTX 5090 has a 6.6× higher speed ceiling (memory bandwidth 1792 vs 273 GB/s). The speed table below shows each card's best quant that fits, so a card with more memory can show a slower, higher-quality setting.
- The RTX 5090 launched at $1,999 vs $3,999 for the DGX Spark (launch MSRP; street prices differ).
Specs that matter for LLMs
| DGX Spark | RTX 5090 | |
|---|---|---|
| Memory (VRAM) | 128 GB unified | 32 GB |
| Usable for a model (our estimate) | 108.8 GB | 30.4 GB |
| Memory bandwidth | 273 GB/s | 1792 GB/s |
| Launch MSRP | $3,999 | $1,999 |
| Launch $ per GB of memory | $31 | $62 |
| Top 60 models that fit (4-bit or better, 8K ctx) | 45 | 43 |
| …of those at 8-bit or better | 44 | 34 |
| Largest top-60 model that fits | GLM 4.5 Air | Qwen3.5 35B A3B |
| Offload headroom: more top-60 models via llama.cpp CPU offload (≥3 tok/s est., up to 128 GB RAM) | n/a: one shared memory pool | 7 more (1 more below 3 tok/s) |
Top 60 = the 60 most-downloaded open models we track. Launch MSRP from vendor announcements. How we calculate.
Estimated speed on popular models
Best quant that fits at 8K context, with a tokens/sec ceiling from memory bandwidth (real speed is typically 50–80% of it). "Offload" means part of the model sits in system RAM. Estimates, not benchmarks.
Models only one of them runs
Only the DGX Spark
- gpt-oss 120B (117B, 59.6 GB at 4-bit)
- GLM 4.5 Air (110B, 70.6 GB at 4-bit)
Only the RTX 5090
None.
More comparisons
DGX Spark vs Mac M4 Max 128GBDGX Spark vs Ryzen AI Max+ 395 128GBRTX 5080 vs RTX 5090RTX 4090 vs RTX 5090RTX 3090 vs RTX 5090Mac M4 Max 128GB vs RTX 5090 All GPU comparisons
See every model on the DGX Spark or the RTX 5090, or try your own settings in the VRAM calculator.