RunsOnMy ModelsGPUs & MacsBy VRAMBest GPUCan I run…?OllamaStart hereAPI pricesVRAM calculatorNew

Mac M4 Max 128GB vs RTX 5090 for local LLMs

Pick the Mac M4 Max 128GB if you want to run bigger models (it runs 45 of the top 60 vs 43); pick the RTX 5090 if the models you use already fit in it and you want more tokens per second.

Specs that matter for LLMs

Mac M4 Max 128GBRTX 5090
Memory (VRAM)128 GB unified32 GB
Usable for a model (our estimate)96.0 GB30.4 GB
Memory bandwidth546 GB/s1792 GB/s
Launch MSRP—$1,999
Launch $ per GB of memory—$62
Top 60 models that fit (4-bit or better, 8K ctx)4543
…of those at 8-bit or better4434
Largest top-60 model that fitsGLM 4.5 AirQwen3.5 35B A3B
Offload headroom: more top-60 models via llama.cpp CPU offload (≥3 tok/s est., up to 128 GB RAM)n/a: one shared memory pool7 more (1 more below 3 tok/s)

Top 60 = the 60 most-downloaded open models we track. Launch MSRP from vendor announcements; Macs and workstation parts have no single launch price, so none is shown. How we calculate.

Estimated speed on popular models

Best quant that fits at 8K context, with a tokens/sec ceiling from memory bandwidth (real speed is typically 50–80% of it). "Offload" means part of the model sits in system RAM. Estimates, not benchmarks.

ModelNeeds at 4-bitMac M4 Max 128GBRTX 5090
Qwen3 8B6.5 GBF16 · ~33 tok/sF16 · ~109 tok/s
Llama 3.1 8B Instruct6.2 GBF16 · ~34 tok/sF16 · ~112 tok/s
Qwen3 14B10.3 GBF16 · ~18 tok/sQ8_0 · ~114 tok/s
gpt-oss 20B11.8 GBF16 · ~197 tok/sF16 · ~648 tok/s
Gemma 3 27B IT17.3 GBF16 · ~10 tok/sQ6_K · ~81 tok/s
Qwen3 32B21.1 GBF16 · ~8 tok/sQ5_K_M · ~77 tok/s
Qwen3 Coder 30B A3B Instruct18.8 GBF16 · ~91 tok/sQ6_K · ~726 tok/s
Llama 3.3 70B Instruct42.7 GBQ8_0 · ~7 tok/sOffload Q4_K_M, 32 GB RAM · ~1.7–3.3 tok/s
gpt-oss 120B59.6 GBF16 · ~170 tok/sOffload Q4_K_M, 64 GB RAM · ~22–44 tok/s

Models only one of them runs

Only the Mac M4 Max 128GB

Only the RTX 5090

None.

More comparisons

DGX Spark vs Mac M4 Max 128GBMac M4 Max 128GB vs Ryzen AI Max+ 395 128GBRTX 5080 vs RTX 5090RTX 4090 vs RTX 5090RTX 3090 vs RTX 5090DGX Spark vs RTX 5090 All GPU comparisons

See every model on the Mac M4 Max 128GB or the RTX 5090, or try your own settings in the VRAM calculator.