RunsOnMy ModelsGPUs & MacsBy VRAMBest GPUCan I run…?OllamaStart hereAPI pricesVRAM calculatorNew

RTX 3090 vs RTX 4090 for local LLMs

For local LLMs these two are close; let price and the rest of your build decide.

Specs that matter for LLMs

RTX 3090RTX 4090
Memory (VRAM)24 GB24 GB
Usable for a model (our estimate)22.8 GB22.8 GB
Memory bandwidth936 GB/s1008 GB/s
Launch MSRP$1,499$1,599
Launch $ per GB of memory$62$67
Top 60 models that fit (4-bit or better, 8K ctx)3939
…of those at 8-bit or better3232
Largest top-60 model that fitsQwen3 Coder 30B A3B InstructQwen3 Coder 30B A3B Instruct
Offload headroom: more top-60 models via llama.cpp CPU offload (≥3 tok/s est., up to 128 GB RAM)7 more (1 more below 3 tok/s)7 more (1 more below 3 tok/s)

Top 60 = the 60 most-downloaded open models we track. Launch MSRP from vendor announcements. How we calculate.

Estimated speed on popular models

Best quant that fits at 8K context, with a tokens/sec ceiling from memory bandwidth (real speed is typically 50–80% of it). "Offload" means part of the model sits in system RAM. Estimates, not benchmarks.

ModelNeeds at 4-bitRTX 3090RTX 4090
Qwen3 8B6.5 GBF16 · ~57 tok/sF16 · ~62 tok/s
Llama 3.1 8B Instruct6.2 GBF16 · ~58 tok/sF16 · ~63 tok/s
Qwen3 14B10.3 GBQ8_0 · ~60 tok/sQ8_0 · ~64 tok/s
gpt-oss 20B11.8 GBF16 · ~338 tok/sF16 · ~365 tok/s
Gemma 3 27B IT17.3 GBQ5_K_M · ~49 tok/sQ5_K_M · ~52 tok/s
Qwen3 32B21.1 GBQ3_K_M only (below 4-bit)Q3_K_M only (below 4-bit)
Qwen3 Coder 30B A3B Instruct18.8 GBQ4_K_M · ~511 tok/sQ4_K_M · ~551 tok/s
Llama 3.3 70B Instruct42.7 GBOffload Q4_K_M, 32 GB RAM · ~1.1–2.2 tok/sOffload Q4_K_M, 32 GB RAM · ~1.1–2.2 tok/s
gpt-oss 120B59.6 GBOffload Q4_K_M, 64 GB RAM · ~17–34 tok/sOffload Q4_K_M, 64 GB RAM · ~17–34 tok/s

Models only one of them runs

None: of the top 60, both fit exactly the same models at 4-bit or better with 8K context.

More comparisons

RTX 3090 vs RTX 3090 TiRTX 3090 vs RTX 4070 Ti SuperRTX 3090 vs RTX 5080RTX 3090 vs RTX 5090RTX 3090 vs RX 7900 XTXMac M4 Max 64GB vs RTX 3090RTX 4080 vs RTX 4090RTX 4090 vs RTX 5090 All GPU comparisons

See every model on the RTX 3090 or the RTX 4090, or try your own settings in the VRAM calculator.