RunsOnMy ModelsGPUs & MacsBy VRAMBest GPUCan I run…?OllamaStart hereAPI pricesVRAM calculatorNew

GPU vs GPU for local LLMs

The comparisons people make most when buying hardware for local AI. Each page uses our own data and formulas: memory, bandwidth, launch MSRP, which of the 60 most-downloaded models fit, speed estimates and offload headroom.

Same generation, next tier up

ComparisonMemoryLaunch MSRPTop-60 models that fit
RTX 4060 Ti 16GB vs RTX 4060 Ti 8GB16 vs 8 GB$499 vs $39932 vs 28
RTX 4060 Ti 16GB vs RTX 407016 vs 12 GB$499 vs $59932 vs 29
RTX 4070 Super vs RTX 4070 Ti Super12 vs 16 GB$599 vs $79929 vs 32
RTX 4080 vs RTX 409016 vs 24 GB$1,199 vs $1,59932 vs 39
RTX 5060 Ti 16GB vs RTX 507016 vs 12 GB$429 vs $54932 vs 29
RTX 5070 Ti vs RTX 508016 vs 16 GB$749 vs $99932 vs 32
RTX 5080 vs RTX 509016 vs 32 GB$999 vs $1,99932 vs 43
RTX 3090 vs RTX 3090 Ti24 vs 24 GB$1,499 vs $1,99939 vs 39

Previous generation vs current

ComparisonMemoryLaunch MSRPTop-60 models that fit
RTX 3060 12GB vs RTX 406012 vs 8 GB$329 vs $29929 vs 28
RTX 3060 12GB vs RTX 4060 Ti 16GB12 vs 16 GB$329 vs $49929 vs 32
RTX 3060 12GB vs RTX 5060 Ti 16GB12 vs 16 GB$329 vs $42929 vs 32
RTX 4060 vs RTX 50608 vs 8 GB$299 vs $29928 vs 28
RTX 4060 Ti 16GB vs RTX 5060 Ti 16GB16 vs 16 GB$499 vs $42932 vs 32
RTX 4070 vs RTX 507012 vs 12 GB$599 vs $54929 vs 29
RTX 4070 Ti Super vs RTX 5070 Ti16 vs 16 GB$799 vs $74932 vs 32
RTX 4080 Super vs RTX 508016 vs 16 GB$999 vs $99932 vs 32
RTX 3080 10GB vs RTX 407010 vs 12 GB$699 vs $59929 vs 29
RTX 3090 vs RTX 4070 Ti Super24 vs 16 GB$1,499 vs $79939 vs 32
RTX 3090 vs RTX 508024 vs 16 GB$1,499 vs $99939 vs 32
RTX 3090 vs RTX 409024 vs 24 GB$1,499 vs $1,59939 vs 39
RTX 4090 vs RTX 509024 vs 32 GB$1,599 vs $1,99939 vs 43
RTX 3090 vs RTX 509024 vs 32 GB$1,499 vs $1,99939 vs 43

AMD and Intel vs NVIDIA

ComparisonMemoryLaunch MSRPTop-60 models that fit
RTX 4090 vs RX 7900 XTX24 vs 24 GB$1,599 vs $99939 vs 39
RTX 3090 vs RX 7900 XTX24 vs 24 GB$1,499 vs $99939 vs 39
RTX 5080 vs RX 7900 XTX16 vs 24 GB$999 vs $99932 vs 39
RTX 5070 Ti vs RX 9070 XT16 vs 16 GB$749 vs $59932 vs 32
RTX 5070 vs RX 907012 vs 16 GB$549 vs $54929 vs 32
RTX 4070 Ti Super vs RX 7900 XT16 vs 20 GB$799 vs $89932 vs 33
RTX 4060 Ti 16GB vs RX 7800 XT16 vs 16 GB$499 vs $49932 vs 32
RTX 4060 vs RX 76008 vs 8 GB$299 vs $26928 vs 28
Arc B580 vs RTX 406012 vs 8 GB$249 vs $29929 vs 28
Arc B580 vs RTX 3060 12GB12 vs 12 GB$249 vs $32929 vs 29
Arc A770 16GB vs RTX 4060 Ti 16GB16 vs 16 GB$349 vs $49932 vs 32

Mac and unified memory vs NVIDIA

ComparisonMemoryLaunch MSRPTop-60 models that fit
Mac M4 Pro 48GB vs RTX 409048 vs 24 GB— vs $1,59943 vs 39
Mac M4 Max 128GB vs RTX 5090128 vs 32 GB— vs $1,99945 vs 43
Mac M4 Pro 24GB vs RTX 4060 Ti 16GB24 vs 16 GB— vs $49932 vs 32
Mac M4 Max 64GB vs RTX 309064 vs 24 GB— vs $1,49943 vs 39
DGX Spark vs RTX 5090128 vs 32 GB$3,999 vs $1,99945 vs 43
DGX Spark vs Mac M4 Max 128GB128 vs 128 GB$3,999 vs —45 vs 45
DGX Spark vs Ryzen AI Max+ 395 128GB128 vs 128 GB$3,999 vs —45 vs 45
Mac M4 Max 128GB vs Ryzen AI Max+ 395 128GB128 vs 128 GB— vs —45 vs 45
2x RTX 3090 vs Mac M3 Ultra 256GB48 vs 256 GB$2,998 vs —43 vs 49

Fit = 4-bit or better with 8K context, under 100% of usable memory. Pair order in the URL is alphabetical, so each comparison has one address. See also best GPU by budget and all GPUs and Macs.