RunsOnMy ModelsGPUs & MacsBy VRAMBest GPUCan I run…?API pricesVRAM calculatorNew

Can I run Llama 70B on my PC?

Llama 3.3 70B Instruct (71B) needs about 43.3 GB of GPU memory at 4-bit with an 8K context. No single consumer GPU we track runs it fully in VRAM at 4-bit. With llama.cpp offload, the smallest card that can run it is the RX 7600 with 64 GB of system RAM, at an estimated 0.6–1.3 tokens/sec (very slow: fine for batch jobs, painful for chat). The smallest Mac that runs it is the Mac M2 Max 96GB.

43.3 GBneeded at 4-bit, 8K
8GPUs/Macs: fully in memory
33GPUs: with CPU offload
M2 Max 96GBsmallest Mac

Every Llama 70B model we track

Cheapest consumer GPU (launch MSRP) and smallest Mac that run each model fully in memory at 4-bit or better with 8K context.

ModelParams4-bit · 8KCheapest GPUSmallest Mac
Llama 3.3 70B Instruct71B43.3 GBnone in VRAMMac M2 Max 96GB
Llama 3.1 70B Instruct71B42.7 GBnone in VRAMMac M4 Max 64GB
Meta Llama 3 70B Instruct71B43.3 GBnone in VRAMMac M2 Max 96GB
DeepSeek R1 Distill Llama 70B71B43.3 GBnone in VRAMMac M2 Max 96GB
Llama 3.1 70B71B42.7 GBnone in VRAMMac M4 Max 64GB

Llama 3.3 70B Instruct on every GPU and Mac

Best quant that fits fully in memory at 8K context with a speed ceiling; otherwise the llama.cpp offload plan (system RAM needed, estimated speed from DDR4-3200 to DDR5-6000). Macs and unified-memory PCs share one pool, so offload adds nothing there. How offload is estimated.

HardwareMemoryVerdictDetails
RX 76008 GBOffload Q4_K_M, 64 GB RAM · ~0.6–1.3 tok/sdetails
RTX 40608 GBOffload Q4_K_M, 64 GB RAM · ~0.6–1.3 tok/sdetails
RTX 50608 GBOffload Q4_K_M, 64 GB RAM · ~0.6–1.3 tok/sdetails
RTX 3060 Ti8 GBOffload Q4_K_M, 64 GB RAM · ~0.6–1.3 tok/sdetails
RTX 4060 Ti 8GB8 GBOffload Q4_K_M, 64 GB RAM · ~0.6–1.3 tok/sdetails
RTX 30708 GBOffload Q4_K_M, 64 GB RAM · ~0.6–1.3 tok/sdetails
RTX 3080 10GB10 GBOffload Q4_K_M, 64 GB RAM · ~0.7–1.3 tok/sdetails
Arc B58012 GBOffload Q4_K_M, 64 GB RAM · ~0.7–1.4 tok/sdetails
RTX 3060 12GB12 GBOffload Q4_K_M, 64 GB RAM · ~0.7–1.4 tok/sdetails
RX 7700 XT12 GBOffload Q4_K_M, 64 GB RAM · ~0.7–1.4 tok/sdetails
RTX 507012 GBOffload Q4_K_M, 64 GB RAM · ~0.7–1.4 tok/sdetails
RTX 407012 GBOffload Q4_K_M, 64 GB RAM · ~0.7–1.4 tok/sdetails
RTX 4070 Super12 GBOffload Q4_K_M, 64 GB RAM · ~0.7–1.4 tok/sdetails
RTX 4070 Ti12 GBOffload Q4_K_M, 64 GB RAM · ~0.7–1.4 tok/sdetails
RTX 3080 12GB12 GBOffload Q4_K_M, 64 GB RAM · ~0.7–1.4 tok/sdetails
Arc A770 16GB16 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RTX 5060 Ti 16GB16 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.5 tok/sdetails
RTX 4060 Ti 16GB16 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.5 tok/sdetails
RX 7800 XT16 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RX 7900 GRE16 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RX 907016 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RX 9070 XT16 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RTX 5070 Ti16 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RTX 4070 Ti Super16 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RTX 4080 Super16 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RTX 508016 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RTX 408016 GBOffload Q4_K_M, 64 GB RAM · ~0.8–1.6 tok/sdetails
RX 7900 XT20 GBOffload Q4_K_M, 32 GB RAM · ~0.9–1.8 tok/sdetails
RX 7900 XTX24 GBOffload Q4_K_M, 32 GB RAM · ~1.0–2.1 tok/sdetails
RTX 309024 GBOffload Q4_K_M, 32 GB RAM · ~1.0–2.1 tok/sdetails
RTX 409024 GBOffload Q4_K_M, 32 GB RAM · ~1.0–2.1 tok/sdetails
RTX 3090 Ti24 GBOffload Q4_K_M, 32 GB RAM · ~1.0–2.1 tok/sdetails
RTX 509032 GBOffload Q4_K_M, 32 GB RAM · ~1.6–3.2 tok/sdetails
DGX Spark128 GBQ8_0 · ~4 tok/sdetails
Ryzen AI Max+ 395 128GB128 GBQ8_0 · ~3 tok/sdetails
Mac M1 16GB16 GBNodetails
Mac M4 16GB16 GBNodetails
Mac M2 24GB24 GBNodetails
Mac M3 24GB24 GBNodetails
Mac M4 Pro 24GB24 GBNodetails
Mac M4 32GB32 GBNodetails
Mac M1 Pro 32GB32 GBNodetails
Mac M3 Pro 36GB36 GBNodetails
Mac M4 Pro 48GB48 GBQ2_K only (below 4-bit)details
Mac M4 Pro 64GB64 GBQ3_K_M only (below 4-bit)details
Mac M1 Max 64GB64 GBQ3_K_M only (below 4-bit)details
Mac M4 Max 64GB64 GBQ3_K_M only (below 4-bit)details
Mac M2 Max 96GB96 GBQ6_K · ~7 tok/sdetails
Mac M3 Max 128GB128 GBQ8_0 · ~5 tok/sdetails
Mac M4 Max 128GB128 GBQ8_0 · ~7 tok/sdetails
Mac M2 Ultra 192GB192 GBQ8_0 · ~11 tok/sdetails
Mac M3 Ultra 256GB256 GBF16 · ~6 tok/sdetails
Mac M3 Ultra 512GB512 GBF16 · ~6 tok/sdetails

Questions

How much VRAM do I need for Llama 3.3 70B Instruct?

About 43.3 GB at 4-bit (Q4_K_M) with an 8K context, including KV cache and runtime overhead. Longer contexts need more; the model page has the full table by quant and context.

Other popular checks: Can I run gpt-oss-120b?Can I run gpt-oss-20b?Can I run Qwen3?Can I run DeepSeek R1? · Best GPU by budget · Mac vs PC

Model data: Hugging Face Hub API and GGUF file sizes. GPU specs: vendor pages. Speeds are estimates, not benchmarks. Methodology · Report an error.