AI models that fit in 8 GB of VRAM
133 of 285 open models we track fit at 4-bit (Q4_K_M) with an 8K context on a 8 GB discrete GPU. About 7.6 GB is usable. 86 of those also fit at 8-bit. Typical 8 GB cards: RTX 4060 8GB, RTX 3070, Intel Arc A750.
GPUs and Macs with 8 GB
Cards and machines in our table with exactly 8 GB of memory. Macs use unified memory, so fewer models fit than on a 8 GB discrete GPU; open the Mac page for the default macOS limits.
RTX 3060 TiRTX 3070RTX 4060RTX 4060 Ti 8GBRTX 5060RX 7600
Models that fit, largest first
Memory needed at 8K context. "Tight" means the model uses 90–100% of usable VRAM. How we calculate.
| Model | Params | Q4_K_M | 4-bit fit | Q8_0 | 8-bit fit |
|---|---|---|---|---|---|
| Llama 3.2 11B Vision Instruct | 11B | 7.4 GB | Tight | 11.6 GB | No |
| GLM 4.6V Flash | 10B | 6.7 GB | Fits | 10.3 GB | No |
| GLM 4.1V 9B Thinking | 10B | 6.7 GB | Fits | 10.3 GB | No |
| Step3 VL 10B | 10B | 6.5 GB | Fits | 9.9 GB | No |
| SenseNova Loop 9B Preview | 9.7B | 6.4 GB | Fits | 10.0 GB | No |
| Qwen3.5 9B | 9.7B | 6.4 GB | Fits | 10.0 GB | No |
| Ornith 1.5 9B | 9.7B | 6.6 GB | Fits | 10.0 GB | No |
| Qwen3.5 9B Base | 9.7B | 6.4 GB | Fits | 10.0 GB | No |
| MiMo V2.6 Distill Qwen 9B | 9.4B | 6.6 GB | Fits | 10.0 GB | No |
| internlm3 8b instruct | 8.8B | 6.0 GB | Fits | 9.7 GB | No |
| granite 4.2 8b | 8.8B | 6.8 GB | Fits | 10.5 GB | No |
| granite 4.1 8b | 8.8B | 6.8 GB | Fits | 10.5 GB | No |
| Qwen3 VL 8B Instruct | 8.8B | 6.5 GB | Fits | 9.9 GB | No |
| Molmo2 8B | 8.7B | 6.5 GB | Fits | 9.9 GB | No |
| LFM2.5 8B A1B | 8.5B MoE | 5.5 GB | Fits | 9.1 GB | No |
| Qwen2.5 VL 7B Instruct | 8.3B | 5.5 GB | Fits | 8.7 GB | No |
| UI TARS 1.5 7B | 8.3B | 5.5 GB | Fits | 8.7 GB | No |
| olmOCR 2 7B 1025 | 8.3B | 5.5 GB | Fits | 8.7 GB | No |
| olmOCR 7B 0225 preview | 8.3B | 5.5 GB | Fits | 8.7 GB | No |
| UI TARS 7B DPO | 8.3B | 5.5 GB | Fits | 8.7 GB | No |
| Qwen3 8B | 8.2B | 6.5 GB | Fits | 9.9 GB | No |
| DeepSeek R1 0528 Qwen3 8B | 8.2B | 6.5 GB | Fits | 9.9 GB | No |
| granite 3.3 8b instruct | 8.2B | 6.3 GB | Fits | 9.8 GB | No |
| granite 3.1 8b instruct | 8.2B | 6.3 GB | Fits | 9.8 GB | No |
| granite 3.2 8b instruct | 8.2B | 6.3 GB | Fits | 9.8 GB | No |
| Apertus 8B Instruct 2509 | 8.1B | 6.4 GB | Fits | 9.6 GB | No |
| Llama 3.1 8B Instruct | 8.0B | 6.2 GB | Fits | 9.6 GB | No |
| Llama 3.1 8B | 8.0B | 6.2 GB | Fits | 9.6 GB | No |
| Hermes 3 Llama 3.1 8B | 8.0B | 6.2 GB | Fits | 9.6 GB | No |
| DeepSeek R1 Distill Llama 8B | 8.0B | 6.2 GB | Fits | 9.6 GB | No |
| Meta Llama 3 8B Instruct | 8.0B | 6.2 GB | Fits | 9.6 GB | No |
| Meta Llama Guard 2 8B | 8.0B | 6.2 GB | Fits | 9.6 GB | No |
| Meta Llama 3.1 8B Instruct | 8.0B | 6.2 GB | Fits | 9.6 GB | No |
| Ling 3.0 tiny | 7.9B MoE | 5.5 GB | Fits | 8.7 GB | No |
| MiMo 7B RL | 7.8B | 6.2 GB | Fits | 9.4 GB | No |
| internlm2 5 7b chat | 7.7B | 6.0 GB | Fits | 9.2 GB | No |
| internlm2 chat 7b | 7.7B | 6.0 GB | Fits | 9.2 GB | No |
| Qwen2.5 7B Instruct | 7.6B | 5.5 GB | Fits | 8.7 GB | No |
| Qwen2.5 Coder 7B Instruct | 7.6B | 5.5 GB | Fits | 8.7 GB | No |
| DeepSeek R1 Distill Qwen 7B | 7.6B | 5.5 GB | Fits | 8.7 GB | No |
| Falcon H1R 7B | 7.6B | 5.3 GB | Fits | 8.5 GB | No |
| Olmo 3 7B Instruct | 7.3B | 7.3 GB | Tight | 10.3 GB | No |
| Olmo 3 1025 7B | 7.3B | 7.3 GB | Tight | 10.3 GB | No |
| Olmo 3 7B Think | 7.3B | 7.3 GB | Tight | 10.3 GB | No |
| Mistral 7B v0.1 | 7.2B | 5.5 GB | Fits | 8.6 GB | No |
| Mistral 7B Instruct v0.1 | 7.2B | 5.5 GB | Fits | 8.6 GB | No |
| granite 4.0 h tiny | 6.9B MoE | 4.6 GB | Fits | 7.5 GB | Tight |
| OLMoE 1B 7B 0924 | 6.9B MoE | 5.4 GB | Fits | 8.4 GB | No |
| Yi 6B 200K | 6.1B | 4.4 GB | Fits | 7.0 GB | Tight |
| Yi 6B | 6.1B | 4.4 GB | Fits | 7.0 GB | Tight |
| Molmo2 4B | 4.9B | 4.3 GB | Fits | 6.2 GB | Fits |
| WeVisOne VL 4B | 4.8B | 4.3 GB | Fits | 6.2 GB | Fits |
| Mage VL Cowork | 4.7B | 4.3 GB | Fits | 6.2 GB | Fits |
| Qianfan OCR | 4.7B | 4.4 GB | Fits | 6.2 GB | Fits |
| Qwen3.5 4B | 4.7B | 3.7 GB | Fits | 5.3 GB | Fits |
| S5 nano | 4.7B | 3.7 GB | Fits | 5.4 GB | Fits |
| LightOnOCR 3 4B | 4.5B | 3.6 GB | Fits | 5.3 GB | Fits |
| SingVL S1 4B | 4.5B | 3.6 GB | Fits | 5.3 GB | Fits |
| Intern Decision 4B | 4.5B | 3.6 GB | Fits | 5.3 GB | Fits |
| Qwen3 VL 4B Instruct | 4.4B | 4.1 GB | Fits | 5.8 GB | Fits |
| gemma 3 4b it | 4.3B | 3.5 GB | Fits | 5.0 GB | Fits |
| medgemma 1.5 4b it | 4.3B | 3.5 GB | Fits | 5.0 GB | Fits |
| medgemma 4b it | 4.3B | 3.5 GB | Fits | 5.0 GB | Fits |
| gemma 3 4b pt | 4.3B | 3.6 GB | Fits | 5.4 GB | Fits |
| Phi 3.5 vision instruct | 4.1B | 5.8 GB | Fits | 7.6 GB | Tight |
| Qwen3 4B | 4.0B | 4.1 GB | Fits | 5.8 GB | Fits |
| Qwen3 4B Instruct 2507 | 4.0B | 4.1 GB | Fits | 5.8 GB | Fits |
| granite vision 4.1 4b | 4.0B | 3.2 GB | Fits | 4.6 GB | Fits |
| Phi 4 mini instruct | 3.8B | 4.1 GB | Fits | 5.6 GB | Fits |
| Phi 3 mini 4k instruct | 3.8B | 5.7 GB | Fits | 7.2 GB | Tight |
| Phi 3.5 mini instruct | 3.8B | 5.7 GB | Fits | 7.2 GB | Tight |
| Phi 3 mini 128k instruct | 3.8B | 5.7 GB | Fits | 7.2 GB | Tight |
| Qwen2.5 VL 3B Instruct | 3.8B | 2.8 GB | Fits | 4.0 GB | Fits |
| granite 4.2 3b | 3.7B | 3.3 GB | Fits | 4.8 GB | Fits |
| granite 4.1 3b llmon preview | 3.7B | 3.3 GB | Fits | 4.8 GB | Fits |
| Raon 1 nano | 3.5B | 3.0 GB | Fits | 4.3 GB | Fits |
| granite 4.1 3b | 3.4B | 3.2 GB | Fits | 4.6 GB | Fits |
| granite 4.0 micro | 3.4B | 3.2 GB | Fits | 4.6 GB | Fits |
| DeepSeek OCR 2 | 3.4B MoE | 2.9 GB | Fits | 4.0 GB | Fits |
| deepseek vl2 tiny | 3.4B MoE | 3.0 GB | Fits | 4.5 GB | Fits |
| Unlimited OCR 2 | 3.3B MoE | 3.0 GB | Fits | 4.0 GB | Fits |
| Unlimited OCR | 3.3B MoE | 2.9 GB | Fits | 4.0 GB | Fits |
| DeepSeek OCR | 3.3B MoE | 2.9 GB | Fits | 4.0 GB | Fits |
| granite 3.1 3b a800m instruct | 3.3B MoE | 2.9 GB | Fits | 4.3 GB | Fits |
| Llama 3.2 3B Instruct | 3.2B | 3.4 GB | Fits | 4.7 GB | Fits |
| Llama 3.2 3B | 3.2B | 3.6 GB | Fits | 5.1 GB | Fits |
| Hermes 3 Llama 3.2 3B | 3.2B | 3.4 GB | Fits | 4.7 GB | Fits |
| d1 3B | 3.1B | 2.3 GB | Fits | 3.4 GB | Fits |
| LFM2.5 VL 3B | 3.1B | 2.3 GB | Fits | 3.4 GB | Fits |
| Qwen2.5 3B Instruct | 3.1B | 2.9 GB | Fits | 4.3 GB | Fits |
| SmolLM3 3B | 3.1B | 3.0 GB | Fits | 4.3 GB | Fits |
| SmolLM3 3B Base | 3.1B | 3.0 GB | Fits | 4.3 GB | Fits |
| phi 2 | 2.8B | 4.7 GB | Fits | 5.8 GB | Fits |
| LFM2.5 2.6B | 2.7B | 2.3 GB | Fits | 3.4 GB | Fits |
| granite 3.3 2b instruct | 2.5B | 2.6 GB | Fits | 3.6 GB | Fits |
| MiniCPM5 2B | 2.5B | 2.5 GB | Fits | 3.5 GB | Fits |
| WeVisOne VL 2B | 2.4B | 2.8 GB | Fits | 3.6 GB | Fits |
| Qwen3.5 2B | 2.3B | 2.2 GB | Fits | 2.8 GB | Fits |
| SmolVLM Instruct | 2.2B | 3.0 GB | Fits | 3.8 GB | Fits |
| Qwen3 1.7B | 2.0B | 2.6 GB | Fits | 3.3 GB | Fits |
| Qwen3.8 27B DSpine b16 | 2.0B | 2.2 GB | Fits | 3.1 GB | Fits |
| d1 2B | 1.9B | 1.8 GB | Fits | 2.5 GB | Fits |
| LFM3 VL 2B | 1.9B | 1.8 GB | Fits | 2.5 GB | Fits |
| DeepSeek R1 Distill Qwen 1.5B | 1.8B | 1.9 GB | Fits | 2.7 GB | Fits |
| LFM3 1.7B | 1.7B | 1.8 GB | Fits | 2.5 GB | Fits |
| LFM3 1.7B Base | 1.7B | 1.7 GB | Fits | 2.5 GB | Fits |
| SmolLM2 1.7B Instruct | 1.7B | 3.0 GB | Fits | 3.7 GB | Fits |
| SmolLM2 1.7B | 1.7B | 3.0 GB | Fits | 3.7 GB | Fits |
| SmolLM 1.7B | 1.7B | 3.0 GB | Fits | 3.7 GB | Fits |
| granite 4.0 1b | 1.6B | 2.2 GB | Fits | 2.8 GB | Fits |
| Qwen2.5 1.5B Instruct | 1.5B | 1.9 GB | Fits | 2.7 GB | Fits |
| OLMo 2 0425 1B | 1.5B | 2.5 GB | Fits | 3.1 GB | Fits |
| deepseek coder 1.3b instruct | 1.3B | 2.8 GB | Fits | 3.3 GB | Fits |
| Llama 3.2 1B | 1.2B | 1.8 GB | Fits | 2.4 GB | Fits |
| Llama 3.2 1B Instruct | 1.2B | 1.6 GB | Fits | 2.1 GB | Fits |
| LFM2.5 1.2B Instruct | 1.2B | 1.3 GB | Fits | 1.8 GB | Fits |
| HunyuanOCR | 1.1B | 2.0 GB | Fits | 2.5 GB | Fits |
| PaddleOCR VL 1.6 | 959M | 1.3 GB | Fits | 1.7 GB | Fits |
| Qwen3.5 0.8B | 873M | 1.5 GB | Fits | 1.7 GB | Fits |
| LightOnOCR 3 0.8B | 853M | 1.5 GB | Fits | 1.7 GB | Fits |
| FastVLM 0.5B | 759M | 1.2 GB | Fits | 1.5 GB | Fits |
| Qwen3 0.6B | 752M | 1.9 GB | Fits | 2.2 GB | Fits |
| GOT OCR2 0 | 716M | 1.8 GB | Fits | 2.1 GB | Fits |
| Nemotron 3.5 Parse | 631M | 1.1 GB | Fits | 1.5 GB | Fits |
| GOT OCR 2.0 hf | 561M | 1.8 GB | Fits | 2.0 GB | Fits |
| SmolVLM2 500M Video Instruct | 507M | 1.1 GB | Fits | 1.2 GB | Fits |
| SmolVLM 500M Instruct | 507M | 1.1 GB | Fits | 1.2 GB | Fits |
| Qwen2.5 0.5B Instruct | 494M | 1.2 GB | Fits | 1.4 GB | Fits |
| LFM2.5 VL 450M | 449M | 0.8 GB | Fits | 1.0 GB | Fits |
| SmolLM2 360M Instruct | 362M | 1.1 GB | Fits | 1.2 GB | Fits |
| SmolLM2 360M | 362M | 1.1 GB | Fits | 1.2 GB | Fits |
| LFM2.5 350M | 354M | 0.8 GB | Fits | 1.0 GB | Fits |
| LFM2 350M | 354M | 1.0 GB | Fits | 1.1 GB | Fits |
Questions
How many AI models fit in 8 GB of VRAM?
133 of the 285 open models we track fit at 4-bit (Q4_K_M) with an 8K context. 86 also fit at 8-bit (Q8_0) at the same context.
What is the largest model that fits in 8 GB?
Of the models we track, the largest that fits at 4-bit with 8K context is Llama 3.2 11B Vision Instruct (11B), needing about 7.4 GB.
How much of 8 GB can a model actually use?
About 7.6 GB. We treat 95% of a discrete GPU's VRAM as usable after driver and display reserve, and a model "fits" when it needs at most 90% of that. The formulas are on the methodology page.
Other VRAM sizes
12 GB16 GB24 GB32 GB48 GB64 GB
A generic 8 GB discrete GPU is modelled with 95% of VRAM usable, the same rule as the rest of the site. For a specific card, including its bandwidth and estimated tokens/sec, open that GPU page. Data: Hugging Face Hub API and vendor spec pages. Report an error.