| Kimi VL A3B Thinking 2506 | 16B (3.0B act.) | Q2_K | 6.7 GB | Q2_K | 256 | details |
| Kimi VL A3B Instruct | 16B (3.0B act.) | Q2_K | 7.1 GB | no | 239 | details |
| Kimi VL A3B Thinking | 16B (3.0B act.) | Q2_K | 6.7 GB | Q2_K | 256 | details |
| LLaDA2.1 mini | 16B (1.4B act.) | Q2_K | 6.7 GB | no | 536 | details |
| Moonlight 16B A3B Instruct | 16B (3.0B act.) | Q2_K | 7.1 GB | no | 233 | details |
| DeepSeek Coder V2 Lite Instruct | 16B (2.7B act.) | Q2_K | 6.3 GB | Q2_K | 289 | details |
| DeepSeek V2 Lite | 16B (2.7B act.) | Q2_K | 6.8 GB | Q2_K | 264 | details |
| DeepSeek V2 Lite Chat | 16B (2.7B act.) | Q2_K | 6.8 GB | Q2_K | 264 | details |
| Qwen2.5 Coder 14B Instruct | 15B | Q2_K | 7.3 GB | no | 52 | details |
| DeepSeek R1 Distill Qwen 14B | 15B | Q2_K | 7.6 GB | no | 50 | details |
| Qwen3 14B | 15B | Q2_K | 7.1 GB | no | 52 | details |
| phi 4 | 15B | Q2_K | 7.4 GB | no | 51 | details |
| gemma 3 12b it | 12B | Q2_K | 6.2 GB | no | 60 | details |
| Llama Guard 4 12B | 12B | Q2_K | 6.5 GB | no | 64 | details |
| Llama 3.2 11B Vision Instruct | 11B | Q3_K_M | 6.8 GB | no | 55 | details |
| Llama 3.2 11B Vision | 11B | Q3_K_M | 6.7 GB | no | 55 | details |
| GLM 4.6V Flash | 10B | Q4_K_M | 6.7 GB | Q3_K_M | 47 | details |
| GLM 4.1V 9B Thinking | 10B | Q4_K_M | 6.7 GB | Q3_K_M | 47 | details |
| Step3 VL 10B | 10B | Q4_K_M | 6.5 GB | no | 57 | details |
| SenseNova Loop 9B Preview | 9.7B | Q4_K_M | 6.4 GB | Q3_K_M | 51 | details |
| Qwen3.5 9B | 9.7B | Q4_K_M | 6.4 GB | Q3_K_M | 51 | details |
| Ornith 1.5 9B | 9.7B | Q4_K_M | 6.6 GB | Q3_K_M | 49 | details |
| Qwen3.5 9B Base | 9.7B | Q4_K_M | 6.4 GB | Q3_K_M | 51 | details |
| MiMo V2.6 Distill Qwen 9B | 9.4B | Q4_K_M | 6.6 GB | Q3_K_M | 49 | details |
| internlm3 8b instruct | 8.8B | Q4_K_M | 6.0 GB | Q3_K_M | 54 | details |
| granite 4.2 8b | 8.8B | Q4_K_M | 6.8 GB | no | 54 | details |
| granite 4.1 8b | 8.8B | Q4_K_M | 6.8 GB | no | 54 | details |
| Qwen3 VL 8B Instruct | 8.8B | Q4_K_M | 6.5 GB | no | 57 | details |
| Molmo2 8B | 8.7B | Q4_K_M | 6.5 GB | no | 57 | details |
| LFM2.5 8B A1B | 8.5B (1.0B act.) | Q5_K_M | 6.4 GB | Q5_K_M | 404 | details |
| Qwen2.5 VL 7B Instruct | 8.3B | Q5_K_M | 6.2 GB | Q4_K_M | 53 | details |
| UI TARS 1.5 7B | 8.3B | Q5_K_M | 6.2 GB | Q4_K_M | 53 | details |
| olmOCR 2 7B 1025 | 8.3B | Q5_K_M | 6.2 GB | Q4_K_M | 53 | details |
| olmOCR 7B 0225 preview | 8.3B | Q5_K_M | 6.2 GB | Q4_K_M | 53 | details |
| UI TARS 7B DPO | 8.3B | Q5_K_M | 6.2 GB | Q4_K_M | 53 | details |
| Qwen3 8B | 8.2B | Q4_K_M | 6.5 GB | no | 57 | details |
| DeepSeek R1 0528 Qwen3 8B | 8.2B | Q4_K_M | 6.5 GB | no | 57 | details |
| granite 3.3 8b instruct | 8.2B | Q4_K_M | 6.3 GB | no | 58 | details |
| granite 3.1 8b instruct | 8.2B | Q4_K_M | 6.3 GB | no | 58 | details |
| granite 3.2 8b instruct | 8.2B | Q4_K_M | 6.3 GB | no | 58 | details |
| Apertus 8B Instruct 2509 | 8.1B | Q4_K_M | 6.4 GB | no | 57 | details |
| Llama 3.1 8B Instruct | 8.0B | Q4_K_M | 6.2 GB | no | 59 | details |
| Llama 3.1 8B | 8.0B | Q4_K_M | 6.2 GB | Q2_K | 59 | details |
| Hermes 3 Llama 3.1 8B | 8.0B | Q4_K_M | 6.2 GB | no | 59 | details |
| DeepSeek R1 Distill Llama 8B | 8.0B | Q4_K_M | 6.2 GB | no | 59 | details |
| Meta Llama 3 8B Instruct | 8.0B | Q4_K_M | 6.2 GB | no | 59 | details |
| Meta Llama Guard 2 8B | 8.0B | Q4_K_M | 6.2 GB | no | 59 | details |
| Meta Llama 3.1 8B Instruct | 8.0B | Q4_K_M | 6.2 GB | Q2_K | 59 | details |
| Ling 3.0 tiny | 7.9B (1.4B act.) | Q5_K_M | 6.2 GB | Q4_K_M | 288 | details |
| MiMo 7B RL | 7.8B | Q4_K_M | 6.2 GB | no | 61 | details |
| internlm2 5 7b chat | 7.7B | Q5_K_M | 6.7 GB | Q2_K | 52 | details |
| internlm2 chat 7b | 7.7B | Q5_K_M | 6.7 GB | Q2_K | 52 | details |
| Qwen2.5 7B Instruct | 7.6B | Q5_K_M | 6.2 GB | Q4_K_M | 53 | details |
| Qwen2.5 Coder 7B Instruct | 7.6B | Q5_K_M | 6.2 GB | Q4_K_M | 53 | details |
| DeepSeek R1 Distill Qwen 7B | 7.6B | Q5_K_M | 6.2 GB | Q4_K_M | 53 | details |
| Falcon H1R 7B | 7.6B | Q6_K | 6.8 GB | Q4_K_M | 46 | details |
| Olmo 3 7B Instruct | 7.3B | Q3_K_M | 6.5 GB | no | 79 | details |
| Olmo 3 1025 7B | 7.3B | Q3_K_M | 6.4 GB | no | 81 | details |
| Olmo 3 7B Think | 7.3B | Q3_K_M | 6.5 GB | no | 79 | details |
| Mistral 7B v0.1 | 7.2B | Q5_K_M | 6.2 GB | Q2_K | 56 | details |
| Mistral 7B Instruct v0.2 | 7.2B | Q5_K_M | 6.3 GB | no | 56 | details |
| Mistral 7B Instruct v0.1 | 7.2B | Q5_K_M | 6.2 GB | Q2_K | 56 | details |
| granite 4.0 h tiny | 6.9B (1.5B act.) | Q6_K | 6.0 GB | Q6_K | 239 | details |
| OLMoE 1B 7B 0924 | 6.9B (1.3B act.) | Q6_K | 6.8 GB | Q2_K | 273 | details |
| deepseek coder 7b instruct v1.5 | 6.9B | Q3_K_M | 7.6 GB | no | 83 | details |
| deepseek coder 6.7b instruct | 6.7B | Q3_K_M | 7.5 GB | no | 87 | details |
| deepseek coder 6.7b base | 6.7B | Q2_K | 6.8 GB | no | 114 | details |
| Llama 2 7b hf | 6.7B | Q2_K | 6.8 GB | no | 114 | details |
| Yi 6B 200K | 6.1B | Q6_K | 5.7 GB | Q5_K_M | 58 | details |
| Yi 6B | 6.1B | Q6_K | 5.7 GB | Q5_K_M | 58 | details |
| Molmo2 4B | 4.9B | Q8_0 | 6.2 GB | Q3_K_M | 61 | details |
| WeVisOne VL 4B | 4.8B | Q8_0 | 6.2 GB | Q3_K_M | 61 | details |
| Mage VL Cowork | 4.7B | Q8_0 | 6.2 GB | Q3_K_M | 61 | details |
| Qianfan OCR | 4.7B | Q8_0 | 6.2 GB | Q3_K_M | 61 | details |
| Qwen3.5 4B | 4.7B | Q8_0 | 5.3 GB | Q8_0 | 64 | details |
| S5 nano | 4.7B | Q8_0 | 5.4 GB | Q8_0 | 62 | details |
| LightOnOCR 3 4B | 4.5B | Q8_0 | 5.3 GB | Q8_0 | 64 | details |
| SingVL S1 4B | 4.5B | Q8_0 | 5.3 GB | Q8_0 | 64 | details |
| Intern Decision 4B | 4.5B | Q8_0 | 5.3 GB | Q8_0 | 64 | details |
| Qwen3 VL 4B Instruct | 4.4B | Q8_0 | 5.8 GB | Q2_K | 67 | details |
| gemma 3 4b it | 4.3B | Q8_0 | 5.0 GB | Q8_0 | 70 | details |
| medgemma 1.5 4b it | 4.3B | Q8_0 | 5.0 GB | Q8_0 | 70 | details |
| medgemma 4b it | 4.3B | Q8_0 | 5.0 GB | Q8_0 | 70 | details |
| gemma 3 4b pt | 4.3B | Q8_0 | 5.4 GB | Q8_0 | 63 | details |
| Phi 3.5 vision instruct | 4.1B | Q6_K | 6.6 GB | no | 85 | details |
| Qwen3 4B | 4.0B | Q8_0 | 5.8 GB | Q2_K | 67 | details |
| Qwen3 4B Instruct 2507 | 4.0B | Q8_0 | 5.8 GB | Q2_K | 67 | details |
| granite vision 4.1 4b | 4.0B | Q8_0 | 4.6 GB | Q8_0 | 80 | details |
| Phi 4 mini instruct | 3.8B | Q8_0 | 5.6 GB | Q3_K_M | 71 | details |
| Phi 3 mini 4k instruct | 3.8B | Q6_K | 6.4 GB | no | 92 | details |
| Phi 3.5 mini instruct | 3.8B | Q6_K | 6.4 GB | no | 92 | details |
| Phi 3 mini 128k instruct | 3.8B | Q6_K | 6.4 GB | no | 92 | details |
| Qwen2.5 VL 3B Instruct | 3.8B | F16 | 6.7 GB | Q8_0 | 47 | details |
| granite 4.2 3b | 3.7B | Q8_0 | 4.8 GB | Q8_0 | 74 | details |
| granite 4.1 3b llmon preview | 3.7B | Q8_0 | 4.8 GB | Q8_0 | 74 | details |
| Raon 1 nano | 3.5B | Q8_0 | 4.3 GB | Q8_0 | 85 | details |
| granite 4.1 3b | 3.4B | Q8_0 | 4.6 GB | Q8_0 | 80 | details |
| granite 4.0 micro | 3.4B | Q8_0 | 4.6 GB | Q8_0 | 80 | details |
| DeepSeek OCR 2 | 3.4B (1.2B act.) | F16 | 6.6 GB | Q8_0 | 139 | details |
| deepseek vl2 tiny | 3.4B (1.2B act.) | Q8_0 | 4.5 GB | Q8_0 | 231 | details |
| Unlimited OCR 2 | 3.3B (1.1B act.) | F16 | 6.6 GB | Q8_0 | 142 | details |
| Unlimited OCR | 3.3B (1.1B act.) | F16 | 6.6 GB | Q8_0 | 143 | details |
| DeepSeek OCR | 3.3B (1.1B act.) | F16 | 6.6 GB | Q8_0 | 143 | details |
| granite 3.1 3b a800m instruct | 3.3B (883M act.) | Q8_0 | 4.3 GB | Q8_0 | 306 | details |
| Llama 3.2 3B Instruct | 3.2B | Q8_0 | 4.7 GB | Q6_K | 84 | details |
| Llama 3.2 3B | 3.2B | Q8_0 | 5.1 GB | Q5_K_M | 75 | details |
| Hermes 3 Llama 3.2 3B | 3.2B | Q8_0 | 4.7 GB | Q6_K | 84 | details |
| d1 3B | 3.1B | Q8_0 | 3.4 GB | Q8_0 | 100 | details |
| LFM2.5 VL 3B | 3.1B | Q8_0 | 3.4 GB | Q8_0 | 100 | details |
| Qwen2.5 3B Instruct | 3.1B | F16 | 6.7 GB | Q8_0 | 47 | details |
| SmolLM3 3B | 3.1B | Q8_0 | 4.3 GB | Q8_0 | 88 | details |
| SmolLM3 3B Base | 3.1B | Q8_0 | 4.3 GB | Q8_0 | 88 | details |
| phi 2 | 2.8B | Q8_0 | 5.8 GB | no | 97 | details |
| LFM2.5 2.6B | 2.7B | Q8_0 | 3.4 GB | Q8_0 | 100 | details |
| granite 3.3 2b instruct | 2.5B | F16 | 5.8 GB | Q8_0 | 57 | details |
| MiniCPM5 2B | 2.5B | F16 | 5.7 GB | F16 | 57 | details |
| WeVisOne VL 2B | 2.4B | F16 | 5.4 GB | Q8_0 | 71 | details |
| Qwen3.5 2B | 2.3B | F16 | 4.5 GB | F16 | 76 | details |
| SmolVLM Instruct | 2.2B | F16 | 5.4 GB | Q4_K_M | 79 | details |
| Qwen3 1.7B | 2.0B | F16 | 4.8 GB | Q8_0 | 84 | details |
| Qwen3.8 27B DSpine b16 | 2.0B | F16 | 4.8 GB | F16 | 71 | details |
| d1 2B | 1.9B | Q8_0 | 2.5 GB | Q8_0 | 156 | details |
| LFM3 VL 2B | 1.9B | Q8_0 | 2.5 GB | Q8_0 | 156 | details |
| DeepSeek R1 Distill Qwen 1.5B | 1.8B | F16 | 4.2 GB | F16 | 81 | details |
| LFM3 1.7B | 1.7B | Q8_0 | 2.5 GB | Q8_0 | 156 | details |
| LFM3 1.7B Base | 1.7B | F16 | 4.0 GB | F16 | 83 | details |
| SmolLM2 1.7B Instruct | 1.7B | F16 | 5.2 GB | Q4_K_M | 84 | details |
| SmolLM2 1.7B | 1.7B | F16 | 5.2 GB | Q4_K_M | 84 | details |
| SmolLM 1.7B | 1.7B | F16 | 5.2 GB | Q4_K_M | 84 | details |
| granite 4.0 1b | 1.6B | F16 | 4.3 GB | F16 | 88 | details |
| Qwen2.5 1.5B Instruct | 1.5B | F16 | 3.8 GB | F16 | 93 | details |
| OLMo 2 0425 1B | 1.5B | F16 | 4.4 GB | Q8_0 | 97 | details |
| deepseek coder 1.3b instruct | 1.3B | F16 | 4.5 GB | Q6_K | 107 | details |
| Llama 3.2 1B | 1.2B | F16 | 3.2 GB | F16 | 117 | details |
| Llama 3.2 1B Instruct | 1.2B | F16 | 5.5 GB | F16 | 58 | details |
| LFM2.5 1.2B Instruct | 1.2B | F16 | 5.0 GB | F16 | 61 | details |
| HunyuanOCR | 1.1B | F16 | 3.5 GB | F16 | 129 | details |
| PaddleOCR VL 1.6 | 959M | F16 | 2.5 GB | F16 | 150 | details |
| Qwen3.5 0.8B | 873M | F16 | 2.4 GB | F16 | 190 | details |
| LightOnOCR 3 0.8B | 853M | F16 | 2.4 GB | F16 | 190 | details |
| FastVLM 0.5B | 759M | F16 | 2.2 GB | F16 | 190 | details |
| Qwen3 0.6B | 752M | F16 | 2.7 GB | F16 | 240 | details |
| GOT OCR2 0 | 716M | F16 | 2.8 GB | F16 | 201 | details |
| Nemotron 3.5 Parse | 631M | F16 | 1.9 GB | F16 | 220 | details |
| GOT OCR 2.0 hf | 561M | F16 | 2.5 GB | F16 | 257 | details |
| SmolVLM2 500M Video Instruct | 507M | F16 | 1.6 GB | F16 | 351 | details |
| SmolVLM 500M Instruct | 507M | F16 | 1.6 GB | F16 | 351 | details |
| Qwen2.5 0.5B Instruct | 494M | F16 | 1.7 GB | F16 | 291 | details |
| LFM2.5 VL 450M | 449M | F16 | 1.9 GB | F16 | 202 | details |
| SmolLM2 360M Instruct | 362M | F16 | 1.5 GB | F16 | 397 | details |
| SmolLM2 360M | 362M | F16 | 1.5 GB | F16 | 397 | details |
| LFM2.5 350M | 354M | F16 | 1.9 GB | F16 | 202 | details |
| LFM2 350M | 354M | F16 | 1.4 GB | F16 | 406 | details |