RunsOnMy ModelsGPUs & MacsBy VRAMAPI pricesVRAM calculatorNew

Can MiMo V2 Flash run on the RTX 3080 12GB?

No. Even at 2-bit with 8K context, MiMo V2 Flash needs about 106 GB, more than the 11.4 GB usable on the RTX 3080 12GB.

Memory by quant and context

Quant4K ctx8K ctx32K ctx128K ctxMax tok/s (est., 8K)
2-bit (Q2_K) •106 GB No106 GB No110 GB No123 GB No—
3-bit (Q3_K_M) •138 GB No139 GB No142 GB No156 GB No—
4-bit (Q4_K_M) •175 GB No176 GB No179 GB No193 GB No—
5-bit (Q5_K_M) •205 GB No206 GB No209 GB No223 GB No—
6-bit (Q6_K) •237 GB No238 GB No241 GB No255 GB No—
8-bit (Q8_0) •307 GB No308 GB No311 GB No324 GB No—
16-bit (F16/BF16) •576 GB No577 GB No580 GB No594 GB No—

• real GGUF file size from unsloth/MiMo-V2-Flash-GGUF. Speed is a bandwidth ceiling (912 GB/s), not a benchmark. Methodology.

Hardware that does fit it

DGX SparkRyzen AI Max+ 395 128GBH200Mac M2 Ultra 192GBMac M3 Ultra 256GBMac M3 Ultra 512GB

More

MiMo V2 Flash on every GPU and Mac · Every model that runs on the RTX 3080 12GB · Other models that fit 12 GB VRAM · Try other settings in the calculator

Data: Hugging Face Hub (XiaomiMiMo/MiMo-V2-Flash), NVIDIA specs. Data as of 2026-11-17.