RunsOnMy ModelsGPUs & MacsBy VRAMAPI pricesVRAM calculatorNew

Can GLM 4.6 run on the RTX 5080?

No. Even at 2-bit with 8K context, GLM 4.6 needs about 125 GB, more than the 15.2 GB usable on the RTX 5080.

Memory by quant and context

Quant4K ctx8K ctx32K ctx128K ctxMax tok/s (est., 8K)
2-bit (Q2_K) •124 GB No125 GB No134 GB No168 GB No—
3-bit (Q3_K_M) •161 GB No162 GB No171 GB No206 GB No—
4-bit (Q4_K_M) •203 GB No204 GB No213 GB No247 GB No—
5-bit (Q5_K_M) •238 GB No239 GB No248 GB No282 GB No—
6-bit (Q6_K) •275 GB No277 GB No285 GB No320 GB No—
8-bit (Q8_0) •355 GB No357 GB No365 GB No400 GB No—
16-bit (F16/BF16) •667 GB No668 GB No677 GB No711 GB No—

• real GGUF file size from unsloth/GLM-4.6-GGUF. Speed is a bandwidth ceiling (960 GB/s), not a benchmark. Methodology.

Hardware that does fit it

H200Mac M2 Ultra 192GBMac M3 Ultra 256GBMac M3 Ultra 512GB

More

GLM 4.6 on every GPU and Mac · Every model that runs on the RTX 5080 · Other models that fit 16 GB VRAM · Try other settings in the calculator

Data: Hugging Face Hub (zai-org/GLM-4.6), NVIDIA specs. Data as of 2026-11-17.