nvidia NVFP4 (BF16→NVFP4, GB200)
source ↗GPQA Diamond
92.11−0.06baseline 92.17
SciCode
57.69+1.48baseline 56.21
MMMU-Pro
76.3−0.58baseline 76.88
IFBench
60.54−0.76baseline 61.3
Terminal-Bench 2.1
83.15+0.57baseline 82.58
MoE, 45 layers + 1 MTP, 288 experts + 1 shared, top-8, KDA linear-attn + sparse MLA
GLM-5.3-Flash is Z.ai's 320B-total / 18B-active MoE with KDA linear attention and sparse MLA, shipping a 1M-token context under the MIT license. Its quantization story centers on the nvidia NVFP4 checkpoint, which holds BF16 quality on a GB200 (GPQA Diamond 92.17 → 92.11) while the turboderp EXL3 build at 2.05 bpw (85.2 GB) reaches 41.8 tok/s on two RTX Pro 6000 cards.
GLM-5.3-Flash is a 320B total / 18B active MIT model from Z.ai / THUDM with 1M context. Quantized checkpoints lose 0.06–0.76 points on the 3 measured per-quant benchmarks.
| Checkpoint | Family | Size | Source |
|---|---|---|---|
| zai-org FP8 native ~306 GiB official checkpoint | FP8 | 306 GB | source ↗ |
| amd GLM-5.3-Flash-Quark-MXFP4 | MXFP4 | 185 GB | source ↗ |
| OneNexus GLM-5.3-Flash-MXFP4 | MXFP4 | 195.6 GB | source ↗ |
| nvidia GLM-5.3-Flash-NVFP4 Size not captured | NVFP4 | — | source ↗ |
| unsloth GLM-5.3-Flash-GGUF UD-Q2_K_XL ~109 GB | GGUF | 109 GB | source ↗ |
| unsloth GLM-5.3-Flash-GGUF Q3_K_XL | GGUF | 137.4 GB | source ↗ |
| unsloth GLM-5.3-Flash-GGUF Q4_K_XL | GGUF | 185.99 GB | source ↗ |
| ggml-org GLM-5.3-Flash Q4_K | GGUF | 168.92 GB | source ↗ |
| turboderp GLM-5.3-Flash EXL3 2.05bpw | EXL3 | 85.2 GB | source ↗ |
| autotrust GLM5.3-Flash-E256-DGX-Spark NVFP4 NVFP4 E256 expert-pruned | NVFP4 | 170.5 GB | source ↗ |
| autotrust GLM5.3-Flash-E224-DGX-Spark NVFP4 NVFP4 E224 expert-pruned | NVFP4 | 151.5 GB | source ↗ |
| canada-quant GLM-5.3-Flash-W4A16-MTP W4A16-MTP | GGUF | 177.7 GB | source ↗ |
| AxonZeta GLM-5.3-Flash-AZ-Focus-EXL3 EXL3 AZ-Focus; size not captured | EXL3 | — | source ↗ |
baseline 92.17
baseline 56.21
baseline 76.88
baseline 61.3
baseline 82.58
baseline 86.2
baseline 75
baseline 80.8
baseline 85.8
Hardware: AMD MI355X
Setup: vLLM FP8 TP4
source ↗Hardware: NVIDIA GB300
Setup: SGLang FP8 KV cache
source ↗Hardware: 2x NVIDIA RTX Pro 6000
Setup: turboderp EXL3 2.05bpw (TabbyAPI)
source ↗Hardware: NVIDIA GB200
Setup: vLLM FP8 TP4 + MTP5
source ↗