nvidia NVFP4 (FP8→NVFP4, 2x4 B300)
source ↗MMLU-Pro
87.88+0.07baseline 87.81
GPQA Diamond
92.68+0.89baseline 91.79
LiveCodeBench V6
53.55+0.6baseline 52.95
AIME 2025
99.53+0.15baseline 99.38
Terminal-Bench 2.1
86.8+1.13baseline 85.67
GlmMoeDsaForCausalLM, DSA sparse attn, 79 layers, 8 active experts
GLM-5.3 is Z.ai's 753B-total / 40B-active DSA sparse-attention MoE with a 1M-token context, released under the custom glm-5.3 license. The nvidia NVFP4 checkpoint beats its FP8 baseline on 2x4 B300 (GPQA Diamond 91.79 → 92.68), while OneNexus MXFP4 recovers 99.62% of combined BF16 quality on 4x MI350.
GLM-5.3 is a 753B total / 40B active glm-5.3 (custom) model from Z.ai / THUDM with 1M context. Quantized checkpoints lose 0.15–7.3 points on the 5 measured per-quant benchmarks.
| Checkpoint | Family | Size | Source |
|---|---|---|---|
| zai-org FP8 native ~755.7 GB official checkpoint | FP8 | 755.7 GB | source ↗ |
| unsloth GLM-5.3-GGUF UD-IQ1_S | GGUF | 217 GB | source ↗ |
| unsloth GLM-5.3-GGUF Q2_K_XL | GGUF | 254 GB | source ↗ |
| unsloth GLM-5.3-GGUF Q3_K_XL | GGUF | 343 GB | source ↗ |
| unsloth GLM-5.3-GGUF Q4_K_XL | GGUF | 467 GB | source ↗ |
| unsloth GLM-5.3-GGUF Q5_K_XL | GGUF | 562 GB | source ↗ |
| unsloth GLM-5.3-GGUF Q6_K_XL | GGUF | 684 GB | source ↗ |
| unsloth GLM-5.3-GGUF Q8_0 | GGUF | 801 GB | source ↗ |
| OneNexus GLM-5.3-MXFP4 GiB | MXFP4 | 407.92 GB | source ↗ |
| nvidia GLM-5.3-NVFP4 Size not captured | NVFP4 | — | source ↗ |
| gpustack GLM-5.3-W4A8 W4A8 | GGUF | 372.3 GB | source ↗ |
| autotrust GLM-5.3-GGUF-DGX-Spark SLIM-Q E192 IQ2_XXS SLIM-Q E192 IQ2_XXS | GGUF | 149.7 GB | source ↗ |
baseline 87.81
baseline 91.79
baseline 52.95
baseline 99.38
baseline 85.67
baseline 97.65
baseline 89.2
baseline 54.04
baseline 89.65
baseline 2.44
baseline 95.1
baseline 86.9
baseline 92
Hardware: 4x AMD MI350
Setup: OneNexus MXFP4
source ↗