ARVQ-FP4/NVFP4 hybrid (jarrelscy)
source ↗Perplexity (teacher → student)
10.27+1.47baseline 8.8
sparse MoE, omni
MiMo-V2.6-Pro-RL is Xiaomi's 1.02T-total / 42B-active omni sparse MoE with a 1M context, released in October 2026 under the MIT license. Its quantization story is a community GGUF and MLX ladder spanning Q2_K 373 GB to Q4_K_M 618 GB, plus one experimental ARVQ-FP4/NVFP4 hybrid that reports a teacher-to-student perplexity table.
MiMo-V2.6-Pro is a 1.02T total / 42B active MIT model from Xiaomi with 1M context. Quantization loss is not measured here — no published per-quant delta shows a quality drop versus the full-precision baseline.
| Checkpoint | Family | Size | Source |
|---|---|---|---|
| XiaomiMiMo MiMo-V2.6-Pro (official) Official Pro checkpoint | BF16 | — | source ↗ |
| ggml-org MiMo-V2.6-Pro-RL MXFP4 | MXFP4 | 554 GB | source ↗ |
| ggml-org MiMo-V2.6-Pro-RL Q2_K | GGUF | 419 GB | source ↗ |
| DevQuasar MiMo-V2.6-Pro-RL Q2_K | GGUF | 373 GB | source ↗ |
| DevQuasar MiMo-V2.6-Pro-RL Q4_K_M | GGUF | 618 GB | source ↗ |
| DevQuasar MiMo-V2.6-Pro-RL Q5_K_M | GGUF | 489 GB | source ↗ |
| mlx-community MiMo-V2.6-Pro-RL mxfp4-q8 mxfp4-q8 | MXFP4 | 516 GB | source ↗ |
baseline 8.8
No serving metrics captured for this model.