Skip to main content
Spec Hub has a Lean 4 Model Spec for each of these checkpoints. Every spec is conformance-checked against the official Hugging Face implementation; see Results. ”✓ 1.5e-15” is the maximum relative error between the official implementation and the spec, layer by layer, in float64. “checkpoint ✓” means the weight-level cross-check on the published checkpoint has been run too.

Browse a spec

What every spec covers

  • The text path. Vision and audio towers and multi-token-prediction heads are out of scope. For text-only input, Qwen3.8’s mRoPE sections coincide, so the spec defines ordinary partial RoPE.
  • Decode attention (attn.core) is specified for one new query per sequence over seq_lens[b] cached positions. That is what decode kernels compute.
  • Dense models only. Mixture-of-experts models are not supported yet.

Facts proved about the specs

The spec library proves these properties in Lean, and the Lean kernel checks them with standard axioms only: The full list of 37 audited theorems is in specs/Audit.lean. Run theformalera-conformance prove to rebuild and re-audit them.