”✓ 1.5e-15” is the maximum relative error between the official implementation and the spec, layer by layer, in float64. “checkpoint ✓” means the weight-level cross-check on the published checkpoint has been run too.
Browse a spec
What every spec covers
- The text path. Vision and audio towers and multi-token-prediction heads are out of scope. For text-only input, Qwen3.8’s mRoPE sections coincide, so the spec defines ordinary partial RoPE.
- Decode attention (
attn.core) is specified for one new query per sequence overseq_lens[b]cached positions. That is what decode kernels compute. - Dense models only. Mixture-of-experts models are not supported yet.
Facts proved about the specs
The spec library proves these properties in Lean, and the Lean kernel checks them with standard axioms only:
The full list of 37 audited theorems is in
specs/Audit.lean. Run theformalera-conformance prove to rebuild and re-audit them.