Unify canonical MoE folding across Qwen and GLM

[kiddyboots216]

Summary

• Define trainer-side canonical_moe_fold_v1 as the versioned logical adjacent-pair BF16 tree.
• Separate contributor transport from arithmetic so admitted Qwen, GLM, and downstream DSV4 paths share one reduction ABI.
• Add Qwen CP8 row identity/padding, GDN prefix exchange, per-sample K3 reassembly, and exact-topology guards.
• Admit GLM DP-owned rows while retaining its qualified CP16 transport and bounded row buffers.
• Fix exact GDN CP parameter-gradient ownership and restore ring zigzag order before per-sample K3 reconstruction.

DSV4 consumes this primitive through #45. The former architecture-scoped combine divergence is gone; DSV4 retains only its variable-row transport before the shared fold.

Stack

• Base: Add exact dense Qwen programs and shared operator improvements #43 at 10439526fb35c8858bb3ebc8c382172cb9ef7f24
• Serving dependency: Unify exact MoE contributor folding xorl-sglang#16 at c9e9dd662200bc576fffb87a3c946f5eaecaa29d
• Downstream: DSV4-Flash active-LoRA zero-K3: full qualification closed (K3 = 0 at 64-decision promotion) #45
• Head: 5bb7a3f37e6f08d9c3299b69264a2ad24f7846b8

Validation

• Two-GPU exact GDN CP parameter/gradient ownership: 1 passed.
• Per-sample K3 CP and sequence-shard collator suite: 12 passed.
• Changed Python files: Ruff passed.
• Range-diff preserves all 17 prior payload/repair commits; the only added commit pins the final restacked sampler Add the Qwen3.5 zero-K3 GDN contract #16 head.

[broly-code-security-scanner]

Broly Security Scan

Note

✅ Clean scan
No vulnerabilities detected in this PR.

Note

Re-scan this PR anytime with /broly scan — useful after /broly undismiss, or to refresh findings without a new push.

Broly — SAST (zai-org/GLM-5.2) · Secrets · SCA · IaC · GH Actions · Base Images · Supply Chain Threats · Exploit Chains · Adversarial Verification

We're continuously improving Broly's accuracy and finding quality — your feedback is valuable. False positives, missed findings, bugs, and feature requests all welcome.

 

[kiddyboots216]

Superseded by #57, which consolidates the complete exact trainer-serving stack directly onto main.