Skip to content

Admit hybrid models at Ulysses 8 under the exact contract (GDN-CP scan chain + composed admission) - #55

Closed
kiddyboots216 wants to merge 1 commit into
pr/deepep-zero-k3from
pr/gdn-cp-hybrid-u8
Closed

Admit hybrid models at Ulysses 8 under the exact contract (GDN-CP scan chain + composed admission)#55
kiddyboots216 wants to merge 1 commit into
pr/deepep-zero-k3from
pr/gdn-cp-hybrid-u8

Conversation

@kiddyboots216

@kiddyboots216 kiddyboots216 commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

Exact GDN under Ulysses context parallelism

Stacked on #54. This PR contains production code and conventional tests only.

What changes

Hybrid Qwen3.5-family models were byte-broken under Ulysses sharding because cross-rank GDN state folding, shard-local chunk rephasing, and short-convolution composition did not preserve the Ulysses-1 program. This PR adds:

  1. A canonical scan chain that transports the FP32 running-state operands in declared rank order, with receipt validation and deterministic reinjection.
  2. A collator contract that aligns document starts, stream ends, and shard cuts to the 64-token chunk grid.
  3. Convolution-halo re-entry through the contracted varlen serving kernel using the previous shard's raw post-projection rows.
  4. Fail-closed joint admission for qualified Ulysses degrees and the pinned kernel/toolchain fingerprint.

Gates

  • State-chain equality at ranks 2, 4, and 8 with vacuity, ordering, digest, and alignment negatives.
  • Convolution-halo locality and byte equality.
  • Four-rank collective chain mechanics and eight-GPU model/collator integration.
  • Hybrid Ulysses-8 hidden-state and FP32 logprob bytes equal to the Ulysses-1 oracle, with both the attention exchange and state chain proven load-bearing.
  • Endpoint replay: 1,540/1,540 decision tokens bitwise equal at Ulysses 1 and 8; K3 exactly 0.0.

Scope

Admission remains evidence-scoped to the qualified hybrid family and Ulysses degrees. Missing collator attestation, incompatible topology, or toolchain drift fails closed.

@broly-code-security-scanner

broly-code-security-scanner Bot commented Aug 13, 2026

Copy link
Copy Markdown

Broly Security Scan

Note

Clean scan
No vulnerabilities detected in this PR.

Note

Re-scan this PR anytime with /broly scan — useful after /broly undismiss, or to refresh findings without a new push.

Broly — SAST (zai-org/GLM-5.2) · Secrets · SCA · IaC · GH Actions · Base Images · Supply Chain Threats · Exploit Chains · Adversarial Verification

We're continuously improving Broly's accuracy and finding quality — your feedback is valuable. False positives, missed findings, bugs, and feature requests all welcome.

Ask in #security-engineering   Powered by Together AI

Comment thread experiments/gdn_cp_exact/hybrid_u8_fixture_gate.py Fixed
Comment thread experiments/gdn_cp_exact/p5_fixture_gate.py Fixed
Comment thread src/xorl/ops/kernel_config_pin.py Fixed
Comment thread experiments/gdn_cp_exact/endpoint_replay.py Fixed
Comment thread experiments/gdn_cp_exact/p6_realweights_gate.py Fixed
Comment thread experiments/gdn_cp_exact/hybrid_u8_fixture_gate.py Fixed
Comment thread experiments/gdn_cp_exact/endpoint_capture.py Fixed
Comment thread src/xorl/ops/kernel_config_pin.py Fixed
Comment thread experiments/gdn_cp_exact/hybrid_u8_fixture_gate.py Fixed
Comment thread experiments/gdn_cp_exact/endpoint_replay.py Fixed
Comment thread experiments/gdn_cp_exact/p6_realweights_gate.py Fixed
Comment thread experiments/gdn_cp_exact/proto_chain_gate.py Fixed
Add aligned packed-sequence cuts, a receipt-validated canonical scan-state handoff, serving-paired convolution halos, and fail-closed topology and toolchain admission. Cover collator attestation, topology guards, kernel-pin ownership, and composed byte-contract behavior with conventional tests.
@kiddyboots216

Copy link
Copy Markdown
Contributor Author

Superseded by #57, which consolidates the complete exact trainer-serving stack directly onto main.

@kiddyboots216
kiddyboots216 deleted the pr/gdn-cp-hybrid-u8 branch August 17, 2026 23:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants