fix(integrations): restore strict Qwen3 bitwise parity - #339
fix(integrations): restore strict Qwen3 bitwise parity#339inaniloquentee wants to merge 1 commit into
Conversation
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Plus Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Flink-ddd
left a comment
There was a problem hiding this comment.
LGTM, Thank you for update.
Summary
Validation
python -m pytest -q tests/test_framework_runtime_adapters.py tests/test_flashinfer_pr7_attention.py: 77 passed, 1 skippedtrain_rollout_logprob_abs_diff: 0.0mismatch_count: 0 / 128max_abs_diff: 0.0The validation job subsequently hits Vime/Megatron's existing distributed optimizer checkpoint assertion
(torch.Size([]), 0, 311427072), after the strict consistency metric has passed.Fixes #335