Skip to content

Add env switch for AITER custom all-reduce - #12

Merged
sammysun0711 merged 1 commit into
qwen3_5_v0.5.15_dflashfrom
qwen3_5_disable_new_ca
Aug 7, 2026
Merged

Add env switch for AITER custom all-reduce#12
sammysun0711 merged 1 commit into
qwen3_5_v0.5.15_dflashfrom
qwen3_5_disable_new_ca

Conversation

@apinge

@apinge apinge commented Aug 5, 2026

Copy link
Copy Markdown
Owner

Motivation

This PR ports the feature of SGLANG_USE_AITER_NEW_CA from zejunchen-zejun#229

Modifications

Accuracy Tests

Speed Tests and Profiling

Checklist

Review and Merge Process

  1. Ping Merge Oncalls to start the process. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • Common commands include /tag-and-rerun-ci, /tag-run-ci-label, /rerun-failed-ci
  4. After green CI and required approvals, ask Merge Oncalls or people with Write permission to merge the PR.

@apinge
apinge marked this pull request as ready for review August 5, 2026 11:29

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Ports the SGLANG_USE_AITER_NEW_CA feature into SGLang by wiring an environment-controlled switch into the custom all-reduce (“ca”) execution path in the distributed parallel state.

Changes:

  • Adds SGLANG_USE_AITER_NEW_CA-driven behavior by passing use_new=... into the custom all-reduce call.
  • Imports get_bool_env_var in parallel_state.py to read the new env switch.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread python/sglang/srt/distributed/parallel_state.py
Comment thread python/sglang/srt/distributed/parallel_state.py
@sammysun0711
sammysun0711 merged commit 71d2967 into qwen3_5_v0.5.15_dflash Aug 7, 2026
5 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants