Skip to content

perf(amd): port MI355X Qwen3.5 MXFP4 disagg sweep to srt-slurm - #2629

Closed
cquil11 wants to merge 6 commits into
agent/srt-slurm-amd-integrationfrom
agent/port-qwen35-fp4-mi355x-srt-slurm
Closed

cquil11 wants to merge 6 commits into
agent/srt-slurm-amd-integrationfrom
agent/port-qwen35-fp4-mi355x-srt-slurm

Conversation

@cquil11

@cquil11 cquil11 commented Aug 17, 2026 •

Copy link
Copy Markdown
Collaborator

Port MI355X Qwen3.5 MXFP4 8k1k disaggregation to native srt-slurm recipes with SGLang Router and MoRI.

  • Add the production recipe and route the master-config entries to it.
  • Use the existing TP8 prefill / TP8 decode workload.

Based on shared AMD integration #2542, which owns the launcher, cluster profile, benchmark/eval integration, and upstream srt-slurm v2.22.1 submodule. Integration-run links are in the base PR.

@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase As a PR reviewer and CODEOWNER, I have reviewed this and have.

For PR verification, add the full-sweep-fail-fast label (strongly recommended) to this PR — the benchmark sweep only runs on labeled PRs. Use full-sweep-enabled only if you need matrix jobs to keep running past a failure.

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs


感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 As a PR reviewer and CODEOWNER, I have reviewed this and have。

如需进行 PR 验证,请为此 PR 添加 full-sweep-fail-fast 标签(强烈推荐)— 基准测试 sweep 仅在带有标签的 PR 上运行。仅当需要矩阵任务在失败后继续运行时才使用 full-sweep-enabled。

PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档

@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch from fc2c4c1 to 13a6473 Compare August 17, 2026 04:53
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp8-mi355x-srt-slurm branch from dda2f3a to 32d3ee2 Compare August 26, 2026 23:54
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch from 13a6473 to a577154 Compare August 27, 2026 00:09
@cquil11
cquil11 changed the base branch from agent/port-qwen35-fp8-mi355x-srt-slurm to main August 27, 2026 00:09
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch 5 times, most recently from 0b5db48 to f70c653 Compare August 27, 2026 16:24
@cquil11
cquil11 changed the base branch from main to agent/srt-slurm-amd-integration August 27, 2026 16:25
@cquil11
cquil11 force-pushed the agent/srt-slurm-amd-integration branch from 8581966 to 1d4522c Compare August 27, 2026 16:28
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch from f70c653 to a3fa9fa Compare August 27, 2026 16:28
@cquil11
cquil11 force-pushed the agent/srt-slurm-amd-integration branch from 1d4522c to 6da0605 Compare August 27, 2026 17:27
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch from a3fa9fa to 7c04648 Compare August 27, 2026 17:27
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch 2 times, most recently from 164e27e to e7d7fe0 Compare August 27, 2026 21:20
@cquil11
cquil11 force-pushed the agent/srt-slurm-amd-integration branch from 5e1715e to 70f5a6d Compare August 27, 2026 21:25
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch from e7d7fe0 to 352bdcd Compare August 27, 2026 21:27
@cquil11
cquil11 force-pushed the agent/srt-slurm-amd-integration branch 5 times, most recently from c84fa81 to c94d0a4 Compare August 31, 2026 15:51
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch from 352bdcd to 722cd9c Compare September 18, 2026 22:49
@cquil11
cquil11 force-pushed the agent/srt-slurm-amd-integration branch from 0d7ca6f to 6d439d6 Compare September 18, 2026 22:49
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch from 722cd9c to 4c89ea4 Compare September 22, 2026 15:48
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch from 4c89ea4 to 8f59c83 Compare September 23, 2026 17:44
@cquil11
cquil11 force-pushed the agent/port-qwen35-fp4-mi355x-srt-slurm branch from 8f59c83 to f508cf1 Compare September 23, 2026 18:17
@cquil11
cquil11 force-pushed the agent/srt-slurm-amd-integration branch 3 times, most recently from 0f87045 to a63bd37 Compare September 23, 2026 22:05
@cquil11

cquil11 commented Sep 23, 2026

Copy link
Copy Markdown
Collaborator Author

Folded into #2542.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant