Skip to content

perf: enable HybridEP in H100/B200 performance recipes - #3438

Open
seonjinn wants to merge 15 commits into
NVIDIA-NeMo:mainfrom
seonjinn:sna/hybridep-x86-performance-recipes-20260730
Open

perf: enable HybridEP in H100/B200 performance recipes#3438
seonjinn wants to merge 15 commits into
NVIDIA-NeMo:mainfrom
seonjinn:sna/hybridep-x86-performance-recipes-20260730

Conversation

@seonjinn

Copy link
Copy Markdown
Contributor

Dependency

Depends on #3436. Do not merge this PR before #3436. The dependency-only diff will disappear after #3436 lands.

Summary

  • Enable HybridEP in canonical 8-GPU MoE performance recipes for H100/B200 systems.
  • Set the x86 topology explicitly to ranks/domain 8, NVLink domain 8, MNNVL disabled, and combine chunk 128.
  • Set explicit GB200 topology for HybridEP 4-GPU recipes while leaving dense and non-HybridEP 4-GPU recipes unchanged.
  • Validate the effective topology and emit one rank-zero diagnostic line during Megatron policy setup.

Testing

  • Resolved performance recipe tests: 45 passed.
  • Ruff, compileall, uv lock check, and git diff check passed.
  • Linux MCore and H100/B200/GB200 server validation is in progress; job evidence will be added.

seonjinn added 8 commits July 31, 2026 00:47
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
@seonjinn
seonjinn requested review from a team as code owners July 31, 2026 08:08
@copy-pr-bot

copy-pr-bot Bot commented Jul 31, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@seonjinn seonjinn added the CI:L1 Run doctests, unit tests, and functional tests label Jul 31, 2026
@seonjinn

Copy link
Copy Markdown
Contributor Author

/ok to test 67a4b3d

@seonjinn seonjinn added CI:Lfast Runs a fast test suite and re-use nightly `main` container (but sync dependencies to PRs version) and removed CI:L1 Run doctests, unit tests, and functional tests labels Jul 31, 2026
@seonjinn

Copy link
Copy Markdown
Contributor Author

/ok to test 67a4b3d

@seonjinn

seonjinn commented Aug 3, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 0480dc6

…ormance-recipes-20260730

Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: seonjinn <sna@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI:Lfast Runs a fast test suite and re-use nightly `main` container (but sync dependencies to PRs version)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant