[Klaud Cold] Port #3394: dsv41flash-fp4-b300-vllm-agentic-dspark to vLLM nightly-0961bbae with FlashInfer sparse indexer + fp8 KV - #3458
Conversation
…LLM nightly-0961bbae with FlashInfer sparse indexer + fp8 KV Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
5fabe6d to
b709c88
Compare
|
Thanks for the contribution!
中文感谢你的贡献!
|
| - dsv41flash-fp4-b300-vllm-agentic-dspark | ||
| description: | ||
| - "Port #3394 onto the srt-slurm recipe: pin B300 DeepSeek-V4.1-Flash vLLM to the 2026-09-22 nightly 0961bbae (from deepseekv41-flash-0909); enable FlashInfer sparse attention (FLASHINFER_MLA_SPARSE_DSV41) with MXFP4 indexer KV and sparse indexer logits at both TP2 and TP4, plus fp8 KV cache; raise the engine readiness timeout to 7200 s (health check 720 x 10 s). Topology, conc lists and memory limits unchanged." | ||
| pr-link: PRLINK_PLACEHOLDER |
There was a problem hiding this comment.
🟡 (optional) This merges a perf-changelog entry with pr-link: PRLINK_PLACEHOLDER instead of a real PR URL, breaking the changelog's own convention. Every other of the 1039 pr-link entries in perf-changelog.yaml points to a real https://github.com/SemiAnalysisAI/InferenceX/pull/NNNN URL; this is the only literal placeholder, so anyone auditing or tooling that parses pr-link to find the originating PR gets a dead value for this recipe change. Fix: replace PRLINK_PLACEHOLDER with the actual PR URL before merge (or have CI fail the append-only changelog check when a pr-link is not a valid PR URL).
Why this was flagged
The entry appended at perf-changelog.yaml:8962-8970 documents the image/attention-config/kv-cache-dtype/timeout changes but sets pr-link: PRLINK_PLACEHOLDER (perf-changelog.yaml:8970) rather than a real PR link. AGENTS.md:124 requires a perf-changelog entry for every performance-affecting change but does not sanction placeholder links, and every other of the 1039 pr-link entries in the file is a resolved github.com/.../pull/NNNN URL. Anyone using pr-link to trace which PR introduced a given recipe change (audit, regression bisection, tooling) gets an unresolvable placeholder instead of the base branch's convention of a working URL. No check in the diff or repo enforces pr-link is a real URL before merge.
Verification: normal. perf-changelog.yaml:8970 (the entry this PR appends, lines 8966-8970) sets pr-link: PRLINK_PLACEHOLDER. It is the sole non-URL pr-link in the file (1039 pr-link occurrences; only this one is not a github .../pull/NNNN URL). Beyond breaking the file convention, the repo's own gate rejects it: infx/workflows/validate_perf_changelog.py defines CANONICAL_PR_LINK =… | nit. The finding is…
Summary
Port of #3394 (by @xinli-sw) onto the srt-slurm recipe that #3428 moved this config to. #3394 edits the retired
benchmarks/single_node/agentic/dsv41flash_fp4_b300_vllm_mtp.shbash script, which the B300 DeepSeek-V4.1-Flash vLLM AgentX config no longer runs.Recipes touched:
dsv41flash-fp4-b300-vllm-agentic-dsparkChanges:
configs/nvidia-master.yaml: imagevllm/vllm-openai:deepseekv41-flash-0909→vllm/vllm-openai:nightly-0961bbae2894d574be790d219651824eb199318e(2026-09-22 nightly).srt-slurm-recipes/dsv41flash/vllm/b300-fp4-mtp/agentic.yaml:containerbump to the same nightly.attention-config: {"backend":"FLASHINFER_MLA_SPARSE_DSV41","indexer_kv_dtype":"mxfp4","indexer_sparse_logits":true}at both TP2 and TP4 (as Update B300 DeepSeek V4.1 Flash vLLM nightly / 更新 B300 DeepSeek V4.1 Flash vLLM nightly #3394's script does; its description mentions MegaAttention at TP4, but its code uses FlashInfer for both).kv-cache-dtype: fp8.VLLM_ENGINE_READY_TIMEOUT_S3600 → 7200 andhealth_check.max_attempts360 → 720 (10 s interval), replacing Update B300 DeepSeek V4.1 Flash vLLM nightly / 更新 B300 DeepSeek V4.1 Flash vLLM nightly #3394's launcher-sideVLLM_ENGINE_READY_TIMEOUT_S=7200.perf-changelog.yaml: new entry.Topology, conc lists, CUDA-graph ladders and memory limits are unchanged. #3394's
EVAL_ONLYscript edits andDSV41_MIN_CUDAGRAPH_CAPTURE_SIZElauncher export apply only to the legacy script path and are not needed here.References: vLLM tracking issue, upstream recipe.
Test plan
🤖 Generated with Claude Code