Skip to content

[None][perf] GVR top-K decode: enable R0 histogram-ladder admission by default #16457

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lfr-0531 merged 50 commits into from
Jul 28, 2026
Merged

[None][perf] GVR top-K decode: enable R0 histogram-ladder admission by default #16457

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
50 commits
Select commit Hold shift + click to select a range
ad3f9c4
[None][perf] gvr top-k decode: add block_count_ge_multi + R0 knobs (i…
longcheng-nv Jul 15, 2026
9878e1a
[None][perf] gvr top-k decode: add P1b histogram-quantile rung placem…
longcheng-nv Jul 15, 2026
d2252ee
[None][perf] gvr top-k decode: R0 single-pass admission in _run_phase…
longcheng-nv Jul 15, 2026
af5bd95
[None][perf] gvr top-k decode: inline log-falsi R1 shot on R0 miss
longcheng-nv Jul 15, 2026
b28b884
[None][perf] gvr top-k decode: fb_fix bounded log-falsi fallback (rep…
longcheng-nv Jul 15, 2026
a8c69a7
[None][perf] gvr top-k decode: cluster-aware R0 (cs>1 long-row branch)
longcheng-nv Jul 15, 2026
4d00c8a
[None][perf] gvr top-k decode: R0 dispatch defaults ((0.85,0.35) qfra…
longcheng-nv Jul 15, 2026
f926cdf
[None][perf] gvr top-k decode: p1b_cache path (SMEM gather-cache, 16-…
longcheng-nv Jul 15, 2026
a489d80
[None][perf] gvr top-k decode: fix cluster-R0 admission/refine handof…
longcheng-nv Jul 15, 2026
1ba38ec
[None][perf] gvr top-k decode: seeded cluster R0-miss refine (fold R1…
longcheng-nv Jul 15, 2026
ee10ccf
[perf] GVR P3/P4: hoist SMEM window bases; single-pass P4 writeback o…
siyidNV Jul 13, 2026
4e69280
[perf] GVR P4 level-2 histogram refinement
siyidNV Jul 13, 2026
d29d6f7
[perf] GVR P4 multi-level refinement + lane-parallel bin-search step1
siyidNV Jul 13, 2026
ff03622
[perf] GVR P4: bracket-window histogram + zero-atomic converged write…
siyidNV Jul 13, 2026
1a44fff
[fix] GVR P4: clamp histogram range overflow to keep threshold ordered
siyidNV Jul 13, 2026
ac1c5f8
[fix] GVR: parity-buffer the cluster all-reduce DSMEM count exchange
siyidNV Jul 13, 2026
c528253
[None][perf] gvr top-k decode: add fused rank-and-scatter P4 (inert f…
longcheng-nv Jul 15, 2026
6002551
[None][perf] gvr top-k decode: enable rank-scatter P4 by default unde…
longcheng-nv Jul 15, 2026
39f17b2
[None][perf] gvr top-k decode: p1b_cache ON for all dtypes at cluster…
longcheng-nv Jul 15, 2026
b8b616b
[perf] GVR P2/P4: redundant-warp sync reduction
siyidNV Jul 15, 2026
7b31f3c
[None][chore] Address review: float-domain bin clamp; document knobs
siyidNV Jul 15, 2026
3e20622
[None][chore] GVR top-K decode: ruff-format the R0 additions
longcheng-nv Jul 15, 2026
95a8388
[None][perf] GVR top-K decode: enable R0 admission by default + equiv…
longcheng-nv Jul 15, 2026
0182519
[None][perf] GVR top-K decode: pick_config launch-shape policy + laun…
longcheng-nv Jul 16, 2026
a2ebe3a
Merge branch 'main' into perf/gvr-kernel-opts
siyidNV Jul 16, 2026
88a563b
[None][perf] GVR top-K decode: virtual seed rung (r0_vseed) + per-K r…
longcheng-nv Jul 16, 2026
eae3745
[None][fix] GVR top-K decode: exact tie resolution in the P4 straddli…
longcheng-nv Jul 16, 2026
c6ff467
Merge branch 'main' into perf/gvr-kernel-opts
siyidNV Jul 16, 2026
0560d0c
Merge branch 'main' into perf/gvr-kernel-opts
siyidNV Jul 17, 2026
af7351c
[None][chore] Fix ruff-format pre-commit violations
longcheng-nv Jul 17, 2026
7408f3b
[None][test] Preserve -1 encoding for true index 0 in R0 pre_idx helper
longcheng-nv Jul 17, 2026
0d6fc4f
[None][perf] gvr_topk_decode: K2048 R0 low rung 0.85 -> 0.6 (real-con…
longcheng-nv Jul 19, 2026
1128c05
[None][perf] gvr_topk_decode: K2048 R0 Phase-4 histogram diet 2048 ->…
longcheng-nv Jul 20, 2026
e6fdbfa
[None][perf] gvr_topk_decode: tiny-tie fast path for p4_exact_tail
longcheng-nv Jul 20, 2026
6fa4b5c
[None][chore] Address review: tidy comments, parameterize SMEM scalar…
siyidNV Jul 20, 2026
d693f33
Merge branch 'main' into perf/gvr-kernel-opts
siyidNV Jul 20, 2026
9b7f0bf
Merge branch 'main' into perf/gvr-kernel-opts
siyidNV Jul 20, 2026
f485738
Merge branch 'main' into perf/gvr-kernel-opts
siyidNV Jul 21, 2026
9269219
Merge branch 'main' into perf/gvr-kernel-opts
siyidNV Jul 21, 2026
6140078
Merge PR #16424 (perf/gvr-kernel-opts) into perf/gvr-topk-r0-histogra…
longcheng-nv Jul 21, 2026
b14ec40
[None][chore] gvr_topk_decode: ruff-format cleanup (fixes CI Release-…
longcheng-nv Jul 21, 2026
a707cfe
[None][fix] gvr_topk: equalize cs=1/cs>1 SMEM layouts for the LB hybr…
longcheng-nv Jul 21, 2026
04a0900
[None][test] gvr_topk r0-equivalence: tie-aware fp32 index-set compar…
longcheng-nv Jul 22, 2026
25efb6e
[None][test] bump unittest/_torch/attention bucket TIMEOUT to 90m on …
longcheng-nv Jul 22, 2026
4b35396
[None][test] gvr_topk: slim UT suite ~33%, revert attention-bucket TI…
longcheng-nv Jul 22, 2026
377fb37
Merge remote-tracking branch 'origin/main' into perf/gvr-topk-r0-hist…
longcheng-nv Jul 22, 2026
584eccf
[None][fix] Carry import hotfix for #15582 vs #16382 guard conflict (…
longcheng-nv Jul 22, 2026
4cb479c
Merge remote-tracking branch 'origin/main' into perf/gvr-topk-r0-hist…
longcheng-nv Jul 22, 2026
e612fc2
[None][fix] Carry test fix: seed _multi_frontend_ipc_dir in bypass-__…
longcheng-nv Jul 22, 2026
dc2bdc8
Merge remote-tracking branch 'origin/main' into perf/gvr-topk-r0-hist…
longcheng-nv Jul 23, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading