Skip to content

[feat][evaluation] Centralized experiment scheduling: OSS seams, quota accounting, and reclaim paths #646

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
xueyizheng wants to merge 58 commits into
base: main
Choose a base branch
from
Open

[feat][evaluation] Centralized experiment scheduling: OSS seams, quota accounting, and reclaim paths #646

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
b215d44
feat(evaluation): 中心化调度地基 —— experiment 调度字段 + 单 item 消耗向量
xueyizheng Aug 18, 2026
9af835f
feat(evaluation): 新增跨空间调度队列扫描 ScanSchedulerQueue
xueyizheng Aug 18, 2026
ccc3def
feat(evaluation): 中心化调度 OSS 接缝 —— 额度闸 port + 旧 daemon 防双驱动
xueyizheng Aug 19, 2026
8c94d7e
refactor(evaluation): Guard 改为常规构造参数 + OSS wire 注册 noop
xueyizheng Aug 19, 2026
c389ef0
chore(evaluation): 运行 kitex codegen 生成调度字段与消耗向量的 Go 类型
xueyizheng Aug 19, 2026
7499874
feat(evaluation): run log 额度预占投影 + 窄派发 repo（spec 1.15/1.16）
xueyizheng Aug 19, 2026
f827a92
feat(evaluation): consumer 兑现 run log 投影 Queueing/reserved → Processi…
xueyizheng Aug 19, 2026
4ee479d
feat(evaluation): 中心调度加 scheduler_scope 隔离边界
xueyizheng Aug 19, 2026
c24d9ea
perf(evaluation): 调度索引收敛为 4 列，去掉无效排序列
xueyizheng Aug 19, 2026
a57850d
feat(evaluation): consumer 侧校验 item 的调度域归属
xueyizheng Aug 19, 2026
0bda862
fix(evaluation): 接通创建冻结链 + 修 item 终态不释放额度
xueyizheng Aug 19, 2026
1957f8f
refactor(evaluation): 拆出窄接口 IExperimentSchedulerQueueRepo
xueyizheng Aug 19, 2026
e1c03b0
perf(evaluation): 取消 expt_item_result_run_log 的 idx_expt_run_dispatch 索引
xueyizheng Aug 19, 2026
ac5ca90
fix(evaluation): 阻止部分更新改写创建期冻结的调度列
xueyizheng Aug 19, 2026
5994a1c
feat(evaluation): 增加 ICentralAdmissionPolicy 窄 port
xueyizheng Aug 20, 2026
918f330
feat(evaluation): 创建期按 admission policy 收窄 enforce 范围
xueyizheng Aug 20, 2026
ccb11b2
feat(evaluation): 补齐中心化调度读视图（priority/mode/quota），scheduler_scope 不外露
xueyizheng Aug 20, 2026
6694510
fix(evaluation): 补两条终态路径的额度归还，并把取执行权移进 item 锁内
xueyizheng Aug 20, 2026
72e27b1
feat(evaluation): priority 需授权才能指定，trigger 可信来源改按 caller PSM 判
xueyizheng Aug 20, 2026
b6c8447
refactor(evaluation): space_ids 直接用 []string，去掉双形态 ID 解析
xueyizheng Aug 20, 2026
fc1e368
feat(evaluation): 并发登记成额度维度 concurrency|item
xueyizheng Aug 20, 2026
fab4167
fix(evaluation): default_priority 从死配置改为真生效
xueyizheng Aug 20, 2026
c23412e
feat(evaluation): 三样调度特权参数收敛到一份白名单，并对 OpenAPI 开放
xueyizheng Aug 20, 2026
936986f
fix(evaluation): CheckBenefit 不再对 nil session 解引用（BOE 实测 panic）
xueyizheng Aug 20, 2026
eec8b05
test(evaluation): 补主释放点的终态判定闸测试（矩阵 R2/R3）
xueyizheng Aug 20, 2026
c0b4e2a
fix(evaluation): 释放 reason 改由 run log 终态推导；修两处失真注释
xueyizheng Aug 21, 2026
8eae911
fix(evaluation): 实验终态时释放未跑完 item 的中心调度额度
xueyizheng Aug 21, 2026
6d1b590
[feat][evaluation] trigger_type=evalx 的实验不发飞书通知
xueyizheng Aug 21, 2026
eef010a
feat(evaluation): 抽出 ISchedulerClock，让时钟实现可替换
xueyizheng Aug 22, 2026
6052539
fix(evaluation): 中心调度漏写主表 → 正在执行的 item 对用户显示成 queueing
xueyizheng Aug 23, 2026
28cfadc
feat(evaluation): admission subject 带上申报的 quota category，供商业版校验
xueyizheng Aug 24, 2026
e82b7a7
fix(evaluation): 实验终态释放额度改按 item 判据 —— 按 turn 判会漏掉沙箱死亡的那批
xueyizheng Aug 24, 2026
589a78c
fix(evaluation): 删除实验时归还中心调度额度 —— 此前是 100% 泄漏且不可逆
xueyizheng Aug 24, 2026
1d453c5
feat(evaluation): 资源申报加 source —— 同一资源不同来源是不同的池子
xueyizheng Aug 24, 2026
9b6ffb4
feat(evaluation): 生成 source 字段的 kitex 代码 + 四个转换点搬运它
xueyizheng Aug 24, 2026
60c2d37
style(evaluation): gofmt —— 补上四处因新增注释而失效的对齐与缩进
xueyizheng Aug 24, 2026
0d2957e
移除不必要的required，除非特殊情况，否则都使用option
Aug 24, 2026
b73ecf7
fix(evaluation): 中心调度取得执行权时补记 expt_stats，止住计数单向下溢
xueyizheng Aug 24, 2026
8d6f08f
fix(evaluation): 两条 daemon 终态路径不再抢先写主表 status，止住 expt_stats 净零蒸发
xueyizheng Aug 25, 2026
e3a7de9
feat(evaluation): 在线实验一律不进中心调度 —— 它缺实验级 36h 超时兜底
xueyizheng Aug 25, 2026
97a59c5
docs(evaluation): 改掉 WithConcurrencyDimension 的两处失真注释
xueyizheng Aug 25, 2026
5e5ed8a
fix(evaluation): 补齐两条额度泄漏出口 —— 终态收口写 run log、重试释放旧 run 预占
xueyizheng Aug 26, 2026
fa95642
feat(evaluation): 新增"额度不可满足"错误码 —— 申报超调度域上限时置 item 失败
xueyizheng Aug 28, 2026
b4e4c7f
fix(evaluation): 修 reservation 缺失时 item 卡死 Processing —— 退回队列而非静默丢弃
xueyizheng Aug 28, 2026
aa204ea
fix(evaluation): 孤儿退回加固两处 —— 主表写绑 CAS 结果、requeue 不刷新僵尸时钟
xueyizheng Aug 28, 2026
37096aa
test(evaluation): 补齐「额度不可满足」错误码与结果层反解的单测
xueyizheng Aug 31, 2026
5601f14
fix(evaluation): 修 CI lint QF1008 —— 去掉多余的 Dialector 选择器
xueyizheng Aug 31, 2026
cfb0deb
test(evaluation): 补派发投影 repo 与调度队列扫描的单测，patch 覆盖率 79.18%→83.19%
xueyizheng Aug 31, 2026
d2dee4b
feat(evaluation): UpdateExptRunConf 两面开放 priority_level 与 expected_qu…
xueyizheng Aug 31, 2026
7a3d233
feat(evaluation): UpdateExptRunConf 落地 priority 与 quota 向量的写入与改价
xueyizheng Aug 31, 2026
477c22b
test(evaluation): 补齐 rebase onto main 后 NewPayloadBuilder 的新增参数
xueyizheng Aug 31, 2026
844deb3
docs(evaluation): 登记改价与调度拍之间那个刻意不加锁的竞争窗口
xueyizheng Aug 31, 2026
1e4769c
feat(evaluation): 执行链透传发起实验的空间 (ExptSpaceID)
xueyizheng Sep 1, 2026
f837d13
fix(evaluation): expt_stats 计数行改为锚在主表上，并加每拍对账
xueyizheng Sep 1, 2026
6ef5394
perf(evaluation): expt_stats 对账收窄到 enforce 实验，并按实验 5 分钟节流
xueyizheng Sep 1, 2026
1067a69
chore(evaluation): rebase onto main 收尾（重新生成 wire_gen + 补格式）
xueyizheng Sep 1, 2026
9c5811f
fix(evaluation): 中心调度派发补写 turn 主表与 CK 加速表
xueyizheng Sep 2, 2026
4da012c
fix(evaluation): 孤儿 item 退回队列时同步回退 turn 主表与 CK 加速表
xueyizheng Sep 2, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
949 changes: 887 additions & 62 deletions backend/kitex_gen/coze/loop/evaluation/domain/expt/expt.go
View file
Open in desktop

Large diffs are not rendered by default.

11 changes: 11 additions & 0 deletions backend/kitex_gen/coze/loop/evaluation/domain/expt/expt_validator.go
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading