Skip to content

refactor: reuse JSON pointer escaping and stop word lookup - #210

Merged
chamsechan merged 1 commit into
mainfrom
refactor/shared-validation-helpers
Oct 24, 2026
Merged

chamsechan merged 1 commit into
mainfrom
refactor/shared-validation-helpers

Conversation

@chamsechan

@chamsechan chamsechan commented Oct 24, 2026 •

Copy link
Copy Markdown
Owner

配置错误路径和文本生成各有重复的基础字符串处理。本次让配置校验复用已有的 JSON Pointer 转义,并让 Kite、Inferlet 与通用生成器复用最早停止词查找,共减少 3 份重复实现,保持现有行为。

Kite 和 Inferlet 的图文输入校验、token embedding 校验与复制仍由各自 Backend 独立维护。新增测试覆盖停止词优先顺序、未命中及跨解码片段的匹配。

验证:

  • Kite 启用配置:SDK、Pipeline 工具及测试 runner 构建成功,相关测试 9 项通过。
  • Backend 全关闭配置:相同目标构建成功,相关测试 8 项通过;两种配置的架构依赖检查均通过。
  • 默认完整门禁:451 项通过、5 项因缺少可选模型或 tokenizer 资产跳过、0 失败;交付脚本提交前再次执行同一门禁。

@chamsechan
chamsechan merged commit 313acb0 into main Oct 24, 2026
6 checks passed
@chamsechan
chamsechan deleted the refactor/shared-validation-helpers branch October 24, 2026 14:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant