Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -302,3 +302,10 @@ media/self-improving-agents-video/out/
media/self-improving-agents-video/**/*.mp4
media/self-improving-agents-video/**/*.mp3
media/self-improving-agents-video/**/*.wav

# 科普视频工程(media/experience-era-agents-video)本地产物:同上集规则。
media/experience-era-agents-video/video/public/audio/
media/experience-era-agents-video/out/
media/experience-era-agents-video/**/*.mp4
media/experience-era-agents-video/**/*.mp3
media/experience-era-agents-video/**/*.wav
1 change: 1 addition & 0 deletions docs/.agents/knowledge-map.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,4 +71,5 @@
- [经验时代的自驱迭代进化智能体调研](../research/self-evolution/140-experience-era-self-improvement.md) — 精读 88 页综述提炼 Harness 经验基础设施框架,对照 negentropy Routine 闭环诊断出两处根本断点(Judge 无历史锚点 ±20 振荡 / `decay_override` 死配置致经验记忆 7-8 天全灭 + 反馈链断),落地双支柱改进:证据锚定纵向评估(trajectory + progress_evidence + 量化振荡 opt-in)与经验记忆闭环补强(衰减修复 E / 检索反馈闭环 B / 写入去重准入 A / 失败教训结构化与注入 C-D)
- [Skill 进化闭环 × 自我改进评测](../research/self-evolution/141-skills-evolution-and-si-measurement.md) — 综述 §3(Skills 三阶段 Evolution 缺口)/ §7(Meta-Evolving 三体制)/ §8(SI 六目标 + SIP-Bench + 反事实归因)映射到 negentropy:PR [#1038](https://github.com/ThreeFish-AI/negentropy/pull/1038) 落地 eval 四表 + held-out 双相门(decide_skill_shadow/canary)+ 反事实 Skill Influence Pattern + TargetHandler 抽象 + SkillTemplateHandler 闭环(GEPA 变异 prompt_template + active_version 发布),补 140 号未覆盖的 Skills/Meta/SI 度量框架
- [arXiv §5 科普视频制作包](../../video-package/README.md) — 基于 [141 号调研同源综述](../research/self-evolution/141-skills-evolution-and-si-measurement.md)(arXiv:2607.13104 §5 基座模型自我改进)的完整视频制作包:13:42 逐字稿(N0–N6 段落 ID 主键体系,4.7 字/秒自洽)+ 46 镜头分镜表(md/csv 双格式,822s 与逐字稿/动画三表对齐)+ 单文件 Canvas 动画 demo(1920×1080、8 场景 3B1B 风格、←/→/空格/R/1-8/H 快捷键、file:// 零依赖直开)+ 71 条事实核查表(引文 100% grep 验证命中论文原文、RISKY/REWRITE 双零、ANALOGY 类比显式登记)
- [科普视频制作 Pipeline(公共基建)](../../media/pipeline/README.md) — 全仓可复用的论文→视频九阶段流水线(精读提取/策划/逐字稿 SSOT/双重校验/分镜/TTS/Remotion/抽帧 QA/终渲):中心脚本三件套(`--project` 参数化)+ 每 Stage 代理提示词规格(skills/01–05)+ 新集脚手架清单与复用边界(Python 脚本集中 SSOT、Remotion 原语复制适配);作品:[《AI 如何自己变强?》](../../media/self-improving-agents-video/README.md)(Schmidhuber 综述 · 蓝/橙契约 · 6 幕)与 [《上线之后,AI 才开始上学》](../../media/experience-era-agents-video/README.md)([140 号调研](../research/self-evolution/140-experience-era-self-improvement.md)同源清华×Frontis 综述 · 金/青/紫契约 · 7 幕 13.6 分钟,论文笔记由 9 并行代理逐章精读产出)
- [自进化 Agents Team 方案(Phase 3 记忆检索面已落地)](../concepts/design/self-evolving-agents.md) — 四层自进化架构:本次落地 `engine/evolution/` 子系统(GEPA proposer + 状态机 + decision 护栏)并在记忆检索权重面接通 propose→shadow→canary→promote/rollback 全闭环(迁移 0081 + evolution_inspector),默认全关灰度;agent/skill/knowledge 面、Phase 1 tool_invocations 遥测、eval 四表留后续
58 changes: 58 additions & 0 deletions media/experience-era-agents-video/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,58 @@
# 《上线之后,AI 才开始上学》科普视频工程

> 基于 Che Jiang, Jincheng Zhong, Yu Fu, *et al.*, "Self-Improving Agents in the Era of Experience: A Survey of Self- to Meta-Evolution," *Frontis.AI / Tsinghua University*, Jun. 2026(88 页综述,无公开 arXiv 号)的动效图解式科普视频(B 站/YouTube,约 13.6 分钟)。
> 形态:AI 配音(edge-tts)+ Remotion 代码动画,无真人出镜。
> 与上一集《AI 如何自己变强?》([../self-improving-agents-video/](../self-improving-agents-video/README.md),Schmidhuber 团队综述)互补:上集讲「自我进化改什么」,本集讲「部署之后经验怎么攒」;片尾互相引用。

## 目录结构

| 路径 | 说明 |
|---|---|
| `research/paper-notes.md` | 论文精读笔记——全部口播内容的**单一事实源**(9 个并行提取代理逐章产出) |
| `script/planning.md` | 策划案:受众、七幕结构、三色视觉契约(金=经验流 / 青=Harness / 紫=参数内化) |
| `script/narration.md` | 逐字稿(唯一维护处),`- [句id] 文本` 一句一行 |
| `script/narration.json` | 派生物:拆句结果,供 TTS 与字幕消费(勿手改) |
| `script/storyboard.md` | 分镜表:镜号 ↔ 句 id 区间 ↔ 画面动效(场景组件实现规格) |
| `scripts/*.py` | 薄包装 → 公共管线 [media/pipeline/scripts/](../pipeline/scripts/)(`--project` 透传) |
| `video/` | Remotion 工程(独立 pnpm 项目,`ignore-workspace` 与主仓隔离) |
| `out/` | 渲染产物(gitignored) |

## 复现流水线

```bash
# 1. 改稿后重建逐句 JSON
uv run --no-project scripts/build_narration.py

# 2. 合成配音(增量幂等;首跑约 3-5 分钟,需网络)
uv run --no-project --with edge-tts --with mutagen scripts/tts.py

# 3. 预览
cd video && pnpm install --ignore-workspace && pnpm dev

# 4. 草渲(半分辨率快速迭代)
cd video && pnpm run render:draft # -> ../out/draft.mp4

# 5. 抽帧 QA(在工程根目录;--scene 与句 id 二选一)
uv run --no-project scripts/qa_frames.py out/draft.mp4 --scene P2

# 6. 终渲 1080p30
cd video && pnpm run render # -> ../out/final.mp4
```

## 音画同步机制

每句一段 MP3;`tts.py` 产出 `video/public/audio/manifest.json`(含每句实测时长);Remotion `calculateMetadata` 读取 manifest 计算全片时间轴(句间 0.32s、幕间 +0.9s、片头 0.6s、片尾 2s)——改稿后**只需重跑 1→2→4**,无需手工对轨。

## 内容修改守则

- 口播内容改动只发生在 `script/narration.md`;所有论文断言须可回溯 `research/paper-notes.md`;
- 新增/修改句后,受影响 beat 的句 id 区间需在对应场景组件(`video/src/scenes/`)同步;
- 三色语义是全片视觉契约:金 `#F5C542` = 经验流(trace→z),青 `#2DD4BF` = Harness 运行时,紫 `#B78CFF` = 参数内化。

## 论文引用(IEEE)

[1] C. Jiang, J. Zhong, Y. Fu, *et al.*, "Self-Improving Agents in the Era of Experience: A Survey of Self- to Meta-Evolution," *Frontis.AI / Tsinghua University*, Jun. 2026.(Harness 形式化、技能/记忆/环境/参数四面、元进化、SI 六评测目标、移动攻击面)

## 许可注意

Remotion 对超过 3 人的公司需商业授权(个人/小团队免费);若本视频转为公司用途,请评估许可或迁移 MIT 协议的 Motion Canvas。配音来自 edge-tts(微软在线语音),发布前请自行确认平台对合成语音的标注要求。
Loading