Repository navigation
Conversation
…category - intent_schema v1.1: system_change required, fail-closed default disallow; 9 few-shots; prompt authorization examples; heuristic fallback - rules: token-exact system category (create/update/delete/deletion/disable/grant/unlock/schedule/deploy/manage/...), delete verbs moved from file category; Manager-suffix false positive fixed - 30-request LLM re-validation (docs/experiments/parser_spotcheck_v2.md); pilot FPR stays 4% - post-unfreeze runs (tau=0.75): InjecAgent 0/100 succ (last miss vetoed), MCPTox attack-influenced 10 (12 blocked); docs updated (errors/integration/sweep), 130 tests
… blueprint into docs/ - blueprint.md -> docs/blueprint.md with ToC, section/component anchors and key-content callouts (no design changes) - new docs/README.md (docs hub) and docs/experiments/README.md (status matrix, E1-E10 index, datasets, models, artifact map, reproduce commands, merge map, cross-cutting supervisor Q&A) - 10 experiment notes merged into 4 reports: 01 gate-0 foundation (E1-E4), 02 parser/schema (E5-E6), 03 B2 ToolGate (E7), 04 gate-2 gated eval (E8-E10); each with at-a-glance, goal, setup, results, artifacts, limitations, supervisor Q&A - references updated (README, AGENTS, setup, roadmap, CHANGELOG, issue template, configs schema comment, build_pilot_set docstring); 42 local links verified; 130 tests green
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this PR does
Brings
atikup to date with the merged docs cleanup and implements the rest of Phase 3 plus all of Phase 4 (Gate 1 & Gate 2 evidence), the schema v1.1 unfreeze, and the docs restructure.Phase 3 — B2 ToolGate baseline (Gate 1)
no_contract).directories+ best-effort seeding from the trusted request; coverage frozen inconfigs/b2_coverage.json(scripts/freeze_b2_coverage.py).docs/experiments/03_b2_toolgate.md.Phase 4 — Gate build (Gate 2)
AgentLoopis a real ReAct loop that executes only throughGateMiddleware.execute(); trace provenance (model/embedding metadata + run-time contract) is logged per call.--gate none|ours|toolgateonharness/run_injecagent.py,harness/run_mcptox.py, and thescripts/run_*_ours.pypilots; the ordering invariant is enforced structurally (policy built before attacker content).eval/sweep.py::sweep_cases,scripts/sweep_gated.py): knee at τ = 0.75 (pilot FPR 4%).scripts/error_taxonomy.py) + rule fixes (path scope, destructive-file verbs, shell-operator guard) and thesystem_changeschema v1.1 unfreeze (30-request LLM re-validation).Docs
blueprint.mdmoved todocs/blueprint.md(indexed ToC/anchors, key-content callouts; no design changes).docs/README.mdanddocs/experiments/README.mdhubs; 10 short notes merged into 4 indexed reports (E1–E10) with datasets, artifacts, reproduce commands, and supervisor Q&A.Verification
pytest -q→ 130 passed (data-dependent tests skip without benchmark clones).ruff checkclean on all new/changed files (pre-existing repo-wide findings untouched).Notes for reviewers
docs/experiments/README.mdis the entry point: gate status matrix, E1–E10 index, artifact map, and the old→new docs merge map.configs/b2_coverage.jsonand the E7/E8 reports.