Skip to content

chore(grading): plan and authorize the regrade of the published selection - #134

Merged
kamui merged 1 commit into
mainfrom
t3code/issue-30-regrade-plan
Oct 12, 2026
Merged

kamui merged 1 commit into
mainfrom
t3code/issue-30-regrade-plan

Conversation

@kamui

@kamui kamui commented Oct 12, 2026

Copy link
Copy Markdown
Owner

Why

The selection is settled (#132), the audit is declared (#128) and the queue's tools are in place (#129, #130). The owner authorized the regrade on 2026-10-12 after the grader-model test (#133): Claude Opus 5.5 at high effort, all 198 batches, a ceiling of $500 at list price. This records the plan and the authorization the queues run under.

Scope

  • docs/research/cohort-rebuild-2026-10-05/regrade/approval.v1.json: the owner's answer, with the question and the other options.
  • source-plan.*.v1.json, execution-plan.*.v1.json, authorization.*.v1.json for the queues selected (45 batches, ceiling $117.40), rebuilt (125, $312.87) and plain (28, $69.71), written by plan.py --cap 500.
  • README.md there: what is graded, the estimate (about $337 expected, $603.30 of allowances), and how the owner starts the pilot and the queues.

Tradeoffs

  • The ceiling is under the sum of allowances. An allowance is released down to actual cost when its batch finishes, and a queue reserves a batch only when it fits.
  • Each queue's ceiling is its share of the $500 by allowances, so one queue cannot use another's room. If a queue reaches its ceiling it stops as budget-stopped and needs a new authorization.
  • The grades are kept on a working branch until the audit's sample is drawn, so nothing here puts a grade on main.

Blast Radius

Research files only. The authorizations pin 23 runner files at this commit; a change to any of them before or during the regrade needs a new authorization version.

Verification

Part of #30

…tion

The owner authorized Claude Opus 5.5 at high effort for the 198 batches
under a ceiling of $500 at list price, after the grader-model test. Each
of the three queues has its pinned source plan, execution plan and
authorization, and the README gives the estimate and how the queues are
started.

Part of #30.

@kamui kamui left a comment

Copy link
Copy Markdown
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved (advisory) — no findings.

Reviewed c3fd4d8. All 11 changed files reviewed, including exact regeneration of every source plan and execution order, input pins, budget shares, and pilot/resume behavior. No actionable findings or open questions.

Review details

Intent: Record the approved Opus 5.5 high regrade of the published selection under a $500 list-price ceiling.

Issue fit: Matches the planning and authorization portion of #30. Dispatch, grading and the declared audit remain later work.

Reviewed: c3fd4d8 against merge-base aa6ff1e.

Checks:

  • Passed local exact-head plan regeneration and pin/budget checks: 198 batches, 663 saved reviews, 2,153 comments; combined queue ceiling $499.98.
  • Exact-head CI passed preserved-evidence, current-grading and claim validation. CI run.
  • Independent verification challenged cohort integrity, authorization accounting, and pilot/resume behavior.
  • Reviewed as the authenticated PR author because the base has no reviewing-app declaration. Published as an advisory COMMENT.

@kamui
kamui merged commit b25a00a into main Oct 12, 2026
4 checks passed
@kamui
kamui deleted the t3code/issue-30-regrade-plan branch October 12, 2026 18:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant