Repository navigation
chore(grading): plan and authorize the regrade of the published selection - #134
Merged
Merged
Conversation
…tion The owner authorized Claude Opus 5.5 at high effort for the 198 batches under a ceiling of $500 at list price, after the grader-model test. Each of the three queues has its pinned source plan, execution plan and authorization, and the README gives the estimate and how the queues are started. Part of #30.
kamui
commented
Oct 12, 2026
kamui
left a comment
Owner
Author
There was a problem hiding this comment.
Approved (advisory) — no findings.
Reviewed c3fd4d8. All 11 changed files reviewed, including exact regeneration of every source plan and execution order, input pins, budget shares, and pilot/resume behavior. No actionable findings or open questions.
Review details
Intent: Record the approved Opus 5.5 high regrade of the published selection under a $500 list-price ceiling.
Issue fit: Matches the planning and authorization portion of #30. Dispatch, grading and the declared audit remain later work.
Reviewed: c3fd4d8 against merge-base aa6ff1e.
Checks:
- Passed local exact-head plan regeneration and pin/budget checks: 198 batches, 663 saved reviews, 2,153 comments; combined queue ceiling $499.98.
- Exact-head CI passed preserved-evidence, current-grading and claim validation. CI run.
- Independent verification challenged cohort integrity, authorization accounting, and pilot/resume behavior.
- Reviewed as the authenticated PR author because the base has no reviewing-app declaration. Published as an advisory COMMENT.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
The selection is settled (#132), the audit is declared (#128) and the queue's tools are in place (#129, #130). The owner authorized the regrade on 2026-10-12 after the grader-model test (#133): Claude Opus 5.5 at high effort, all 198 batches, a ceiling of $500 at list price. This records the plan and the authorization the queues run under.
Scope
docs/research/cohort-rebuild-2026-10-05/regrade/approval.v1.json: the owner's answer, with the question and the other options.source-plan.*.v1.json,execution-plan.*.v1.json,authorization.*.v1.jsonfor the queuesselected(45 batches, ceiling $117.40),rebuilt(125, $312.87) andplain(28, $69.71), written byplan.py --cap 500.README.mdthere: what is graded, the estimate (about $337 expected, $603.30 of allowances), and how the owner starts the pilot and the queues.Tradeoffs
budget-stoppedand needs a new authorization.main.Blast Radius
Research files only. The authorizations pin 23 runner files at this commit; a change to any of them before or during the regrade needs a new authorization version.
Verification
plan.pywithout--capand with it print the same queues: 198 batches, 663 saved reviews, 2,153 comments, allowances $603.30.bun run verify:importandcurrent_grading.py checkpass; 0 of 623 admitted reviews assessed.Part of #30