Skip to content

improvement: boost psuedocode snr - #87

Merged
sidkmenon merged 13 commits into
mainfrom
sm/snr
Oct 5, 2026
Merged

sidkmenon merged 13 commits into
mainfrom
sm/snr

Conversation

@sidkmenon

Copy link
Copy Markdown
Contributor
  • Use the draft pseudocode prompt from improvement: make pseudocode SNR better #73
  • Summarize only new tests
  • Share the test queries between summarize and test-bodies
  • Tag integration and end-to-end test files
  • Keep integration tests open
  • Show test files by default
  • Tint collapsed folds that hide changes
  • Rework the summarize prompt
  • Summarize in plain text and head with the docstring
  • Rebuild the context and removed-runs plugins
  • Keep summaries up to two thirds of the body
  • Quote multi-line labels between a body's opener and closer

AI-assisted with Claude Code; see each commit's Agent-Session trailer.

@sidkmenon sidkmenon changed the title Fold tests by kind and summarize new ones improvement: boost psuedocode snr Oct 5, 2026
The prompt picks a shape per body: plain-word steps, a call tree, or a
component tree. The text is a placeholder until it is reworded.

AI-assisted implementation with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Modified and unchanged tests keep their ordinary fold labels.

AI-assisted implementation with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
No behavior change. Each shared pattern sets both plugins' test tags,
so the two plugins agree on what a test is.

AI-assisted implementation with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Classify adds `integration` or `e2e` to a test file when its path or its
first lines say so. Other test files count as unit tests.

AI-assisted implementation with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Test-bodies skips files tagged `integration` or `e2e`, and single tests
marked with `@pytest.mark.integration` or a leading `testing.Short()` check.

AI-assisted implementation with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Test-bodies now decides which tests collapse, so classify no longer
hides test files.

AI-assisted implementation with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
A collapsed paired fold that hides a change takes the theme's
`diff.delta` tint, and its row counts the changed lines.

AI-assisted implementation with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Pick a shape per body (steps, call tree, component tree, test phases),
with a fenced example for each. Tests compare against the manifest's
default prompt instead of its first words.

AI-assisted with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
The model replies with only the pseudocode: one body per request left
the JSON schema with nothing to do. The docstring's first line heads
the label, and a summary must have at most half the body's
non-whitespace characters. Drop the tests for plumbing a reader never
sees.

AI-assisted with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
#84 committed these components before its last source changes, so
tests/wasm.rs rebuilt them on every run.

AI-assisted with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
Half rejected reasonable summaries that repeat a test's data, and the
model's replies vary in length from run to run.

AI-assisted with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
A collapsed syntax body whose label spans lines, such as pseudocode,
shows one '> ' row per line at the body's indent instead of joining
them onto the opener's line.

AI-assisted with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
AI-assisted with Claude Code.

Agent-Session: ea775653-fef8-47be-96ea-16815bdff22c
Agent-Session: d72470a3-1f93-4201-8e6d-2730c798e92b
Agent-Session: 82924cb5-dcfa-42e4-abb0-ef40393249f8
@sidkmenon
sidkmenon merged commit 729d6a5 into main Oct 5, 2026
30 of 34 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant