Skip to content

Allow an A/A Experiment #1265

Closed
Closed

Description

@JacobStephens2

This was generated by AI from a grill-with-docs session.

Parent

#1252

What to build

An A/A Experiment: one commit and the same flags in both Arms, so that an Experiment measures how often the Arms disagree when nothing differs (grill Q2.1). Both Arms are built and run as they would be for any Experiment, and the result reaches a Verdict. If anything refuses identical Arms today, relax it for this case. docs/guide.md says how to run one, with the suites selected by --suite, and why.

Acceptance criteria

  • An integration test runs an Experiment with one commit and the same flags in both Arms, against the fake Harness, through to a Verdict.
  • docs/guide.md describes the A/A Experiment.

Activity

  1. JacobStephens2 commented on Oct 24, 2026

    @JacobStephens2
    OwnerAuthor

    Closed by #1280, merged into issue-1252 by a thirdshift Ticket run with Self-merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestready-for-agentFully specified, ready for an AFK agent

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions