Repository navigation
docs: add Factory code review recipe - #897
rachaelrenk merged 6 commits into
Conversation
Co-Authored-By: Oz <oz-agent@warp.dev>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
This PR was generated with Warp. Comment |
Co-Authored-By: Warp <agent@warp.dev>
|
I'm starting a first review of this pull request. You can view the conversation on Warp. I completed the review and no human review was requested for this pull request. Comment Powered by Oz |
There was a problem hiding this comment.
Overview
This PR replaces the Factory code-review use-case scaffold with a full recipe for routing pull requests and merge requests to a review-only factory agent.
Concerns
- The GitHub automation example promises review on pull requests opened ready for review, but the snippet only subscribes to
pull_request_ready; opened non-draft pull requests requirepull_request_openedor the prose and test instructions need to narrow scope. - No approved spec context was provided. The security pass found no separate security issue beyond keeping the recipe's trigger behavior aligned with its review-only claims.
Verdict
Found: 1 critical, 0 important, 0 suggestions
Request changes
Comment /warp-agent-review on this pull request to retrigger a review (up to 3 times on the same pull request).
Powered by Oz
There was a problem hiding this comment.
Review summary
The independent agent completed its review for this commit.
Findings
- src/content/docs/factories/use-cases/code-review.mdx:34 — [CRITICAL] Keeping the default review agent's shared instructions intact conflicts with asking it to post findings directly: examples/00-warp-default-agents/agents/review/agent.md in warpdotdev/warp-factory-examples at 84e7c952f1506c4bd2784d96fd40a6f4d6398cad requires reports only to the orchestrator and explicitly forbids PR posts. Requested resolution: route through a communicator that publishes the review report, or configure a dedicated review-only agent with explicit posting instructions, then align the automation target, setup steps, and expected result.
- src/content/docs/factories/use-cases/code-review.mdx:45 — [IMPORTANT] The new GitHub ready-event behavior, GitLab and Azure DevOps event mappings and filters, step 6 re-review behavior, and step 4 definition application lack recorded production evidence; the cited October 7 stable changelog does not establish these capabilities, no implementation sources are cited, and warp-server is unavailable for a rollout check. Requested resolution: record claim-specific sources and production evidence from a named-revision server_rollout.py check, an applicable released OpenAPI or stable changelog entry, or explicit engineering confirmation; otherwise defer the claims or mark them VERIFY and account for them under Unverified claims. Schema acceptance and existing docs are not release evidence.
- src/content/docs/factories/use-cases/code-review.mdx:68 — [SUGGESTION] The trigger filter reference resolves but contains no skip_bots policy, accepted values, or default, leaving the bot-authored review use case unexplained. Requested resolution: link to an existing explanation that actually owns the policy, or add a source- and rollout-verified explanation to the canonical reference and link to it without duplicating the policy across recipes.
Verdict
Request changes
Co-Authored-By: Warp <agent@warp.dev>
Co-Authored-By: Warp <agent@warp.dev>
4a2577e
into
factory/factory-use-cases-structure



What this feature does
A review-only automation asks the factory's foreman to delegate code review and publish the review agent's report. Its prompt excludes implementation, approval, and merging.
Summary
Replaces the code-review scaffold with a review-only recipe using provider-specific triggers, the default foreman and review roles, and an explicit review-only automation prompt.
Changes
src/content/docs/factories/use-cases/code-review.mdxContent design plan
Audience and JTBD: An engineering team that wants consistent independent review on ready pull requests without giving an agent merge authority.
Problem: Existing docs describe agents and automations but do not show a focused review-only configuration or its safety boundaries.
Goals:
Purpose and value: The recipe adapts a source-reviewed configuration pattern and clarifies how automated review complements repository protection.
Content type: Feature documentation (combined) — the reader needs both decision guidance and setup steps.
Skill and template:
draft_feature_doc/.agents/templates/feature-doc.md.High-impact scenarios:
Source files consulted
Checked on 2026-10-21:
agent: foreman, requests a report from the review agent, and explicitly instructs the foreman to publish it and stop without implementation. Each re-review event is an explicit request for a fresh review, rather than a claim that the default lifecycle re-reviews automatically.warp-server@084e0e425af93139c6e95a78e2981dce55557c31, provider_github.go emitspull_request_readyfor both non-draftopenedandready_for_reviewdeliveries. classifier_test.go asserts both cases and excludes draft opens from the derived ready event. The recipe therefore retains the single ready trigger rather than adding an unnecessary opened trigger.Production-configuration and live contract evidence
server_rollout.pyhelper fromdocs@9fe3255523eda5c858f3daefd9a15a970a7ea3beagainst an isolated checkout ofwarp-server@084e0e425af93139c6e95a78e2981dce55557c31.pull_request_ready,pull_request_synchronized,merge_request,pull_request_created,pull_request_updated, andfactoryfile. The broad definition-file search also matched unrelated experimental surfaces, so it was not used as a blanket availability verdict. A targeted follow-up check of the nine source-identified routing, provider, save, and apply gates returned exit 0: all nine enabled in the checked-in production configuration, no unknown names. Private flag names and raw output are intentionally not published here.v1alpha1. Response SHA-256:655d676dbc436f7b89edfe2c37ef9f383c29b459a22b51c87fcda172a6ccde8e. Production schema publication establishes a live configuration contract, not a provider round trip.validate_factory_fileswithvalid: true, no diagnostics, and no deferred resolutions. Provider access and other state-dependent checks were not exercised.Unverified claims
Documentation risk
Risk: engineering-review-required
Rationale: Adds new public Factory workflow guidance and configuration examples that require product review.
Docs override: none
PR stack
Dependency: #895 is the shared base and targets
main. PRs #896–#901 each independently targetfactory/factory-use-cases-structure; no guide PR depends on another guide PR.Human review focus
Co-Authored-By: Oz oz-agent@warp.dev
Co-Authored-By: Warp agent@warp.dev