feat(pi): add code review mode by BillLeoutsakosvl346 · Pull Request #5577 · simstudioai/sim

BillLeoutsakosvl346 · 2026-07-10T22:58:55Z

Summary

Extends the Pi Coding Agent from PR creation into a complete repository workflow with three user-facing modes:

Create PR — edits a repository in an isolated E2B sandbox and opens a pull request.
Review Code — reviews an existing PR and submits a GitHub review with optional inline comments.
Local Dev — edits a repository on a user-controlled machine over SSH.

Test plan

Unit tests pass for pi-handler, cloud-backend, cloud-review-backend, keys, and create_pr_review
Cloud PR still clones, edits, pushes, and opens a PR
Cloud Code Review on a real PR posts a summary review and at least one inline comment
Local mode is unchanged
Cloud options only appear when NEXT_PUBLIC_E2B_ENABLED is set

gitguardian · 2026-07-10T22:58:58Z

️✅ There are no secrets present in this pull request anymore.

If these secrets were true positive and are still valid, we highly recommend you to revoke them.
While these secrets were previously flagged, we no longer have a reference to the
specific commits where they were detected. Once a secret has been leaked into a git
repository, you should consider it compromised, even if it was deleted immediately.
Find here more information about risks.

^{_{🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.}}

vercel · 2026-07-10T22:59:00Z

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment

Project	Deployment	Actions	Updated (UTC)
docs	Skipped		Jul 20, 2026 11:14pm

greptile-apps · 2026-07-10T23:01:08Z

Greptile Summary

This PR adds Cloud Code Review mode to the Pi block and renames the existing cloud mode in the UI.

Adds Cloud Code Review inputs, outputs, docs, and provider/model handling.
Adds sandbox checkout and bounded read-only review tooling for existing PRs.
Extends GitHub PR review submission with validated inline comments.
Extracts shared Cloud PR and Cloud Code Review sandbox helpers.
Adds tests for model filtering, review schema validation, review submission, and cloud review flows.

Confidence Score: 5/5

This looks safe to merge.

No blocking issues found in the changed code.
The review flow now pins the checked-out commits and rechecks the PR before submission.
Inline review comments are validated before they reach GitHub.

Important Files Changed

Filename	Overview
apps/sim/executor/handlers/pi/cloud-review-backend.ts	Adds Cloud Code Review orchestration with pinned checkout, host-side model execution, snapshot recheck, and GitHub review submission.
apps/sim/executor/handlers/pi/cloud-review-tools.ts	Adds bounded read-only repository review tools and structured review capture for Cloud Code Review.
apps/sim/tools/github/review-schema.ts	Adds shared validation for review bodies and inline comment coordinates.
apps/sim/tools/github/create_pr_review.ts	Extends GitHub PR review creation to support inline comments with request validation.
apps/sim/blocks/blocks/pi.ts	Updates the Pi block UI and I/O shape for Cloud PR and Cloud Code Review modes.

_{Reviews (3): Last reviewed commit: "address mor" | Re-trigger Greptile}

Introduce a third Pi mode that reviews an existing GitHub PR in an E2B sandbox and posts a structured review with optional inline comments. Keep the stored cloud id for backward compatibility, extend github_create_pr_review for inline comments, and harden review submission against stale SHAs and invalid comment payloads. Co-authored-by: Cursor <cursoragent@cursor.com>

icecrasher321 · 2026-07-11T03:14:07Z

@BillLeoutsakosvl346 the goal is for the agent to leave comments on your PR in github directly since it has all the credentials and everything similar to Greptile or Bugbot

BillLeoutsakosvl346 · 2026-07-13T18:11:38Z

Coding agent demo:

Screen.Recording.2026-07-13.at.11.03.19.AM.mp4

…ode-review # Conflicts: # apps/sim/app/workspace/[workspaceId]/settings/components/byok/byok.tsx # apps/sim/executor/handlers/pi/keys.test.ts # apps/sim/executor/handlers/pi/keys.ts # apps/sim/lib/api/contracts/byok-keys.ts # apps/sim/tools/types.ts

icecrasher321 · 2026-07-20T21:18:32Z

bugbot run

icecrasher321 · 2026-07-20T21:18:36Z

@greptile

cursor · 2026-07-20T22:28:43Z

PR Summary

High Risk
New GitHub review automation with untrusted PR input, credential boundaries between Sim and E2B, and broad changes to auth, model resolution, and secret handling across Pi modes.

Overview
The Pi Coding Agent block grows from two modes to three: Create PR (formerly Cloud), Review Code (new), and Local Dev (formerly Local). Review Code checks out a pinned PR in E2B, runs Pi on the Sim host with read-only sandbox tools, and posts a GitHub review (reviewUrl, commentsPosted) with optional inline comments validated against the exact diff. Skills and memory are limited to Create PR and Local Dev because PR content is untrusted.

Execution is refactored around shared pi-sdk, cloud-shared, and redaction helpers. Model selection intersects Sim’s catalog with Pi’s pinned provider/model IDs (isPiSupportedModel); Create PR still requires BYOK in the sandbox while Review Code and Local Dev can use hosted keys. Local Dev moves to ModelRuntime and scrubs API keys from prompts, events, and tool output.

Docs and block UI add pull number, review outcome (COMMENT / REQUEST_CHANGES, no approvals), and updated setup/FAQ for review permissions.

^{Reviewed by Cursor Bugbot for commit dd0af4d. Configure here.}

icecrasher321 · 2026-07-20T22:31:42Z

bugbot run

icecrasher321 · 2026-07-20T22:31:46Z

@greptile

icecrasher321

Review summary

The implementation is well-tested and the security boundaries are documented clearly. I found a few cleanup opportunities: keep the provider documentation aligned with the new centralized configuration, separate the large embedded sandbox helper from the TypeScript tool wiring, consolidate repeated GitHub response-parsing utilities, and remove unrelated formatting-only churn from this feature PR.

icecrasher321 · 2026-07-20T23:09:21Z

bugbot run

icecrasher321 · 2026-07-20T23:14:33Z

bugbot run

cursor

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

^{Reviewed by Cursor Bugbot for commit dd0af4d. Configure here.}

cursor Bot reviewed Jul 10, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts Outdated

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts Outdated

greptile-apps Bot reviewed Jul 10, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts Outdated

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts Outdated

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts Outdated

vercel Bot deployed to Preview July 10, 2026 23:03 View deployment

vercel Bot temporarily deployed to Preview July 10, 2026 23:03 Inactive

BillLeoutsakosvl346 force-pushed the feature/pi-cloud-code-review branch from 2760fad to c8d7b57 Compare July 10, 2026 23:11

cursor Bot reviewed Jul 10, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts Outdated

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts Outdated

vercel Bot deployed to Preview July 10, 2026 23:15 View deployment

chore(pi): cleanup code

269b4bf

icecrasher321 requested a review from a team as a code owner July 20, 2026 20:53

cursor Bot reviewed Jul 20, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/pi/cloud-review-tools.ts Outdated

Comment thread apps/sim/package.json Outdated

vercel Bot deployed to Preview July 20, 2026 20:57 View deployment

icecrasher321 added 2 commits July 20, 2026 14:00

address comments

451f63b

greptile-apps Bot reviewed Jul 20, 2026

View reviewed changes

Comment thread apps/sim/tools/github/review-schema.ts

vercel Bot deployed to Preview July 20, 2026 21:22 View deployment

cursor Bot reviewed Jul 20, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts

Comment thread apps/sim/executor/handlers/pi/cloud-review-tools.ts Outdated

address mor

4ef92cb

vercel Bot deployed to Preview July 20, 2026 22:33 View deployment

cursor Bot reviewed Jul 20, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/pi/redaction.ts

icecrasher321 reviewed Jul 20, 2026

View reviewed changes

Comment thread apps/docs/content/docs/en/workflows/blocks/pi.mdx Outdated

Comment thread apps/sim/executor/handlers/pi/cloud-review-tools.ts Outdated

Comment thread apps/sim/tools/github/create_pr_review.ts Outdated

Comment thread apps/sim/lib/uploads/core/storage-client.ts

address comments

470ff5c

cursor Bot reviewed Jul 20, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/pi/cloud-review-backend.ts

icecrasher321 changed the title ~~feat(pi): add Cloud Code Review mode and rename Cloud to Cloud PR~~ feat(pi): add code review mode Jul 20, 2026

vercel Bot deployed to Preview July 20, 2026 23:13 View deployment

update

dd0af4d

vercel Bot temporarily deployed to Preview July 20, 2026 23:14 Inactive

cursor Bot reviewed Jul 20, 2026

View reviewed changes

icecrasher321 merged commit 2c4d209 into staging Jul 20, 2026
19 checks passed

Uh oh!

Conversation

BillLeoutsakosvl346 commented Jul 10, 2026 • edited by icecrasher321 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Test plan

Uh oh!

gitguardian Bot commented Jul 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

️✅ There are no secrets present in this pull request anymore.

Uh oh!

vercel Bot commented Jul 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

greptile-apps Bot commented Jul 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Greptile Summary

Confidence Score: 5/5

Important Files Changed

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

icecrasher321 commented Jul 11, 2026

Uh oh!

BillLeoutsakosvl346 commented Jul 13, 2026

Uh oh!

Uh oh!

Uh oh!

icecrasher321 commented Jul 20, 2026

Uh oh!

icecrasher321 commented Jul 20, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

cursor Bot commented Jul 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR Summary

Uh oh!

icecrasher321 commented Jul 20, 2026

Uh oh!

icecrasher321 commented Jul 20, 2026

Uh oh!

Uh oh!

icecrasher321 left a comment

Choose a reason for hiding this comment

Review summary

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

icecrasher321 commented Jul 20, 2026

Uh oh!

Uh oh!

icecrasher321 commented Jul 20, 2026

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

BillLeoutsakosvl346 commented Jul 10, 2026 •

edited by icecrasher321

Loading

gitguardian Bot commented Jul 10, 2026 •

edited

Loading

vercel Bot commented Jul 10, 2026 •

edited

Loading

greptile-apps Bot commented Jul 10, 2026 •

edited

Loading

cursor Bot commented Jul 20, 2026 •

edited

Loading