Skip to content

Publish UI test checks for comment triggers#866

Merged
Kyle-Ye merged 1 commit into
mainfrom
codex/uitest-check-runs
May 17, 2026
Merged

Publish UI test checks for comment triggers#866
Kyle-Ye merged 1 commit into
mainfrom
codex/uitest-check-runs

Conversation

@Kyle-Ye
Copy link
Copy Markdown
Collaborator

@Kyle-Ye Kyle-Ye commented May 17, 2026

Summary

  • Create PR check runs on comment-triggered UI tests so they appear in the PR Checks tab
  • Mark requested platform checks queued immediately from a lightweight prepare job
  • Update the check run to in-progress and final success/failure from the platform job

Validation

  • ruby -e 'require "psych"; Psych.parse_file(".github/workflows/uitests.yml")'
  • git diff --check

Note: actionlint is not installed locally.

@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 17, 2026

🤖 Augment PR Summary

Summary: This PR publishes PR check runs for UI tests that are triggered via issue comments, so they appear in the PR “Checks” tab.

Changes:

  • Adds checks: write permission and a lightweight prepare_issue_comment job that validates /uitest … comment triggers.
  • Parses the comment to determine requested platforms (iOS/macOS) and exports outputs (repo/SHA, requested flags, check run IDs).
  • Creates queued check runs for same-repo PRs and links them to the workflow run via details_url.
  • Updates iOS/macOS UI test jobs to depend on the prepare job and use its checkout target.
  • Marks the corresponding check run in_progress when the platform job starts.
  • Completes the check run with success/failure/cancelled based on job.status.

Technical Notes: Fork PRs still run the requested tests, but check run creation is skipped since checks can’t be created against fork SHAs in the base repo.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

@Kyle-Ye Kyle-Ye merged commit 7371deb into main May 17, 2026
5 of 7 checks passed
@Kyle-Ye Kyle-Ye deleted the codex/uitest-check-runs branch May 17, 2026 17:53
@codecov
Copy link
Copy Markdown

codecov Bot commented May 17, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 13.79%. Comparing base (e14c750) to head (e299f83).
⚠️ Report is 1 commits behind head on main.

❗ There is a different number of reports uploaded between BASE (e14c750) and HEAD (e299f83). Click for more details.

HEAD has 1 upload less than BASE
Flag BASE (e14c750) HEAD (e299f83)
2 1
Additional details and impacted files
@@             Coverage Diff             @@
##             main     #866       +/-   ##
===========================================
- Coverage   25.72%   13.79%   -11.93%     
===========================================
  Files         677      637       -40     
  Lines       47008    41270     -5738     
===========================================
- Hits        12092     5695     -6397     
- Misses      34916    35575      +659     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant