Skip to content

Use commit statuses for UI test comments#867

Merged
Kyle-Ye merged 2 commits into
mainfrom
codex/uitest-commit-statuses
May 17, 2026
Merged

Use commit statuses for UI test comments#867
Kyle-Ye merged 2 commits into
mainfrom
codex/uitest-commit-statuses

Conversation

@Kyle-Ye
Copy link
Copy Markdown
Collaborator

@Kyle-Ye Kyle-Ye commented May 17, 2026

Summary

  • Switch comment-triggered UI test reporting from Checks API to Commit Status API
  • Publish stable contexts for UI Tests / iOS and UI Tests / macOS
  • Keep same-repository protection for status updates

Validation

  • ruby -e 'require "psych"; Psych.parse_file(".github/workflows/uitests.yml")'
  • git diff --check origin/main..HEAD

Note: actionlint is not installed locally.

@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 17, 2026

🤖 Augment PR Summary

Summary: This PR changes UI-test reporting triggered by PR comments from the Checks API to the Commit Status API.

Changes:

  • Updates workflow permissions from checks: write to statuses: write
  • Creates initial commit statuses for UI Tests / iOS and UI Tests / macOS when /uitest comments are received
  • Updates those statuses during execution and sets final success/failure/error on completion
  • Adds a status-enabled output to skip status updates for fork PRs (same-repo guard)

Technical Notes: Uses stable status contexts (per platform) so downstream tooling/branch protection can key off consistent names.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread .github/workflows/uitests.yml
@codecov
Copy link
Copy Markdown

codecov Bot commented May 17, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 25.81%. Comparing base (7371deb) to head (a858b1d).

Additional details and impacted files
@@             Coverage Diff             @@
##             main     #867       +/-   ##
===========================================
+ Coverage   13.80%   25.81%   +12.00%     
===========================================
  Files         637      672       +35     
  Lines       41270    46453     +5183     
===========================================
+ Hits         5697    11990     +6293     
+ Misses      35573    34463     -1110     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@Kyle-Ye Kyle-Ye merged commit ae64d8f into main May 17, 2026
1 of 6 checks passed
@Kyle-Ye Kyle-Ye deleted the codex/uitest-commit-statuses branch May 17, 2026 18:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant