Repository navigation
Smoke Test: Claude - 25212030870 #29530
Copy link
Copy link
Closed as not planned
Labels
Description
Summary
Overall status: PARTIAL — 15 passed, 2 failed (mcpscripts server error), 2 skipped
- Run URL: https://github.com/github/gh-aw/actions/runs/25212030870
- Timestamp: 2026-05-01
- PR used for review tests: Add TruffleHog shared agentic workflow for secret detection in smoke-codex #29512 (Add TruffleHog shared agentic workflow)
Core Tests (#1–12)
| # | Test | Result | Notes |
|---|---|---|---|
| 1 | GitHub MCP (last 2 merged PRs) | ✅ | PR #29516, #29518 |
| 2 | MCP Scripts GH CLI | ❌ | tool.handler is not a function — mcpscripts server error |
| 3 | Serena MCP (activate + find symbols) | ✅ | 100+ symbols found in pkg/ |
| 4 | Make Build | ✅ | gh-aw binary built successfully |
| 5 | Playwright (github.com) | ✅ | Title confirmed "GitHub · Change is constant..." |
| 6 | Tavily Web Search | ✅ | 5 results for "GitHub Agentic Workflows" |
| 7 | File Writing | ✅ | /tmp/gh-aw/agent/smoke-test-claude-25212030870.txt |
| 8 | Bash Tool | ✅ | File content verified via cat |
| 9 | Discussion Interaction | ❌ | tool.handler is not a function — mcpscripts server error |
| 10 | Agentic Workflows MCP Status | ✅ | smoke-claude active, triggers: PR label, reaction, status-comment |
| 11 | Slack Safe Output | ✅ | Posted to #smoke-tests |
| 12 | Code Scanning Alert | ✅ | Dummy warning posted to README.md:1 |
PR Review Tests (#13–19)
| # | Test | Result | Notes |
|---|---|---|---|
| 13 | Update PR Body | ✅ | Appended test message to PR #29512 |
| 14 | PR Review Comments | ✅ | 2 inline comments on trufflehog.md (lines 5, 153) |
| 15 | Submit PR Review | ✅ | COMMENT review submitted with summary |
| 16 | Resolve Review Thread | Skipped — thread node IDs (PRRT_kwDO...) not obtainable from GitHub MCP get_review_comments |
|
| 17 | Add Reviewer | ✅ | Added copilot as reviewer |
| 18 | Push to PR Branch | ✅ | smoke-test-files/smoke-claude-push-test.md committed and pushed |
| 19 | Close PR | Skipped — no safe test PR to close |
Failures
Tests 2 & 9 both failed due to the same root cause: the mcpscripts MCP server returned Error [-32603]: calling "tools/call": tool.handler is not a function for the gh and github_discussion_query tools. This is a server-side tool registration issue.
Error details
[info] [mcpscripts] Calling tool 'gh' with args: {"args":"pr list ..."}
Error [-32603]: calling "tools/call": tool.handler is not a function
Both MCP tool calls and CLI invocations (mcpscripts gh, mcpscripts github_discussion_query) produced the identical error.
💥 [THE END] — Illustrated by Smoke Claude · ● 283.7K · ◷
- expires on May 1, 2026, 1:17 PM UTC
Reactions are currently unavailable
Activity
github-actions commentedon May 1, 2026
This issue was automatically closed because it expired on 2026-05-01T13:17:10.506Z.