🤖 Smoke Test: Claude Engine — Run 37017192067
Run URL: https://github.com/github/gh-aw/actions/runs/37017192067 Timestamp: 2026-10-02T14:09 UTCPR Under Test: #64970 — Claude: default to strict MCP configuration
Core Tests (#1 –12)
#
Test
Status
Notes
1
GitHub MCP Testing
✅
Last 2 merged: #65027 , #64981
2
GH CLI Testing
✅
gh pr list returned 2 PRs
3
Make Build Testing
✅
make build succeeded
4
Playwright Testing
✅
Title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
5
Tavily Web Search Testing
❌
HTTP 429 — rate limit exceeded
6
File Writing Testing
✅
/tmp/gh-aw/agent/smoke-test-claude-37017192067.txt created
7
Bash Tool Testing
✅
File contents verified via cat
8
Discussion Interaction Testing
✅
Discussion #335 found; comment posted
9
Agentic Workflows MCP Testing
✅
2 workflows found: smoke-claude (active), smoke-claude-on-copilot (active)
10
Slack Script Safe Output
✅
Posted to #smoke-tests
11
Code Scanning Alert
✅
Dummy warning alert created
12
Check Run
✅
Check run created with conclusion: success
PR Review Tests (#13 –19)
#
Test
Status
Notes
13
Update PR Testing
✅
Appended test message to PR #64970 body
14
PR Review Comment Testing
✅
2 review comments added on claude_engine.go and claude_engine_test.go
15
Submit PR Review Testing
✅
Review submitted with COMMENT event
16
Resolve Review Thread Testing
⚠️ Skipped — GraphQL returned null (no thread node IDs available)
17
Add Reviewer Testing
✅
Added copilot as reviewer
18
Push to PR Branch Testing
✅
Pushed smoke-test-files/smoke-claude-push-test.md to branch
19
Close PR Testing
⚠️ Skipped — no safe test PR to close
Overall Status: PARTIAL (1 failure: Tavily rate limit; 2 skipped)
Error Details
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
To allow these domains, add them to the network.allowed list in your workflow frontmatter:
network :
allowed :
- defaults
- " clients2.google.com" See Network Configuration for more information.
💥 [THE END] — Illustrated by Smoke Claude · claude · sonnet46 · 51.7 AIC · ⌖ 18.5 AIC · ⊞ 854 · ◷ Comment /smoke-claude to run again
🤖 Smoke Test: Claude Engine — Run 37017192067
Run URL: https://github.com/github/gh-aw/actions/runs/37017192067
Timestamp: 2026-10-02T14:09 UTC
PR Under Test: #64970 — Claude: default to strict MCP configuration
Core Tests (#1–12)
gh pr listreturned 2 PRsmake buildsucceeded/tmp/gh-aw/agent/smoke-test-claude-37017192067.txtcreatedcatsmoke-claude(active),smoke-claude-on-copilot(active)#smoke-testsPR Review Tests (#13–19)
claude_engine.goandclaude_engine_test.gocopilotas reviewersmoke-test-files/smoke-claude-push-test.mdto branchOverall Status: PARTIAL (1 failure: Tavily rate limit; 2 skipped)
Error Details
{"data":null}— unable to retrieve review thread node IDs.Warning
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
clients2.google.comTo allow these domains, add them to the
network.allowedlist in your workflow frontmatter:See Network Configuration for more information.