[mcp-analysis] MCP Structural Analysis - 2026-09-23 #62941
Closed
Replies: 1 comment
|
This discussion has been marked as outdated by GitHub MCP Structural Analysis. A newer discussion is available at Discussion #63172. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
MCP Structural Analysis — 2026-09-23
Tested 9 representative GitHub MCP tools plus the injected workflow-context block across all available toolsets. Ratings held stable (avg 3.6/5, in line with the 17-day trend range of 3.2–3.7). The standout finding remains
list_code_scanning_alerts: even with a boundedperPage=5call it cost 5,900 tokens — by far the most expensive single call today — driven by verbatim-repeated rule descriptions rather than alert diversity. Best value tools were the zero-costgithub-contextblock and the clean, wrapper-basedlist_workflows.Full Structural Analysis Report
Executive Summary
github_context/list_workflows: 5/5list_issues: 2/5Usefulness Ratings for Agentic Work
github_contextlist_workflowsget_file_contentslist_pull_requestssearch_codelist_code_scanning_alertsget_labellist_discussionssearch_userslist_issuesSchema Analysis
github_contextget_file_contentslist_issueslist_pull_requestslist_workflowslist_code_scanning_alertslist_discussionsget_labelsearch_userssearch_codeResponse Size Analysis
Tool-by-Tool Analysis (Today)
github_contextlist_workflowsget_file_contentslist_pull_requestssearch_codelist_code_scanning_alertsget_labellist_discussionssearch_userslist_issues30-Day Trend Summary
Recommendations
github_context,list_workflows(mcpscripts wrapper),get_file_contents,list_pull_requests,search_code.list_code_scanning_alerts(deduplicate rule-levelfull_description/helptext from per-instance data — this alone would cut the toolset's average from ~6,800 tokens dramatically);list_issues(integrity-policy redaction blocks agent assessment on every measured day, 17/17).github_context(90 tokens, zero MCP cost),list_workflowsvia mcpscripts wrapper (172 tokens, full pagination metadata).list_code_scanning_alertsremains the single largest per-call cost by a wide margin, even when bounded withperPage=5;get_file_contentsvaries wildly by target file (207x range observed: 46 tokens for a tiny PR list vs 36,600+ for unbounded alert pulls).Visualizations
Response Size by Toolset
Usefulness Ratings
Daily Token Trend
Size vs Usefulness
Warning
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
api.anthropic.comTo allow these domains, add them to the
network.allowedlist in your workflow frontmatter:See Network Configuration for more information.
All reactions