fix(workflow): use gpt-5.4-mini and raise max-ai-credits for copilot-token-usage-analyzer by Copilot · Pull Request #4877 · github/gh-aw-firewall

Copilot · 2026-06-13T14:33:21Z

The daily Copilot token usage analyzer was hitting its max-ai-credits: 1000 guardrail because the workflow defaulted to claude-sonnet-4.6 — a frontier model unnecessarily expensive for structured JSON analysis and report generation.

Changes

copilot-token-usage-analyzer.md — pin engine.model: gpt-5.4-mini (replaces the GH_AW_DEFAULT_MODEL_COPILOT fallback chain that resolved to claude-sonnet-4.6); set max-ai-credits: 2500 to match the actual workload size (up to 50 runs + historical trend comparison)
copilot-token-usage-analyzer.lock.yml — recompiled; COPILOT_MODEL, GH_AW_INFO_MODEL, maxAiCredits in the AWF firewall config, and GH_AW_MAX_AI_CREDITS env all updated to reflect the new values

engine:
  id: copilot
  model: gpt-5.4-mini   # was: claude-sonnet-4.6 via GH_AW_DEFAULT_MODEL_COPILOT
max-ai-credits: 2500    # was: 1000 (global default)

…x-ai-credits to 2500

github-actions · 2026-06-13T15:42:34Z

✅ Coverage Check Passed

Overall Coverage

Metric	Base	PR	Delta
Lines	96.60%	96.64%	📈 +0.04%
Statements	96.47%	96.51%	📈 +0.04%
Functions	98.78%	98.78%	➡️ +0.00%
Branches	91.22%	91.25%	📈 +0.03%

📁 Per-file Coverage Changes (1 files)

File	Lines (Before → After)	Statements (Before → After)
`src/config-writer.ts`	89.9% → 91.1% (+1.19%)	89.9% → 91.1% (+1.19%)

Coverage comparison generated by scripts/ci/compare-coverage.ts

Copilot

Pull request overview

This PR updates the daily Copilot token usage analyzer workflow to use a cheaper Copilot model (gpt-5.4-mini) and increases the AI-credits budget to avoid prematurely tripping the workflow’s max-ai-credits guardrail during larger analyses.

Changes:

Pin Copilot engine model to gpt-5.4-mini in the source .md workflow definition.
Raise workflow max-ai-credits to 2500 and propagate the updated model/credits into the compiled .lock.yml.
Update the compiled lock workflow’s environment/config wiring to reflect the pinned model and higher max credits.

Show a summary per file

File	Description
`.github/workflows/copilot-token-usage-analyzer.md`	Pins Copilot engine model to `gpt-5.4-mini` and raises `max-ai-credits` to `2500`.
`.github/workflows/copilot-token-usage-analyzer.lock.yml`	Updates compiled workflow to use the new model and max-ai-credits, but currently appears to miss required repo post-processing conventions for lock files.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Files reviewed: 2/2 changed files
Comments generated: 4

+      - name: Install AWF binary
+        run: bash "${RUNNER_TEMP}/gh-aw/actions/install_awf_binary.sh" v0.27.2


Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot · 2026-06-13T15:57:47Z

@copilot address review feedback

Addressed in b948e90.

github-actions · 2026-06-13T16:14:03Z

🔥 Smoke Test Results — PASS

Test	Result
GitHub MCP (list PRs)	✅
GitHub.com connectivity (HTTP 200)	✅
File write/read	✅

PR: fix(workflow): use gpt-5.4-mini and raise max-ai-credits for copilot-token-usage-analyzer
Author: @Copilot | Assignees: @lpcox @Copilot

📰 BREAKING: Report filed by Smoke Copilot

github-actions · 2026-06-13T16:14:15Z

Smoke Test Results — Auth mode: PAT (COPILOT_GITHUB_TOKEN)

Test	Result
GitHub MCP connectivity	✅
GitHub.com HTTP	❌ (pre-step data not injected)
File write/read	❌ (pre-step data not injected)

Overall: FAIL — pre-step template variables were not substituted; HTTP and file tests could not be verified.

PR: "fix(workflow): use gpt-5.4-mini and raise max-ai-credits for copilot-token-usage-analyzer"
Author: @Copilot | Assignees: @lpcox @Copilot

🔑 PAT report filed by Smoke Copilot PAT

github-actions · 2026-06-13T16:14:44Z

Smoke Test: Copilot BYOK (Direct Mode) ✅ PASS

✅ MCP connectivity verified
✅ GitHub.com connectivity (HTTP 200)
✅ File write/read capability
✅ Direct BYOK inference (agent → api-proxy → api.githubcopilot.com)

Running in direct BYOK mode (COPILOT_PROVIDER_API_KEY via api-proxy sidecar). Author: @Copilot, Assignees: @lpcox, @Copilot

🔑 BYOK report filed by Smoke Copilot BYOK

github-actions · 2026-06-13T16:14:54Z

Smoke test results:
✅ fix: add noop fallback to smoke-copilot workflows on non-PR triggers
✅ Reduce test-coverage-reporter prompt surface and coverage payload size
✅ GitHub title contains GitHub
✅ Temp file created and read back
✅ npm ci && npm run build
Overall status: PASS

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

registry.npmjs.org

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "registry.npmjs.org"

See Network Configuration for more information.

🔮 The oracle has spoken through Smoke Codex

github-actions · 2026-06-13T16:16:10Z

@Copilot @lpcox
fix(workflow): use gpt-5.4-mini and raise max-ai-credits for copilot-token-usage-analyzer

MCP testing: ✅
GitHub.com connectivity: ✅
File write/read test: ✅
BYOK inference: ✅
Running in direct BYOK mode (AWF_AUTH_TYPE=github-oidc + AWF_AUTH_AZURE_* + COPILOT_PROVIDER_BASE_URL) via api-proxy → Azure OpenAI (Foundry, o4-mini-aw) authenticated via Microsoft Entra
Overall: PASS

🪪 BYOK (AOAI Entra) report filed by Smoke Copilot BYOK AOAI (Entra)

github-actions · 2026-06-13T16:16:29Z

🏗️ Build Test Suite Results

Ecosystem	Project	Build/Install	Tests	Status
Bun	elysia	✅	1/1 passed	✅ PASS
Bun	hono	✅	1/1 passed	✅ PASS
C++	fmt	✅	N/A	✅ PASS
C++	json	✅	N/A	✅ PASS
Deno	oak	N/A	1/1 passed	✅ PASS
Deno	std	N/A	1/1 passed	✅ PASS
.NET	hello-world	✅	N/A	✅ PASS
.NET	json-parse	✅	N/A	✅ PASS
Go	color	✅	1/1 passed	✅ PASS
Go	env	✅	1/1 passed	✅ PASS
Go	uuid	✅	1/1 passed	✅ PASS
Java	gson	✅	1/1 passed	✅ PASS
Java	caffeine	✅	1/1 passed	✅ PASS
Node.js	clsx	✅	All passed	✅ PASS
Node.js	execa	✅	All passed	✅ PASS
Node.js	p-limit	✅	All passed	✅ PASS
Rust	fd	✅	1/1 passed	✅ PASS
Rust	zoxide	✅	1/1 passed	✅ PASS

Overall: 8/8 ecosystems passed — ✅ PASS

Generated by Build Test Suite for issue #4877 · ◷

github-actions · 2026-06-13T16:16:47Z

Smoke Test: GitHub Actions Services Connectivity

Check	Result
Redis PING	❌ No response (timeout)
PostgreSQL pg_isready	❌ No response
PostgreSQL SELECT 1	❌ No response (timeout)

Overall: FAIL

host.docker.internal resolves to 172.17.0.1 but no services responded on ports 6379 or 5432. Service containers may not be running or are not reachable from this runner context.

🔌 Service connectivity validated by Smoke Services

github-actions · 2026-06-13T16:20:23Z

✅ fix(workflow): use gpt-5.4-mini and raise max-ai-credits for copilot-token-usage-analyzer
✅ GitHub MCP connectivity
✅ GitHub.com HTTP connectivity (200)
✅ File write/read test (agent-test)
✅ Running in direct BYOK mode (COPILOT_PROVIDER_API_KEY + COPILOT_PROVIDER_BASE_URL) via api-proxy → Azure OpenAI (Foundry, o4-mini-aw)

Overall: PASS

cc @Copilot @lpcox

🔑 BYOK (AOAI api-key) report filed by Smoke Copilot BYOK AOAI (api-key)

Initial plan

dd706e4

Copilot AI assigned Copilot and lpcox Jun 13, 2026

Copilot started work on behalf of lpcox June 13, 2026 14:39 View session

fix: switch copilot-token-usage-analyzer to gpt-5.4-mini and raise ma…

c6ded1a

…x-ai-credits to 2500

Copilot AI changed the title ~~[WIP] Increase max AI credits for Daily Copilot Token Usage Analyzer~~ fix(workflow): use gpt-5.4-mini and raise max-ai-credits for copilot-token-usage-analyzer Jun 13, 2026

Copilot finished work on behalf of lpcox June 13, 2026 14:46

Copilot AI requested a review from lpcox June 13, 2026 14:46

lpcox marked this pull request as ready for review June 13, 2026 15:41

Copilot AI review requested due to automatic review settings June 13, 2026 15:41

Copilot started reviewing on behalf of lpcox June 13, 2026 15:41 View session

Copilot AI had a problem deploying to aoai-model June 13, 2026 15:42 Failure

Copilot AI reviewed Jun 13, 2026

View reviewed changes

This comment has been minimized.

Sign in to view

github-actions Bot added the smoke-copilot-byok label Jun 13, 2026

This comment has been minimized.

Sign in to view

github-actions Bot added the smoke-copilot-pat label Jun 13, 2026

github-actions Bot mentioned this pull request Jun 13, 2026

[aw] No-Op Runs #4045

Open

This comment has been minimized.

Sign in to view

github-actions Bot added the smoke-codex label Jun 13, 2026

Copilot AI temporarily deployed to aoai-model June 13, 2026 15:49 Inactive

This comment has been minimized.

Sign in to view

github-actions Bot added the build-test label Jun 13, 2026

This comment has been minimized.

Sign in to view

lpcox and others added 3 commits June 13, 2026 08:52

Potential fix for pull request finding

a5c4f58

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Potential fix for pull request finding

cc6002b

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Potential fix for pull request finding

c31fc06

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot started work on behalf of lpcox June 13, 2026 15:53 View session

lpcox temporarily deployed to aoai-model June 13, 2026 15:54 — with GitHub Actions Inactive

fix(ci): postprocess copilot token analyzer lock workflow

b948e90

github-actions Bot mentioned this pull request Jun 13, 2026

[aw] Contribution Check is missing required data #4883

Closed

Copilot finished work on behalf of lpcox June 13, 2026 15:58

This comment has been minimized.

Sign in to view

github-actions Bot added the smoke-copilot-byok-aoai-apikey label Jun 13, 2026

This comment has been minimized.

Sign in to view

github-actions Bot added the smoke-copilot-byok-aoai-entra label Jun 13, 2026

This comment has been minimized.

Sign in to view

Copilot AI temporarily deployed to aoai-model June 13, 2026 16:10 Inactive

github-actions Bot added the smoke-copilot label Jun 13, 2026

Copilot AI temporarily deployed to aoai-model June 13, 2026 16:15 Inactive

Copilot AI temporarily deployed to aoai-model June 13, 2026 16:16 Inactive

lpcox merged commit 2d567fc into main Jun 13, 2026
74 of 77 checks passed

lpcox deleted the copilot/aw-daily-token-usage-analyzer-increase-limit branch June 13, 2026 16:28

		- name: Install AWF binary
		run: bash "${RUNNER_TEMP}/gh-aw/actions/install_awf_binary.sh" v0.27.2

Conversation

Copilot AI commented Jun 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Uh oh!

github-actions Bot commented Jun 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Coverage Check Passed

Overall Coverage

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Copilot's findings

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copilot AI commented Jun 13, 2026

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

github-actions Bot commented Jun 13, 2026

🔥 Smoke Test Results — PASS

Uh oh!

github-actions Bot commented Jun 13, 2026

Smoke Test Results — Auth mode: PAT (COPILOT_GITHUB_TOKEN)

Uh oh!

github-actions Bot commented Jun 13, 2026

Uh oh!

github-actions Bot commented Jun 13, 2026

Uh oh!

github-actions Bot commented Jun 13, 2026

Uh oh!

github-actions Bot commented Jun 13, 2026

🏗️ Build Test Suite Results

Uh oh!

github-actions Bot commented Jun 13, 2026

Smoke Test: GitHub Actions Services Connectivity

Uh oh!

github-actions Bot commented Jun 13, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Copilot AI commented Jun 13, 2026 •

edited

Loading

github-actions Bot commented Jun 13, 2026 •

edited

Loading