Skip to content

Fix the always-empty Nextflow version in the CodSpeed workflow - #4442

Open
FelixKrueger wants to merge 1 commit into
nf-core:devfrom
FelixKrueger:fix/codspeed-nextflow-version
Open

Fix the always-empty Nextflow version in the CodSpeed workflow#4442
FelixKrueger wants to merge 1 commit into
nf-core:devfrom
FelixKrueger:fix/codspeed-nextflow-version

Conversation

@FelixKrueger

Copy link
Copy Markdown

codspeed.yml passes version: ${{ github.event.inputs.nextflow-version || matrix.nextflow-version }} to setup-nextflow, but this workflow declares neither operand — its workflow_dispatch: is bare and the job has no strategy: — so the value is always an empty string, which explicitly overrides the action's own latest-stable default. The job fails at Install Nextflow with Could not retrieve Nextflow release matching . and has never completed. Dropping the with: block lets the default apply. Happy to pin an explicit version instead if you'd rather keep the benchmarks on a fixed Nextflow.

Detail (AI-assisted)
  • The step looks copied from pytest.yml, which does declare both operands (a workflow_dispatch input and a nextflow-version matrix axis), so the same expression resolves there.
  • The action's message blames the nf-co.re endpoint, but that endpoint returns well-formed JSON — the empty string after matching is the actual tell.
  • The last 12 runs of this workflow are 11 × failure and 1 × cancelled, back to 2026-07-29, on main and dev as well as PR branches.

The version: input was ${{ github.event.inputs.nextflow-version ||
matrix.nextflow-version }}, copied from pytest.yml. That workflow declares
both operands -- a workflow_dispatch input and a matrix axis -- but
codspeed.yml has a bare workflow_dispatch: and no strategy:, so the
expression is always empty and explicitly overrides the action's own
latest-stable default with nothing.

setup-nextflow then reports "Could not retrieve Nextflow release matching ."
and attributes it to the nf-co.re endpoint, which is healthy; the empty
string after "matching" is the actual tell.

Dropping the with: block lets the action's default apply. Every run of this
workflow has failed since at least 2026-07-29, on main and dev as well as on
PR branches.
@FelixKrueger
FelixKrueger force-pushed the fix/codspeed-nextflow-version branch from 8fcd5e3 to cb623e0 Compare August 12, 2026 10:24
@FelixKrueger
FelixKrueger changed the base branch from main to dev August 12, 2026 10:24
@codecov

codecov Bot commented Aug 12, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 78.19%. Comparing base (cb623e0) to head (0358cea).

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@codspeed-hq

codspeed-hq Bot commented Aug 12, 2026

Copy link
Copy Markdown
Contributor

Hooray! CodSpeed harness just leveled up!

The base and head of this comparison were measured with different runner settings, so their benchmark values are not directly comparable.

What changed between base and head:

  • CodSpeed runner v5 changed how benchmarks are measured (base 4.18.4 → head 5.0.1). View release notes

Re-run the base with the same settings to get a valid performance comparison.


Comparing FelixKrueger:fix/codspeed-nextflow-version (0358cea) with dev (cb0ac11)1

Open in CodSpeed

Footnotes

  1. No successful run was found on dev (cb623e0) during the generation of this report, so cb0ac11 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant