Skip to content

Filter hacked submissions from leaderboard queries#500

Merged
SinatrasC merged 2 commits into
gpu-mode:mainfrom
SinatrasC:filter-hacked-leaderboard-db-current
Jun 22, 2026
Merged

Filter hacked submissions from leaderboard queries#500
SinatrasC merged 2 commits into
gpu-mode:mainfrom
SinatrasC:filter-hacked-leaderboard-db-current

Conversation

@SinatrasC

@SinatrasC SinatrasC commented Jun 21, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Exclude submissions marked hacked from leaderboard rankings and leaderboard submission counts.
  • Check both leaderboard.submission.status and leaderboard.submission_job_status.status so queued/background hacked markings are filtered too.
  • Add a regression test covering submission-status hacked rows, job-status hacked rows, and a clean visible row.

Why

  • Retroactive KernelGuard marking should remove entries from ranking views without deleting submission/run evidence.
  • Background jobs can record submission_job_status.status = hacked, while direct marking also updates submission.status.

Validation

  • RUFF_CACHE_DIR=/tmp/kernelbot-ruff-cache uv run --with ruff ruff check . --exclude examples/ --line-length 120
  • uv run --extra dev pytest tests/test_leaderboard_db.py -q
  • uv run python -m py_compile src/libkernelbot/leaderboard_db.py tests/test_leaderboard_db.py

@SinatrasC SinatrasC marked this pull request as ready for review June 21, 2026 21:47
@SinatrasC SinatrasC force-pushed the filter-hacked-leaderboard-db-current branch from 1a388f3 to cf14ee3 Compare June 21, 2026 22:38
@SinatrasC SinatrasC merged commit 3630977 into gpu-mode:main Jun 22, 2026
3 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant