Skip to content

List sources: retry a timed-out search instead of closing the week - #141

Merged
ralyodio merged 1 commit into
mainfrom
fix/list-sources-retry
Oct 7, 2026
Merged

ralyodio merged 1 commit into
mainfrom
fix/list-sources-retry

Conversation

@ralyodio

@ralyodio ralyodio commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Seen in prod on the first 0.12.1 sweep: funding … 0 new (ValueSERP did not answer within 60 s) for most products, and the timed-out scan was recorded as done for the week.

  • A scan that errored and found nothing is no longer recorded, so the next hourly sweep retries it (each try still counts against the 40/day cap; 402 still stops everything).
  • News searches get a 150 s timeout (ValueSERP news answers of 60-120 s are normal; web search keeps 60 s).

Test: a flaky searcher fails funding/leadership once, the next sweep completes them. list-sources + valueserp 21/21.

🤖 Generated with Claude Code

In production most ValueSERP news searches took over 60 s, timed out, and
were recorded as done for the week, so funding and appointment scans for
most products never ran. A scan that errored without results is now left
unrecorded and tried on the next hourly sweep (still counted against the
daily cap), and news searches get a 150 s timeout.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@ralyodio
ralyodio merged commit c12cdc6 into main Oct 7, 2026
4 checks passed
@ralyodio ralyodio mentioned this pull request Oct 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant