Skip to content

Buyer leads: a web source, Google over all of Reddit and the forums - #149

Merged
ralyodio merged 1 commit into
mainfrom
feat/buyer-leads-web
Oct 7, 2026
Merged

ralyodio merged 1 commit into
mainfrom
feat/buyer-leads-web

Conversation

@ralyodio

@ralyodio ralyodio commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Anthony asked for ValueSERP (or the /search stack) as a source. The Reddit
archive only reads subreddits it is given; one Google search for fail2ban /
crowdsec / wazuh over the past week found fresh threads in r/Wazuh,
r/Authentik, r/jellyfin and r/foss, none of them on ThreatCrush's list.

  • WebDiscussionSource: ValueSERP, one query per site (it ignores
    site:a OR site:b) over reddit.com, stackexchange.com, serverfault.com,
    quora.com and indiehackers.com, keywords OR-ed five to a query, past day or
    past week. Thread pages only. Reddit hits are filled in from Arctic Shift by
    post id (full text, author, time) and dedupe with the archive source.
  • Paid per query, so it runs at most once every 20 hours per monitor
    (webAt on the last result), however often the monitor scans.
  • web is a monitor source (default on; reads nothing without
    VALUESERP_API_KEY). WebSearcher.search takes a time period.

The cli-tools /search fan-out was considered: it has no date filter, caps
at 10 hits per provider on free-tier keys, and is not an importable package.

🤖 Generated with Claude Code

Anthony asked for ValueSERP (or the /search stack) as a source. The Reddit
archive only reads subreddits it is given; one Google search for fail2ban /
crowdsec / wazuh over the past week found fresh threads in r/Wazuh,
r/Authentik, r/jellyfin and r/foss, none of them on ThreatCrush's list.

- WebDiscussionSource: ValueSERP, one query per site (it ignores
  site:a OR site:b) over reddit.com, stackexchange.com, serverfault.com,
  quora.com and indiehackers.com, keywords OR-ed five to a query, past day or
  past week. Thread pages only. Reddit hits are filled in from Arctic Shift by
  post id (full text, author, time) and dedupe with the archive source.
- Paid per query, so it runs at most once every 20 hours per monitor
  (webAt on the last result), however often the monitor scans.
- `web` is a monitor source (default on; reads nothing without
  VALUESERP_API_KEY). WebSearcher.search takes a time period.

The cli-tools /search fan-out was considered: it has no date filter, caps
at 10 hits per provider on free-tier keys, and is not an importable package.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@ralyodio
ralyodio merged commit 981e820 into main Oct 7, 2026
4 checks passed
@ralyodio ralyodio mentioned this pull request Oct 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant