Skip to content

Work on Python FBI Speed improvements - #116

Merged
AndrewQuijano merged 8 commits into
masterfrom
speed
Oct 12, 2026
Merged

AndrewQuijano merged 8 commits into
masterfrom
speed

Conversation

@AndrewQuijano

@AndrewQuijano AndrewQuijano commented Oct 12, 2026 •

Copy link
Copy Markdown
Collaborator

Your checklist for this pull request

  • I've documented or updated the documentation of every function and struct that this PR changes.
  • I've added tests that prove my fix is effective or that my feature works (if possible)

Detailed description

  1. Create a Python script, that reads and dumps the database, this avoids having to manually update the bug_mining.py script to dump the data
  2. Before this Python took 70 seconds and C++ 30 seconds or so, there are some other massive speed improvements we can make in Python with the goal of replacing C++ fully soon.

Now Python takes 21 seconds, faster than C++ with parity kept:
image

...

Test plan

A new lava-dump script is added, so it can be called directly to compare the databases via a quick diff with Python and C++.

...

Closing issues

N/A
...

@github-actions github-actions Bot added Github-files GitHub CI/CD Pyroclastic Python LAVA code labels Oct 12, 2026
@AndrewQuijano AndrewQuijano changed the title Work on Speed improvements Work on Python FBI Speed improvements Oct 12, 2026
Cache trigger skip identities across calls, batch-load DUA
relationships, and prune expired incarnations with a death heap.

Preserve per-call skip behavior, discovery order, and RET_BUFFER
processing before pruning. Add regression coverage.
@AndrewQuijano
AndrewQuijano merged commit 74eac75 into master Oct 12, 2026
4 checks passed
@AndrewQuijano
AndrewQuijano deleted the speed branch October 12, 2026 16:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Github-files GitHub CI/CD Lava-Core LAVA C/C++ code Pyroclastic Python LAVA code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant