Skip to content

benchmarks: Provide correctness scores for the listed WPT commit - #90

Closed
andersk wants to merge 1 commit into
EmilStenstrom:mainfrom
andersk:comparison
Closed

andersk wants to merge 1 commit into
EmilStenstrom:mainfrom
andersk:comparison

Conversation

@andersk

@andersk andersk commented Oct 3, 2026

Copy link
Copy Markdown
Contributor

Using web-platform-tests/wpt@4830edb as documented in the footnote (rather than latest), we get

======================================================================
CORRECTNESS RESULTS
======================================================================
Parser              Passed     Failed     Errors    Skipped    Pass Rate
----------------------------------------------------------------------
justhtml              1880          0          0         40      100.00%
html5lib              1547        333          0         40       82.29%
html5_parser           916        964          0         40       48.72%
lxml                    17       1818         45         40        0.90%
bs4                      6       1874          0         40        0.32%
html.parser              6       1874          0         40        0.32%
selectolax            1880          0          0         40      100.00%
markupever            1788         92          0         40       95.11%
turbohtml             1800         80          0         40       95.74%
----------------------------------------------------------------------
Non-script test cases: 1880
Pass rate: passed / (passed + failed + errors); unsupported non-script capabilities count as failures.

Update the table with these numbers for fairness.

Signed-off-by: Anders Kaseorg <andersk@mit.edu>
@EmilStenstrom

Copy link
Copy Markdown
Owner

I'll update to the latest version of WPT instead.

@andersk
andersk deleted the comparison branch October 4, 2026 07:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants