chore(antithesis): DiffEq, count total contexts emitted - #2157
Conversation
This stack of pull requests is managed by Graphite. Learn more about stacking. |
|
Binary Size Analysis (Agent Data Plane)Baseline: e4cba81 · Comparison: 54fb12c · diff ✅ Binary size difference within thresholdChanges by Module
Detailed Symbol Changes |
93c9df1 to
662a005
Compare
662a005 to
4ce3352
Compare
Regression Detector (Agent Data Plane)Run ID: Optimization Goals: ✅ No significant changes detectedFine details of change detection per experiment (3)Experiments configured
Bounds Checks: ✅ Passed (3)
ExplanationA change is flagged as a regression when |Δ mean %| > 5.00% in the regressing direction for its optimization goal AND SMP marks the experiment as a regression ( |
This commit adjusts the differential scenario to also count the total number of contexts emitted in a run by both lanes. Previously the symdiff of ADP-on / ADP-off would pass even if, say, the ratio of actually emitted contexts was 10:1 or whatever. We now say that this ratio closes to 1:1 over time. I have needed to fiddle with the faults present in the differential scenario just because one lane being network faulted while the other isn't doesn't make much sense.
4ce3352 to
54fb12c
Compare

Summary
Change Type
How did you test this PR?
References