`nav-bench` is a new prototype benchmark which measures pageload and sub
navigation performance across 5 sites (Amazon, BBC, DuckDuckGo, Reddit,
Wikipedia) in a single combined browsertime session.
Score is calculated as the geomean of 60000 (ms) /SpeedIndex (ms) across
all sites and cycles (inspired by LoadLine)
Runs at tier 3 (for now) on:
- Linux (ubuntu 24.04)
- Windows 11
- Windows 11 (ref)
- macOS (aarch64)
Uses the recently added mitmproxy 12.2.1
`nav-serverplayback.py` is a separate script rather than an extension of
`alt-serverplayback.py` for a couple of reasons:
1. API incompatibility between mitmproxy 12.2.1 and 8.1.1/11.0.0 it did
not make sense for a single script to satisfy all versions without
significan branching logic
2. Extending `alt-serverplayback.py` risks regressiong every existing
tp6 test which relies on it. Modifying it would require re-validating
everything.
This "duplication" is temporary. Bug 2025545 tracks upgrading
everything to mitmproxy 12 (or whatever the latest is at the time) and
Bug 2025374 tracks upstreaming some changes to use mitmproxy built-in
flags entirely.
Co-authored-by: Andrew Creskey <acreskey@mozilla.com>
Differential Revision: https://phabricator.services.mozilla.com/D301754
