Joe Bowser
2956c527b6
Cover the real Link Preview production model (SmolLM2-360M Q8)
with the same structural assertions the mochitest sibling in
browser_ml_native.js applies to TinyStories. Runs under the
perftest harness because hooks_local_hub.py can serve the GGUF
from MOZ_FETCHES_DIR/onnx-models/; the mochitest sandbox blocks
external hosts and the GGUF is too large to vendor.
Unlike TinyStories, SmolLM2's greedy output is byte-identical on
every architecture in our CI fleet (Linux/Windows x86_64, macOS
aarch64). Its top-1 logit margins are wide enough to absorb
FP-rounding differences from any of the SIMD widths or math
libraries in play (Apple Accelerate included), so the pinned
EXPECTED_TEXT + EXPECTED_HASH don't dispatch on
AppConstants.platform.
Each task emits a heartbeat info() line around engine init so
the harness's "no output for 370s" outer timeout doesn't fire
during the slow GGUF mmap.
Wiring:
- ml-llama-smollm2-smoke task in
taskcluster/kinds/perftest/{linux,windows11-24h2,windows11-24h2-ref}.yml,
each fetching only smollm2-360-instruct-gguf.
- perftest.toml entry with disabled = ... so the test runs only
via mach perftest.
- python/mozperftest/perfdocs/config.yml entry + regenerated
testing/perfdocs/generated/mozperftest.rst for the perfdocs lint.
macOS Intel 10.15 is intentionally not covered: native llama.cpp
was unstable there for TinyStories (see the runtime skip in
test_ml_smoke_test_llama_golden_text), macOS 10.15 is EOL, and
the releng-hardware pool has multi-hour queue depth. Revisit
once a macOS aarch64 perftest worker pool exists.
Not covered here:
- Android perftest task — Link Preview is desktop-only today.
- Semantic similarity / KL divergence — LlamaRunner doesn't
expose logits from JS; that warrants its own bug.
Mach Try (All Green): https://treeherder.mozilla.org/jobs?repo=try&revision=4e54266f9c7d9a4db5b3a058bab3dc763d421255
Differential Revision: https://phabricator.services.mozilla.com/D308152
890 lines
57 KiB
ReStructuredText
890 lines
57 KiB
ReStructuredText
===========
|
|
Mozperftest
|
|
===========
|
|
|
|
**Mozperftest** can be used to run performance tests.
|
|
|
|
|
|
.. toctree::
|
|
|
|
running
|
|
tools
|
|
writing
|
|
developing
|
|
vision
|
|
|
|
The following documents all testing we have for mozperftest.
|
|
If the owner does not specify the Usage and Description, it's marked N/A.
|
|
|
|
accessible/tests/browser/performance
|
|
------------------------------------
|
|
Performance tests for the accessibility engine
|
|
|
|
browser_addManyIds.js
|
|
=====================
|
|
|
|
:owner: Accessibility Team
|
|
:name: browser_addManyIds.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--extra-args headless
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--perfherder
|
|
--perfherder-metrics name:A11Y_TotalTime,unit:ms,shouldAlert:True, name:A11Y_DoInitialUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_parent,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_RecvCache_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_SendCache_parent,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_parent,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_parent,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_DoInitialUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_content,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_RecvCache_content,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_content,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_SendCache_content,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_content,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_content,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_content,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_content,unit:iterations,shouldAlert:False
|
|
--try-platform linux, mac, win
|
|
--verbose
|
|
|
|
**Audit a11y performance when adding 10000 IDs to nodes in DOM.**
|
|
|
|
browser_addManyNodes.js
|
|
=======================
|
|
|
|
:owner: Accessibility Team
|
|
:name: browser_addManyNodes.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--extra-args headless
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--perfherder
|
|
--perfherder-metrics name:A11Y_TotalTime,unit:ms,shouldAlert:True, name:A11Y_DoInitialUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_parent,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_RecvCache_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_SendCache_parent,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_parent,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_parent,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_DoInitialUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_content,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_RecvCache_content,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_content,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_SendCache_content,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_content,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_content,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_content,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_content,unit:iterations,shouldAlert:False
|
|
--try-platform linux, mac, win
|
|
--verbose
|
|
|
|
**Audit a11y performance when adding 100000 nodes to DOM.**
|
|
|
|
browser_bounds.js
|
|
=================
|
|
|
|
:owner: Accessibility Team
|
|
:name: browser_bounds.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--extra-args headless
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--perfherder
|
|
--perfherder-metrics name:A11Y_TotalTime,unit:ms,shouldAlert:True, name:A11Y_DoInitialUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_parent,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_RecvCache_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_SendCache_parent,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_parent,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_parent,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_DoInitialUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_content,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_RecvCache_content,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_content,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_SendCache_content,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_content,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_content,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_content,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_content,unit:iterations,shouldAlert:False
|
|
--try-platform linux, mac, win
|
|
--verbose
|
|
|
|
**Audit a11y performance when computing bounds for a framed (non-display:contents) accessible with 10000 children. Baseline counterpart to browser_displayContentsBounds.js.**
|
|
|
|
browser_displayContentsBounds.js
|
|
================================
|
|
|
|
:owner: Accessibility Team
|
|
:name: browser_displayContentsBounds.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--extra-args headless
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--perfherder
|
|
--perfherder-metrics name:A11Y_TotalTime,unit:ms,shouldAlert:True, name:A11Y_DoInitialUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_parent,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_RecvCache_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_SendCache_parent,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_parent,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_parent,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_DoInitialUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_content,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_RecvCache_content,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_content,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_SendCache_content,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_content,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_content,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_content,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_content,unit:iterations,shouldAlert:False
|
|
--try-platform linux, mac, win
|
|
--verbose
|
|
|
|
**Audit a11y performance when computing bounds for a display:contents accessible with 10000 children.**
|
|
|
|
browser_implicitRoleARIAExpanded.js
|
|
===================================
|
|
|
|
:owner: Accessibility Team
|
|
:name: browser_implicitRoleARIAExpanded.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--extra-args headless
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--perfherder
|
|
--perfherder-metrics name:A11Y_TotalTime,unit:ms,shouldAlert:True, name:A11Y_DoInitialUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_parent,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_RecvCache_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_SendCache_parent,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_parent,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_parent,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_DoInitialUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_content,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_RecvCache_content,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_content,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_SendCache_content,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_content,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_content,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_content,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_content,unit:iterations,shouldAlert:False
|
|
--try-platform linux, mac, win
|
|
--verbose
|
|
|
|
**Audit a11y performance when adding 10000 elements with implicit ARIA roles**
|
|
|
|
browser_reflowPseudoelements.js
|
|
===============================
|
|
|
|
:owner: Accessibility Team
|
|
:name: browser_reflowPseudoelements.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--extra-args headless
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--perfherder
|
|
--perfherder-metrics name:A11Y_TotalTime,unit:ms,alertThreshold:5,shouldAlert:True, name:A11Y_DoInitialUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_parent,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_RecvCache_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_SendCache_parent,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_parent,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_parent,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_DoInitialUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_content,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_RecvCache_content,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_content,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_SendCache_content,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_content,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_content,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_content,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_content,unit:iterations,shouldAlert:False
|
|
--try-platform linux, mac, win
|
|
--verbose
|
|
|
|
**Audit a11y performance when reflowing a table containing 15000 pseudoelements.**
|
|
|
|
browser_removeManySpellingErrors.js
|
|
===================================
|
|
|
|
:owner: Accessibility Team
|
|
:name: browser_removeManySpellingErrors.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--extra-args headless
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--perfherder
|
|
--perfherder-metrics name:A11Y_TotalTime,unit:ms,shouldAlert:True, name:A11Y_DoInitialUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_parent,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_parent,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_parent,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_RecvCache_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_parent,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_parent,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_SendCache_parent,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_parent,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_parent,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_parent,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_parent,unit:iterations,shouldAlert:False, name:A11Y_DoInitialUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedNode_content,unit:ms,shouldAlert:False, name:A11Y_ContentRemovedAcc_content,unit:ms,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_content,unit:ms,shouldAlert:False, name:A11Y_ShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_RecvCache_content,unit:ms,shouldAlert:False, name:A11Y_ProcessShowEvent_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceEvents_content,unit:ms,shouldAlert:False, name:A11Y_CoalesceMutationEvents_content,unit:ms,shouldAlert:False, name:A11Y_ProcessHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_SendCache_content,unit:ms,shouldAlert:False, name:A11Y_WillRefresh_content,unit:ms,shouldAlert:False, name:A11Y_AccessibilityServiceInit_content,unit:ms,shouldAlert:False, name:A11Y_PlatformShowHideEvent_content,unit:ms,shouldAlert:False, name:A11Y_DoInitialUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessQueuedCacheUpdate_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedNode_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ContentRemovedAcc_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PruneOrInsertSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShutdownChildrenInSubtree_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_RecvCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessShowEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_CoalesceMutationEvents_Count_content,unit:iterations,shouldAlert:False, name:A11Y_ProcessHideEvent_Count_content,unit:iterations,shouldAlert:False, name:A11Y_SendCache_Count_content,unit:iterations,shouldAlert:False, name:A11Y_WillRefresh_Count_content,unit:iterations,shouldAlert:False, name:A11Y_AccessibilityServiceInit_Count_content,unit:iterations,shouldAlert:False, name:A11Y_PlatformShowHideEvent_Count_content,unit:iterations,shouldAlert:False
|
|
--try-platform linux, mac, win
|
|
--verbose
|
|
|
|
**Audit a11y performance when removing 500 spelling errors from content editable.**
|
|
|
|
|
|
browser/base/content/test
|
|
-------------------------
|
|
Performance tests from the 'browser/base/content/test' folder.
|
|
|
|
perftest_browser_xhtml_dom.js
|
|
=============================
|
|
|
|
:owner: Browser Front-end team
|
|
:name: Dom-size
|
|
|
|
**Measures the size of the DOM**
|
|
|
|
|
|
browser/components/translations/tests/browser
|
|
---------------------------------------------
|
|
Performance tests for Translations models on Firefox Desktop
|
|
|
|
browser_translations_perf_base.js
|
|
=================================
|
|
|
|
:owner: Translations Team
|
|
:name: Full-Page Translations Base Model
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:engine-init-time,unit:ms,shouldAlert:True,lowerIsBetter:True, name:words-per-second,unit:WPS,shouldAlert:True,lowerIsBetter:False, name:tokens-per-second,unit:TPS,shouldAlert:True,lowerIsBetter:False, name:peak-parent-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:stabilized-parent-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:post-gc-parent-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:peak-inference-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:stabilized-inference-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:post-gc-inference-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:total-translation-time,unit:s,shouldAlert:True,lowerIsBetter:True
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Tests the performance of Full Page Translations with a base-architecture model**
|
|
|
|
browser_translations_perf_basememory.js
|
|
=======================================
|
|
|
|
:owner: Translations Team
|
|
:name: Full-Page Translations BaseMemory Model
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:engine-init-time,unit:ms,shouldAlert:True,lowerIsBetter:True, name:words-per-second,unit:WPS,shouldAlert:True,lowerIsBetter:False, name:tokens-per-second,unit:TPS,shouldAlert:True,lowerIsBetter:False, name:peak-parent-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:stabilized-parent-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:post-gc-parent-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:peak-inference-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:stabilized-inference-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:post-gc-inference-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:total-translation-time,unit:s,shouldAlert:True,lowerIsBetter:True
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Tests the performance of Full Page Translations with a base-memory-architecture model**
|
|
|
|
browser_translations_perf_tiny.js
|
|
=================================
|
|
|
|
:owner: Translations Team
|
|
:name: Full-Page Translations Tiny Model
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:engine-init-time,unit:ms,shouldAlert:True,lowerIsBetter:True, name:words-per-second,unit:WPS,shouldAlert:True,lowerIsBetter:False, name:tokens-per-second,unit:TPS,shouldAlert:True,lowerIsBetter:False, name:peak-parent-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:stabilized-parent-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:post-gc-parent-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:peak-inference-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:stabilized-inference-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:post-gc-inference-process-memory-usage,unit:MiB,shouldAlert:True,lowerIsBetter:True, name:total-translation-time,unit:s,shouldAlert:True,lowerIsBetter:True
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Tests the performance of Full Page Translations with a tiny-architecture model**
|
|
|
|
|
|
dom/serviceworkers/test/performance
|
|
-----------------------------------
|
|
Performance tests running through Mochitest for Service Workers
|
|
|
|
test_caching.html
|
|
=================
|
|
|
|
:owner: DOM LWS
|
|
:name: Service Worker Caching
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:No cache,unit:ms,shouldAlert:True, name:Cached,unit:ms,shouldAlert:True, name:No cache again,unit:ms,shouldAlert:True
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor plain
|
|
|
|
**Test service worker caching.**
|
|
|
|
test_fetch.html
|
|
===============
|
|
|
|
:owner: DOM LWS
|
|
:name: Service Worker Fetch
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:Cold fetch,unit:ms,shouldAlert:True, name:Undisturbed fetch,unit:ms,shouldAlert:True, name:Intercepted fetch,unit:ms,shouldAlert:True, name:Liberated fetch,unit:ms,shouldAlert:True, name:Undisturbed XHR,unit:ms,shouldAlert:True, name:Intercepted XHR,unit:ms,shouldAlert:True, name:Liberated XHR,unit:ms,shouldAlert:True
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor plain
|
|
|
|
**Test cold and warm fetches.**
|
|
|
|
test_registration.html
|
|
======================
|
|
|
|
:owner: DOM LWS
|
|
:name: Service Worker Registration
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:Registration,unit:ms,shouldAlert:True, name:Registration Internals,unit:ms,shouldAlert:True, name:Activation,unit:ms,shouldAlert:True, name:Unregistration,unit:ms,shouldAlert:True
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor plain
|
|
|
|
**Test registration, activation, and unregistration.**
|
|
|
|
test_update.html
|
|
================
|
|
|
|
:owner: DOM LWS
|
|
:name: Service Worker Update
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:Vacuous update,unit:ms,shouldAlert:True, name:Server update,unit:ms,shouldAlert:True, name:Main callback,unit:ms,shouldAlert:True, name:SW callback,unit:ms,shouldAlert:True, name:Update internals,unit:ms,shouldAlert:True
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor plain
|
|
|
|
**Test updating.**
|
|
|
|
|
|
dom/webgpu/tests/mochitest
|
|
--------------------------
|
|
Performance tests from the 'dom/webgpu/tests/mochitest' folder.
|
|
|
|
test_queue_write_perf.html
|
|
==========================
|
|
|
|
:owner: Graphics Team
|
|
:name: Queue Write
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:writeBuffer Time,unit:ms, name:writeTexture Time,unit:ms
|
|
--manifest perftest.toml
|
|
--manifest-flavor plain
|
|
|
|
**Test the performance of Queue.writeBuffer and Queue.writeTexture**
|
|
|
|
|
|
intl/benchmarks/test/xpcshell
|
|
-----------------------------
|
|
Performance tests running through XPCShell for Intl code
|
|
|
|
perftest_dateTimeFormat.js
|
|
==========================
|
|
|
|
:owner: Internationalization Team
|
|
:name: Intl.DateTimeFormat
|
|
:tags: intl,ecma402
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:Intl.DateTimeFormat constructor iterations,unit:iterations, name:Intl.DateTimeFormat constructor accumulatedTime,unit:ms, name:Intl.DateTimeFormat constructor perCallTime,unit:ms, name:Intl.DateTimeFormat.prototype.format iterations,unit:iterations, name:Intl.DateTimeFormat.prototype.format accumulatedTime,unit:ms, name:Intl.DateTimeFormat.prototype.format perCallTime,unit:ms
|
|
--verbose
|
|
|
|
**Test the speed of the Intl.DateTimeFormat implementation.**
|
|
|
|
perftest_locale.js
|
|
==================
|
|
|
|
:owner: Internationalization Team
|
|
:name: Intl.Locale
|
|
:tags: intl,ecma402
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:Intl.Locale constructor iterations,unit:iterations, name:Intl.Locale constructor accumulatedTime,unit:ms, name:Intl.Locale constructor perCallTime,unit:ms, name:Intl.Locale.prototype accessors iterations,unit:iterations, name:Intl.Locale.prototype accessors accumulatedTime,unit:ms, name:Intl.Locale.prototype accessors perCallTime,unit:ms, name:Intl.Locale.maximize operation iterations,unit:iterations, name:Intl.Locale.maximize operation accumulatedTime,unit:ms, name:Intl.Locale.maximize operation perCallTime,unit:ms
|
|
--verbose
|
|
|
|
**Test the speed of the Intl.Locale implementation.**
|
|
|
|
perftest_numberFormat.js
|
|
========================
|
|
|
|
:owner: Internationalization Team
|
|
:name: Intl.NumberFormat
|
|
:tags: intl,ecma402
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:Intl.NumberFormat constructor iterations,unit:iterations, name:Intl.NumberFormat constructor accumulatedTime,unit:ms, name:Intl.NumberFormat constructor perCallTime,unit:ms, name:Intl.NumberFormat.prototype.format iterations,unit:iterations, name:Intl.NumberFormat.prototype.format accumulatedTime,unit:ms, name:Intl.NumberFormat.prototype.format perCallTime,unit:ms, name:Intl.NumberFormat.prototype.formatToParts iterations,unit:iterations, name:Intl.NumberFormat.prototype.formatToParts accumulatedTime,unit:ms, name:Intl.NumberFormat.prototype.formatToParts perCallTime,unit:ms
|
|
--verbose
|
|
|
|
**Test the speed of the Intl.NumberFormat implementation.**
|
|
|
|
perftest_pluralRules.js
|
|
=======================
|
|
|
|
:owner: Internationalization Team
|
|
:name: Intl.PluralRules
|
|
:tags: intl,ecma402
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:Intl.PluralRules constructor iterations,unit:iterations, name:Intl.PluralRules constructor accumulatedTime,unit:ms, name:Intl.PluralRules constructor perCallTime,unit:ms, name:Intl.PluralRules.prototype.select iterations,unit:iterations, name:Intl.PluralRules.prototype.select accumulatedTime,unit:ms, name:Intl.PluralRules.prototype.select perCallTime,unit:ms, name:Intl.PluralRules pluralCategories iterations,unit:iterations, name:Intl.PluralRules pluralCategories accumulatedTime,unit:ms, name:Intl.PluralRules pluralCategories perCallTime,unit:ms
|
|
--verbose
|
|
|
|
**Test the speed of the Intl.PluralRules implementation.**
|
|
|
|
|
|
netwerk/test/perf
|
|
-----------------
|
|
Performance tests from the 'network/test/perf' folder.
|
|
|
|
perftest_http3_cloudflareblog.js
|
|
================================
|
|
|
|
:owner: Network Team
|
|
:name: cloudflare
|
|
|
|
**User-journey live site test for Cloudflare blog.**
|
|
|
|
perftest_http3_controlled.js
|
|
============================
|
|
|
|
:owner: Network Team
|
|
:name: controlled
|
|
:tags: throttlable
|
|
|
|
**User-journey live site test for controlled server**
|
|
|
|
perftest_http3_facebook_scroll.js
|
|
=================================
|
|
|
|
:owner: Network Team
|
|
:name: facebook-scroll
|
|
|
|
**Measures the number of requests per second after a scroll.**
|
|
|
|
perftest_http3_google_image.js
|
|
==============================
|
|
|
|
:owner: Network Team
|
|
:name: g-image
|
|
|
|
**Measures the number of images per second after a scroll.**
|
|
|
|
perftest_http3_google_search.js
|
|
===============================
|
|
|
|
:owner: Network Team
|
|
:name: g-search
|
|
|
|
**User-journey live site test for google search**
|
|
|
|
perftest_http3_lucasquicfetch.js
|
|
================================
|
|
|
|
:owner: Network Team
|
|
:name: lq-fetch
|
|
|
|
**Measures the amount of time it takes to load a set of images.**
|
|
|
|
perftest_http3_youtube_watch.js
|
|
===============================
|
|
|
|
:owner: Network Team
|
|
:name: youtube-noscroll
|
|
|
|
**Measures quality of the video being played.**
|
|
|
|
perftest_http3_youtube_watch_scroll.js
|
|
======================================
|
|
|
|
:owner: Network Team
|
|
:name: youtube-scroll
|
|
|
|
**Measures quality of the video being played.**
|
|
|
|
|
|
netwerk/test/unit
|
|
-----------------
|
|
Performance tests from the 'netwerk/test/unit' folder.
|
|
|
|
test_dns_stress.js
|
|
==================
|
|
|
|
:owner: Network Team
|
|
:name: DNS Benchmark
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
|
|
**Benchmark for DNS resolver lock contention under low and high concurrency.**
|
|
|
|
This test measures DNS resolver throughput by comparing baseline resolution times with low concurrency (within the thread pool) against performance under high concurrency (far exceeding the thread pool). It validates that the resolver scales with available threads rather than serializing all requests.
|
|
|
|
test_trr_bench.js
|
|
=================
|
|
|
|
:owner: Network Team
|
|
:name: TRR Benchmark
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
|
|
**Benchmark for TRR (Trusted Recursive Resolver) DNS lookup performance under various load conditions.**
|
|
|
|
This test measures TRR DNS lookup performance by comparing baseline DNS resolution times with low contention against performance under high contention with many concurrent requests. It validates that TRR requests maintain acceptable performance even when the network is busy with other requests.
|
|
|
|
test_http3_perf.js
|
|
==================
|
|
|
|
:owner: Network Team
|
|
:name: http3 raw
|
|
:tags: network,http3,quic
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:speed,unit:bps
|
|
--xpcshell-cycles 13
|
|
--verbose
|
|
--try-platform linux, mac
|
|
|
|
**XPCShell tests that verifies the lib integration against a local server**
|
|
|
|
|
|
testing/performance
|
|
-------------------
|
|
Performance tests from the 'testing/performance' folder.
|
|
|
|
perftest_bbc_link.js
|
|
====================
|
|
|
|
:owner: Performance Team
|
|
:name: BBC Link
|
|
|
|
**Measures time to load BBC homepage**
|
|
|
|
perftest_facebook.js
|
|
====================
|
|
|
|
:owner: Performance Team
|
|
:name: Facebook
|
|
|
|
**Measures time to log in to Facebook**
|
|
|
|
perftest_jsconf_cold.js
|
|
=======================
|
|
|
|
:owner: Performance Team
|
|
:name: JSConf (cold)
|
|
|
|
**Measures time to load JSConf page (cold)**
|
|
|
|
perftest_jsconf_warm.js
|
|
=======================
|
|
|
|
:owner: Performance Team
|
|
:name: JSConf (warm)
|
|
|
|
**Measures time to load JSConf page (warm)**
|
|
|
|
perftest_politico_link.js
|
|
=========================
|
|
|
|
:owner: Performance Team
|
|
:name: Politico Link
|
|
|
|
**Measures time to load Politico homepage**
|
|
|
|
perftest_youtube_link.js
|
|
========================
|
|
|
|
:owner: Performance Team
|
|
:name: YouTube Link
|
|
|
|
**Measures time to load YouTube video**
|
|
|
|
perftest_pageload.js
|
|
====================
|
|
|
|
:owner: Performance Team
|
|
:name: pageload
|
|
|
|
**Measures time to load mozilla page**
|
|
|
|
perftest_perfstats.js
|
|
=====================
|
|
|
|
:owner: Performance Team
|
|
:name: perfstats
|
|
|
|
**Collect perfstats for the given site**
|
|
|
|
This test launches browsertime with the perfStats option (will collect low-overhead timings, see Bug 1553254). The test currently runs a short user journey. A selection of popular sites are visited, first as cold pageloads, and then as warm.
|
|
|
|
perftest_WPT_chrome_init_file.js
|
|
================================
|
|
|
|
:owner: Performance Testing Team
|
|
:name: webpagetest-chrome
|
|
|
|
**Run webpagetest performance pageload tests on Chrome against Alexa top 50 websites**
|
|
|
|
This mozperftest gets webpagetest to run pageload tests on Chrome against the 50 most popular websites and provide data. The full list of data returned from webpagetest: firstContentfulPaint, visualComplete90, firstPaint, visualComplete99, visualComplete, SpeedIndex, bytesIn,bytesOut, TTFB, fullyLoadedCPUms, fullyLoadedCPUpct, domElements, domContentLoadedEventStart, domContentLoadedEventEnd, loadEventStart, loadEventEnd
|
|
|
|
perftest_WPT_firefox_init_file.js
|
|
=================================
|
|
|
|
:owner: Performance Testing Team
|
|
:name: webpagetest-firefox
|
|
|
|
**Run webpagetest performance pageload tests on Firefox against Alexa top 50 websites**
|
|
|
|
This mozperftest gets webpagetest to run pageload tests on Firefox against the 50 most popular websites and provide data. The full list of data returned from webpagetest: firstContentfulPaint, timeToContentfulPaint, visualComplete90, firstPaint, visualComplete99, visualComplete, SpeedIndex, bytesIn, bytesOut, TTFB, fullyLoadedCPUms, fullyLoadedCPUpct, domElements, domContentLoadedEventStart, domContentLoadedEventEnd, loadEventStart, loadEventEnd
|
|
|
|
|
|
toolkit/components/ml/tests/browser
|
|
-----------------------------------
|
|
Performance tests running through Mochitest for ML Models
|
|
|
|
browser_ml_security_perf.js
|
|
===========================
|
|
|
|
:owner: GenAI Team
|
|
:name: ML Security Orchestrator Performance Tests
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Template test for latency for ML Security Orchestrator**
|
|
|
|
browser_ml_semantic_history_search_perf.js
|
|
==========================================
|
|
|
|
:owner: GenAI Team
|
|
:name: ML Semantic History Search
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:True, name:memory,unit:MB,shouldAlert:True
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform mac, win
|
|
|
|
**Test for latency for ML Semantic Search History Feature**
|
|
|
|
browser_ml_smart_tab_clustering_perf.js
|
|
=======================================
|
|
|
|
:owner: GenAI Team
|
|
:name: ML Smart Tab Clustering
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:False, name:memory,unit:MiB,shouldAlert:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Testing Smart Tab Clustering**
|
|
|
|
browser_ml_speecht5_tts.js
|
|
==========================
|
|
|
|
:owner: GenAI Team
|
|
:name: ML Speech T5 TTS
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:False, name:memory,unit:MiB,shouldAlert:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Testing Speech T5 TTS**
|
|
|
|
browser_ml_autofill_perf.js
|
|
===========================
|
|
|
|
:owner: GenAI Team
|
|
:name: browser_ml_autofill_perf.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:AUTOFILL-pipeline-ready-latency,unit:ms,shouldAlert:False, name:AUTOFILL-initialization-latency,unit:ms,shouldAlert:False, name:AUTOFILL-model-run-latency,unit:ms,shouldAlert:False, name:AUTOFILL-total-memory-usage,unit:MiB,shouldAlert:False, name:tokenSpeed,unit:tokens/s,shouldAlert:False,lowerIsBetter:False, name:charactersSpeed,unit:chars/s,shouldAlert:False,lowerIsBetter:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Template test for latency for ML Autofill model**
|
|
|
|
browser_ml_engine_multi_perf.js
|
|
===============================
|
|
|
|
:owner: GenAI Team
|
|
:name: browser_ml_engine_multi_perf.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:False, name:memory,unit:MiB,shouldAlert:False, name:intent-PIPELINE_READY_LATENCY,unit:MiB,shouldAlert:False, name:intent-INITIALIZATION_LATENCY,unit:MiB,shouldAlert:False, name:intent-MODEL_RUN_LATENCY,unit:MiB,shouldAlert:False, name:suggest-PIPELINE_READY_LATENCY,unit:MiB,shouldAlert:False, name:suggest-INITIALIZATION_LATENCY,unit:MiB,shouldAlert:False, name:suggest-MODEL_RUN_LATENCY,unit:MiB,shouldAlert:False, name:engine3-PIPELINE_READY_LATENCY,unit:MiB,shouldAlert:False, name:engine3-INITIALIZATION_LATENCY,unit:MiB,shouldAlert:False, name:engine3-MODEL_RUN_LATENCY,unit:MiB,shouldAlert:False, name:engine4-PIPELINE_READY_LATENCY,unit:MiB,shouldAlert:False, name:engine4-INITIALIZATION_LATENCY,unit:MiB,shouldAlert:False, name:engine4-MODEL_RUN_LATENCY,unit:MiB,shouldAlert:False, name:TOTAL_MEMORY_USAGE,unit:MiB,shouldAlert:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Testing model execution concurrently**
|
|
|
|
browser_ml_engine_perf.js
|
|
=========================
|
|
|
|
:owner: GenAI Team
|
|
:name: browser_ml_engine_perf.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:False, name:memory,unit:MiB,shouldAlert:False, name:tokenSpeed,unit:tokens/s,shouldAlert:False,lowerIsBetter:False, name:charactersSpeed,unit:chars/s,shouldAlert:False,lowerIsBetter:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Template test for latency for ml models**
|
|
|
|
browser_ml_llama_smollm2_smoke.js
|
|
=================================
|
|
|
|
:owner: GenAI Team
|
|
:name: browser_ml_llama_smollm2_smoke.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Structural smoke for the native llama.cpp backend with SmolLM2 360M Instruct.**
|
|
|
|
browser_ml_llama_summarizer_perf.js
|
|
===================================
|
|
|
|
:owner: GenAI Team
|
|
:name: browser_ml_llama_summarizer_perf.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:False, name:memory,unit:MB,shouldAlert:False, name:tokenSpeed,unit:tokens/s,shouldAlert:False,lowerIsBetter:False, name:charactersSpeed,unit:chars/s,shouldAlert:False,lowerIsBetter:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Template test for latency for Summarizer model using Llama.cpp WASM**
|
|
|
|
browser_ml_smart_tab_perf.js
|
|
============================
|
|
|
|
:owner: GenAI Team
|
|
:name: browser_ml_smart_tab_perf.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:False, name:memory,unit:MiB,shouldAlert:False, name:tokenSpeed,unit:tokens/s,shouldAlert:False,lowerIsBetter:False, name:charactersSpeed,unit:chars/s,shouldAlert:False,lowerIsBetter:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Testing Smart Tab Models**
|
|
|
|
browser_ml_suggest_feature_perf.js
|
|
==================================
|
|
|
|
:owner: GenAI Team
|
|
:name: browser_ml_suggest_feature_perf.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:True, name:memory,unit:MiB,shouldAlert:True
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Template test for latency for ML suggest Feature**
|
|
|
|
browser_ml_suggest_inference.js
|
|
===============================
|
|
|
|
:owner: GenAI Team
|
|
:name: browser_ml_suggest_inference.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:inference-pipeline-ready-latency,unit:ms,shouldAlert:False, name:inference-initialization-latency,unit:ms,shouldAlert:False, name:inference-model-run-latency,unit:ms,shouldAlert:False, name:inference-total-memory-usage,unit:ms,shouldAlert:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Template test for ML suggest Inference Model**
|
|
|
|
browser_ml_summarizer_perf.js
|
|
=============================
|
|
|
|
:owner: GenAI Team
|
|
:name: browser_ml_summarizer_perf.js
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:latency,unit:ms,shouldAlert:True, name:memory,unit:MiB,shouldAlert:True, name:tokenSpeed,unit:tokens/s,shouldAlert:True,lowerIsBetter:False, name:charactersSpeed,unit:chars/s,shouldAlert:True,lowerIsBetter:False
|
|
--verbose
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--try-platform linux, mac, win
|
|
|
|
**Template test for latency for Summarizer model**
|
|
|
|
|
|
toolkit/components/places/tests/browser/performance
|
|
---------------------------------------------------
|
|
Performance tests for Toolkit: Places
|
|
|
|
browser_calculate_frecency_speed.js
|
|
===================================
|
|
|
|
:owner: Places
|
|
:name: Calculate Frecency Speed
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--extra-args headless
|
|
--manifest perftest.toml
|
|
--manifest-flavor browser-chrome
|
|
--perfherder
|
|
--perfherder-metrics name:PlacesCalculateFrecencyHighFrequency,unit:ms,shouldAlert:False, name:PlacesCalculateFrecencyLowFrequency,unit:ms,shouldAlert:False, name:PlacesCalculateFrecencyChunked,unit:ms,shouldAlert:False
|
|
--try-platform linux, mac
|
|
--verbose
|
|
|
|
**Audits the speed of running calculate_frecency.**
|
|
|
|
|
|
toolkit/components/url-classifier/tests/performance
|
|
---------------------------------------------------
|
|
Performance tests for the URL Classifier
|
|
|
|
perftest_exceptionListLookup.js
|
|
===============================
|
|
|
|
:owner: Privacy Team
|
|
:name: UrlClassifier.ExceptionListLookup
|
|
:tags: url-classifier
|
|
:Default options:
|
|
|
|
::
|
|
|
|
--perfherder
|
|
--perfherder-metrics name:UrlClassifier.ExceptionListLookup iterations,unit:iterations, name:UrlClassifier.ExceptionListLookup accumulatedTime,unit:ms, name:UrlClassifier.ExceptionListLookup perCallTime,unit:ms
|
|
--verbose
|
|
|
|
**Test the speed of nsIUrlClassifierExceptionList#matches.**
|
|
|
|
|
|
If you have any questions, please see this `wiki page <https://wiki.mozilla.org/TestEngineering/Performance#Where_to_find_us>`_.
|