Analyzing Performance Results
Every time you run a performance test, whether it is through the Speedo command line or an automation script testing page load or motion effects, the results of the test are compiled and displayed on Sauce Labs, and available to all members of your team for analysis and debugging.
Viewing Performance Results in Sauce Labs
From your Sauce Labs Test Results page, chose one of your completed Performance tests for an overview of its results.
From here, you can drill into a variety of specific details about the test:
- Play the video of the test execution.
- Click the tabs in the panel on the right to see data about the test:
- The Commands tab shows you the script associated with each transition of the test.
- The View Logs tab allows you to choose from a menu of log data captured for the test, including the default
performance.json, which shows you the results.
- The Metadata tab shows you the basic identity of the test, such as the Job ID, Name, and Build, which you may need to use if you are using this data in API calls or other testing.
- At the bottom of the interface, click the Performance tab for a score overview and access to the Performance Report.
Resetting Baselines for a Failed Test
When you expand the Performance tab, if any of the metrics in your test fall outside the established baseline, this is where you have the option to reset the baseline if you wish.
Opening the Performance Report
The full Performance Report gives you more detail about the results of your test and its statistics tracked over time.
In this view, you can see the overall score for the test, plus individual scores for each metric measured in the test. You can click on any of the individual metrics to see a popup graphical representation of that metric's historical performance. You can then click the View History link within the popup window to bring up an interactive view of that graph in which you can hover over the graph to see values for that metric each time the test has been run. Use the drop down menu at the top left of the window to see the history graph for a different metric, or click the
+ icon to show the graphs for two metrics concurrently, as illustrated in the following image.
A performance score is a rating between 0 and 100 indicating how well your page is performing compared to the industry standard. 0 is the lowest possible score and indicates a serious performance issue, while 100 indicates a top-performing app.
The metric is similar to the performance score you can find in a Google Lighthouse Report. The scoring distribution is a log-normal distribution derived from the performance metrics of real website performance data on HTTPArchive.
The color-coding maps to these Performance score ranges:
- 0 to 49 (slow): Red
- 50 to 89 (average): Orange
- 90 to 100 (fast): Green
The score is a weighted average between:
- First Contentful Paint
- Speed Index
- Largest Contentful Paint
- Time to Interactive
- Total Blocking Time
- Cumulative Layout Shift
See Metric Values for definitions of each metric.
Viewing the Trace Report