Live Cross Browser Testing

Testing on a Desktop Browser#

You can run live tests of your websites on a wide variety of operating system, browser, version, and screen resolution configurations.

  1. In Sauce Labs, in the left navigation panel, click LIVE and then click Cross Browser.
  2. Click the Desktop tab.
Live desktop test navigation
  1. In the URL field, enter the URL of the website you want to test.
  2. If you use Sauce Connect Proxy to test applications on a local host or behind a firewall, select the tunnel from the SAUCE CONNECT PROXY dropdown.
  3. Under BROWSER SELECTION, select the browser version and screen resolution you want to use in your test.
  4. In the OS VERSION dropdown, select the OS version you want to use.
Desktop test setup
  1. Your recent and saved configurations are listed in the right panel, under Recent and Saved, respectively.
Recent and saved tests
  1. To save your current configuration, select the Save this configuration check box.
Saved test configuration
  1. Click Start Session. You'll see a loading screen, and then the application will launch in a live test window using the configuration you selected.
Desktop test running

Once your session launches, you can use your mouse cursor and keyboard to interact with the website under test.

Desktop test interface

Live Desktop Test Interface#

IconNameDescription
Unpin/Pin Toolbar iconUnpin/Pin ToolbarUnpins or pins the live testing toolbar.
Session Info iconSession InfoOpens the Current Session window, which includes app and device details.
Take Screenshot iconTake ScreenshotTakes a screenshot of the current device screen. The image is saved on the Test Details page.
Invite to Session iconInvite to SessionOpens the Invite someone to watch this session window. Copy and share the generated link to allow other users to view the test.
NOTE: Users must be logged in to be able to view the test.
Clipboard iconClipboardOpens the Remote Clipboard window.

Testing on a Mobile Browser#

With Sauce Labs you can run live tests of your web apps using native browsers for Android and iOS on both virtual and real mobile devices.

What You'll Need#

Know if your app is designed to run on internal or otherwise restricted networks. If it does and you're testing on real devices, use Sauce Connect Proxy to connect. For more information, see the Sauce Connect Proxy setup for Real Device Cloud.

Real Device#

  1. In Sauce Labs, in the left panel, click LIVE and then click Cross Browser.
  2. Click the Mobile Real tab.
Live mobile real device test navigation
  1. Use the filter options or Search field to find the type of real device you want to use in your test.
  2. To mark a device as a favorite so you can find it easily in the future, click the star next to the device name.
Favorite a device

The default sorting for the device list is Starred First.

  1. In the URL field, enter the URL of the website you want to test.

  2. If you are using Sauce Connect Proxy to access the web app you want to test, select the tunnel from the dropdown.

  3. Click Launch. You'll see a loading screen, and then the URL you entered will launch in a live test window using the real device you selected.

    Mobile real device test interface

Live Mobile Real Device Test Interface#

IconNameDescription
Unpin/Pin Toolbar iconUnpin/Pin ToolbarUnpins or pins the live testing toolbar.
Session Info iconSession InfoOpens the Current Session window, which includes app and device details.
Take Screenshot iconTake ScreenshotTakes a screenshot of the current device screen. The image downloads automatically as a .png file.
Share Session iconShare SessionOpens the Share Device window. For a sharable link to the device, click Get Link.
NOTE: Users must be logged in to be able to view the test.
Rotate Device iconRotate DeviceRotates the device between portrait and landscape.
Home iconHomeOpens the device home screen.
More Device Options iconMore Device OptionsSet Location - Set the GPS location using coordinates or by dropping a pin on the map.
Restart App iconRestart AppRestarts the app.
Switch App Version iconSwitch App VersionOpens the Switch App Version window. To change the version of the app you are testing, hover over the version and then click Choose version.
Clipboard iconClipboardOpens the Paste Content Into Device window.
Install Dependency iconInstall DependencyOpens the Install Dependent App window.
Developer Options iconDeveloper OptionsOpens the Developer Options panel, which includes the Device Log, Device Vitals, and Dev Tools tabs.

Device Log#

Device Log
IconNameDescription
Log LevelLog Level
  • VERBOSE
  • DEBUG
  • INFO
  • WARN
  • ERROR
  • ASSERT
Search Log iconSearch LogOpens the Search log interface. Enter a term or terms in the search box and select or deselect the following checkboxes as necessary:
  • REGEX
  • IGNORE CASE
  • INVERT
Pause Log iconPause LogPauses the log feed.
Wrap Text iconWrap TextWraps text in the log for easier reading.
Clear Log iconClear LogClears the log feed.
Download Log iconDownload LogDownloads the log as a .txt file.

Device Vitals#

Device Vitals is a feature that collects useful performance data in real time from a device during a live session. Data such as network, CPU, and memory usage helps users understand the general performance of a device and the application under test. Users can view a graph of this performance data in real time as the app is processing.

Device Vitals
IconNameDescription
Graph HeightGraph HeightChange the size of the graphs (S, M, L).
Grid Layout iconGrid LayoutDisplays graphs side by side.
Row Layout iconRow LayoutDisplays graphs as as a list.
Download Vitals iconDownload VitalsDownloads the device vitals as a .txt file.

Performance Metrics for Android/iOS Devices

The graph and csv file will contain these performance metrics for devices.

MetricDescription
cpu_totalSystem-wide CPU usage in percentage across all CPU cores. 4 cores at max use would be shown as a value of 400%
cpu_userCPU usage for user processes in percentage across all CPU cores. 4 cores at max use would be shown as a value of 400%
cpu_kernalAndroid OS CPU usage in percentage across all CPU cores. 4 cores at max use would be shown as a value of 400%
n_threadsTotal threads in use by the app
memory_size_kbTotal threads in use by the app
memory_resident_kbMemory currently in use by application in kilobytes
memory_shared_kbAnonymous shared memory currently in use by system shared between application(s) and system
network_wifi_receive_bData in bytes received over wifi connection
network_wifi_sent_bData in bytes sent over wifi connection
network_mobile_receive_bData in bytes received from the mobile carrier network
network_mobile_sent_bData in bytes sent over mobile carrier network

NOTE: Device Vitals for live testing is currently in beta state, which means we are testing it on a few devices first. We will roll out to all devices in the coming weeks, please refer to this page for updates. See the full list of combinations available for beta below.

Web Tests (on Safari)

Device/PlatformiPhone 11iPhone XRiPhoneXSiPhone XiPhone 8iPhone 7iPhone 6iPhone 6 PlusiPhone 6S PlusiPhone 5SiPhone SEiPad Pro 11 2018iPad ProiPad Air 2019iPad 9.7 2017iPad 4
iOS 9.3.2
iOS 10.0.2X
iOS 10.1X
iOS 10.3.3X
iOS 11.4
iOS 11.4.1
iOS 12.2X
iOS 12.4.1X
iOS 13.0X
iOS 13.1X

Virtual Device#

  1. In Sauce Labs, in the left panel, click Live and then click Cross Browser.
  2. Click the Mobile Virtual tab.
Live mobile virtual device test navigation
  1. In the URL field, enter the URL of the website you want to test.
  2. If you are using Sauce Connect Proxy to access the web app you want to test, select the tunnel from the dropdown. For more information about Sauce Connect Proxy, see Using Sauce Connect Proxy.
  3. In the Manufacturer, Device, and OS Version dropdowns, select the specifications for the virtual device you want to use.
  4. Click Start Session. You'll see a loading screen, and then the URL you entered will launch in a live test window using the virtual device you selected.
Mobile virtual device test interface

Live Mobile Virtual Device Test Interface#

IconNameDescription
Unpin/Pin Toolbar iconUnpin/Pin ToolbarUnpins or pins the live testing toolbar.
Session Info iconSession InfoOpens the Current Session window, which includes app and device details.
Take Screenshot iconTake ScreenshotTakes a screenshot of the current device screen. The image is saved on the Test Details page.
Invite to Session iconInvite to SessionOpens the Invite someone to watch this session window. Copy and share the generated link to allow other users to view the test.
NOTE: Users must be logged in to be able to view the test.
Clipboard iconClipboardOpens the Remote Clipboard window.

Running Tests in Parallel#

You can run multiple live test sessions at the same time, with the number of tests limited by the concurrency allowance associated with your account. To run tests in parallel, open a new browser tab and follow the steps to set up the new session. You can switch back and forth between the sessions by clicking on the browser tabs.

Troubleshooting Live Cross Browser Tests#

Below are resolutions to common errors that you may experience in live cross browser testing.

Seeing a Security Error Message (Error #2048)#

This error is displayed when the ports used by manual testing relies are being blocked by a firewall on your end. This may also be caused by running applications such as Avast! antivirus software.

Below are the servers and ports used by manual testing. If you plan to launch manual tests locally installed browsers, we recommend checking with your network administrator confirm that you can access: charon.saucelabs.com:443.

Your Job is Not Loading#

There are two common scenarios here:

  • Error message: "Uh oh! Some error occurred while connecting to the browser"
  • The job seems to start, but you see only a white text box in the middle of a black screen Both errors indicate that your browser is having trouble displaying the VNC stream from the remote machine. Here are some steps to troubleshoot:

Check the Video on Sauce#

If the recorded video after the job shows a steady video stream, this indicates that the issue is in your computer or connection to Sauce Labs. However, if the Sauce Labs video shows the same issue, that indicates an issue in our service. In that case, send us the URL for the job page and a screenshot of the issue.

Confirm That Your Browser is Up to Date#

If you're on an older version, this may cause incompatibilities. Update your browser and try again.

Check Your Firewall#

Make sure that your machine allows full access for the interactive stream over the required ports (see the Sauce Connect Proxy FAQ).

Confirm That Your Internet Connection is Stable#

We recommend running Sauce tests from a machine with a wired Ethernet connection, to ensure a steady connection. If the connection flickers, this error could be thrown.

Long Load Times or Timing Out#

We've streamlined our service to provide the best possible load times. If you're experiencing slow live testing sessions, head to the Sauce Labs Systems Status page and follow us on Twitter (@SauceOps) for the latest updates on service issues and operations.

Links Opening in New Tabs Instead of New Windows#

It's possible for the manual testing VNC client to have a modifier key "stuck" down, causing any clicked links to open in new tabs. This happens if the client loses focus while a key is held down (e.g., when using Alt-Tab to switch application windows). In this case, VNC never receives the keyUp event.

To prevent this from happening: every time you focus back on the manual testing window, click in the middle of the page, then press and release all the modifier keys (i.e., Alt, Control, Command, and Shift).

Last updated on by Laura Thomas