SauceLabs is a cloud service that uses a variety of browser types and real mobile devices to make manual and automated testing easy.
For information on browser testing, please refer to here.
It is one of the largest providers of Selenium / Appium test execution clouds in the industry, providing a full range of features and good customer support.
Compatible Models/OS version
You can check the Real Devices section here. There is a fairly large selection of devices to choose from, although some are not offered by domestic manufacturers.
Method of use
First, register for an account by clicking the Try it free button on the SauceLabs homepage. If you click the authentication email that is sent to you, and log in to SauceLabs, you will be taken to the Dashboard screen (if not, go to a browser window, and open https://billing.saucelabs.com/plans). Your 14-day trial will start from this point.
You have finished the preparation stage, so next enter the necessary items as shown in figure 1, from the batch run settings panel.
Figure 1. SauceLabs Test Execution Settings.
[1] User Name/ [2] Access Key
Click ACCOUNT > User settings (figure 2) from the top right of the SauceLabs screen.
Figure 2. User settings.
You can confirm the username and access key from the User settings (figure 3) page.
Figure 3. Username/Access key.
[3] Data Center
SauceLabs has two types of data centers: United States and Europe. In the DATA CENTER column in the top right corner of the SauceLabs screen (figure 4), select United States if it says US or Europe" if it says EU.
Figure 4. Data Center.
[4] Version/Model
You can see the available devices on the LIVE feature for manual testing. Click Mobile App under LIVE on the left of the screen. Then, click App Upload and upload the APK or IPA file of the appropriate app from Choose File (figure 5). Note that the uploaded app is used only for viewing the list of devices. Therefore, it can be deleted after checking the version and model name information.
Figure 5. Upload the file from “Mobile App”.
Click Choose Device on the uploaded file, after uploading, to see a list of available device models and versions. (figure 6)
Figure 6. Choose Device.
It will then display a list of available devices (figure 7), so enter a version name such as "14.4" and a model name such as "iPad 10.2" on the batch run settings panel.
Figure 7. Device List.
- During the free trial, the test can only be run on devices labeled Free.
- It is not explicitly stated, but the free trial does not appear to allow multiple devices to be used simultaneously.
- The version will be a partial match; for example, the "13" specification will also cover "13.1," "13.2" and so on. For details, refer to the SauceLabs document.
- Use the official expression for the device name, such as “iPhone .*”. For details, refer to the SauceLabs document.
Test results
In addition to the MagicPod test results screen, the test results can also be viewed on the SauceLabs screen. From the test results screen, click each test to display the test log and a video showing an image of the test currently being run and after execution (figure 8).
Figure 8. SauceLabs test results screen.
Command line execution
Using the method here, you can run tests as a batch from the command line.
Batch test execution for multiple types of devices
Using the method here, you can run tests as a batch for multiple types of devices.
Limitations
- SauceLabs iOS devices have push notifications disabled and do not display the push notification permission dialog box (reference). Sign up with a Saucelabs private Cloud plan to test push notifications with SauceLabs.
- If Japanese characters are included in the test case name or batch execution setting name, they will not be displayed in the test result name on the SauceLabs web console.
Known issues
The following issues exist regarding testing on SauceLabs.
- The App store or Play store app login status is not reset. For this reason, you will need to add the logout process to your test case if you use an Apple ID or Google account for your App store or Play store app.