Run batch tests

This page describes how to batch run tests in MagicPod.

If you want to run batch tests from the command line, see below.

• Run batch tests from the command line (Cloud environment)
• Run batch tests from the command line (Local PC environment)

Table of contents

1. Run batch tests
2. Run batch tests for multiple types of devices
   1. Add new run settings for each type
   2. Add new patterns for each type within the run settings
3. Sharing batch run settings
4. Schedule batch runs
5. Run batch tests for specific test cases only

1. Run batch tests

In MagicPod, you can run all of the tests in the project as a batch.

To run them as a batch, select the Batch runs tab from the project screen, to move to the batch run page.

To set the test target, click Details.

On the batch run settings screen, specify the OS and an app to be tested, etc., and click Run new batch.

If you have already set up a test target, you can also run the batch by clicking Run new batch on the batch run page.

When you select a cloud environment, the test will then start in cloud. When you select a local PC environment, MagicPodDesktop will launch and the test will then start in local. You will see that the test being run is added to the list on the batch run page.

Once the test is completed, the success/failure status and execution time can be viewed in the browser.

Click the batch run number to the left of the list or > to the right of the list, and further confirm the results.

Click each test case number, and confirm the detailed test execution log.

If the test fails, you can confirm the error content and screen capture of the error.

Once the test is complete, all project members will be notified of the test results.

Reference: Notification of test results

2. Run batch tests for multiple types of devices

To run tests across different browsers or device versions/models, you can either add new run settings for each type, or add new patterns for each type within the run settings. We recommend trying the former method first.

2-1. Add new run settings for each type

First, click ︙ > Add new settings.

The following dialog will appear. Enter a preferred name, select Normal settings, and click OK.

Once the new run settings are added, specify the browser for each newly added run setting.

To run the tests, select the run setting that has the desired browser configured, and run it.

This will execute the batch run on the configured browser.

Note that this method will only perform a batch run of the tests on the single selected browser.

2-2. Add new patterns for each type within the run settings

As an alternative to method 2-1, you can also run batch tests across various browsers and device versions/models at once.

For more information, please refer to this page.

When running tests in parallel across multiple types of browsers and devices

3. Sharing batch run settings

You can share batch run settings with other members within the project.

Go to the project screen, and click Details on the Batch runs tab.

Click the kebab menu and click Edit.

Select Shared and click OK.

4. Schedule batch runs

You can automatically run tests in batch at a scheduled time. For more information, click here.

5. Run batch tests for specific test cases only

You can run only specific test cases instead of all test cases in the project. For more information, click here.