This page describes how to batch run tests in MagicPod.
If you want to run batch tests from the command line, see below.
- Run batch tests from the command line (Cloud environment)
- Run batch tests from the command line (Local PC environment)
Table of contents
- Run batch tests
- Run batch tests for multiple types of devices
- Schedule batch runs
- Run batch tests for specific test cases only
1. Run batch tests
In MagicPod, you can run all of the tests in the project as a batch.
To run them as a batch, select the Batch runs tab from the project screen, to move to the batch test run page.
Figure 1. Batch test run page.
To set the test target, click Details.
Figure 2. Details button on the batch test run page.
On the test run settings panel, specify the OS and an app to be tested, etc., and click Run new batch.
Figure 3. Test run settings panel.
If you have already set up a test target, you can also run the batch by clicking Run new batch on the batch test run page.
Figure 4. Run new batch button on the batch test run page.
When you select a cloud environment, the test will then start in cloud. When you select a local PC environment, MagicPodDesktop will launch and the test will then start in local. Once you load the page in the browser, you will see that the test being run is added to the list on the batch test run page.
Figure 5. Image of tests being run on the batch test run page.
Once the test is completed, the success/failure status and execution time can be viewed in the browser.
Click the batch run number to the left of the list or > to the right of the list, and further confirm the results.
Figure 6. Batch run test results.
Click each test case number, and confirm the detailed test execution log.
Figure 7. Test results for each test case.
If the test fails, you can confirm the error content and screen capture of the error.
Figure 8. Error test details.
Once the test completes, an email of the test results is sent to all of the project members.
Figure 9. Test results email.
2. Run batch tests for multiple types of devices
You can run batch tests for multiple combinations of versions and models.
First, click Add to create a pattern.
Figure 10. Add device patterns
Set up each pattern.
Figure 11. Set patterns
The parallel run can also be set here on Common settings. The maximum number of simultaneous parallel terminals can be increased by adding options. For more information, click here.
Figure 12. Set the parallel run
- In the case of Remote TestKit, a 10-minute wait process may occur at the start of the test for the return process of the device used.
- By default, testing of the next device will not start until the testing of another type of device ends. If the plan you are contracted for allows for the execution of tests in parallel with multiple types of devices on BrowserStack or Remote TestKit, by specifying the number of simultaneous parallel instances on the MagicPod side, as shown in figure 12, it is possible to run tests on multiple types of devices in parallel.
3. Schedule batch runs
You can automatically run tests in batch at a scheduled time. For more information, click here.
4. Run batch tests for specific test cases only
You can run only specific test cases instead of all test cases in the project. For more information, click here.