The health score feature measures the health of your automated testing operations. The health score is an evaluation of the measured information, represented by a numerical value, and by improving this number, you can enhance your testing operations. This feature can be accessed from the "Analytics" tab on the project page.
Table of contents
1. Improving health score leads to success in your automation project
In a healthy automated testing operation, it is crucial to obtain reliable feedback from tests on a daily basis. A state in which feedback is received daily refers to a situation where the test cases created are executed daily, and any bugs caused by development are reported as test failures by the next day at the latest. Reliable feedback means that the tests are stable (e.g., the results do not change depending on when they are executed) and that the success/failure results can be trusted and used to provide feedback to the development team.
The health score is calculated based on the degree to which the elements necessary for achieving healthy operations are met. For example, it is calculated based on the following factors:
- Whether the tests are being executed regularly (To obtain feedback from tests in a fast cycle)
- Whether the tests are successful (To increase the reliability of the feedback)
- Whether the tests are easy to maintain (To sustain the reliability of the feedback)
By improving the health score, you can enhance the health of your automated testing operations. Establishing such a solid foundation for testing operations is essential for realizing the benefits of automation and leading your project to success.
2. Provided features
The "Analytics" tab offers the following features:
- Daily score measurement based on information from the past week
- Display of actions to improve the score
- Review the results of improvement activities with a history chart for the past 90 days
- Retrieve data for different aggregation periods using the API
By taking improvement actions based on the health score, you can continuously improve your automated testing operations while quantitatively measuring the effects.
The score is displayed in one of three colors—green, orange, or red—based on the measurement results. In the early stages of adoption, it is recommended to aim for green (80 points or higher) with a small number of test cases and then increase the number of test cases while maintaining the score.
- Green (80 points or higher): The status of testing operations is healthy
- Orange (50-80 points): Implement improvement actions to enhance feedback reliability
- Red (below 50 points): Execute test cases daily to build a solid operational foundation