Summary
Key results
Regression testing time reduced by more than 50%
More stable deployments thanks to automation of load testing
Shorter regression without losing quality control
The organization needed to reduce the time and cost of regression while maintaining high quality in an environment where applications were continuously evolving. Manual testing took too much time and engaged testers in repetitive tasks that slowed down the entire change verification process.
The client was looking for a solution that would allow regular execution of regression and smoke tests, relieve the manual team, and create a foundation for further development of automation. An important part of the project was also the ability to check application responsiveness and measure resource usage in order to identify issues affecting release stability more quickly. To deliver the project, the company selected Sii as a partner able to combine test automation, reporting, and performance testing in one consistent approach.
Test framework and clear reporting
Sii delivered the project in 6 months, engaging 5 experts responsible for test automation and development of the test environment. The goal was to build a solution that would shorten regression, improve visibility of test results, and make it easier for the client to further develop automation.
The scope of work included:
- Python, Selenium, Pytest, and behave – building a tailored framework for regression and smoke test automation
- Behavior-Driven Development approach – organizing test scenarios and making them easier to maintain
- Report Portal – real-time test reporting and access to run history
- Load testing using Taurus – verifying application responsiveness and measuring resource usage
- Integration with the client’s tools, including TeamCity and Xray for Jira – better organization of the testing process and tracking of results
Sii prepared the solution so that it was maintainable and ready for further development. The framework was handed over to the client, and Sii remained involved in further testing within the project.
Less manual work, greater release stability
The new solution shortened and organized the regression process, allowing manual testers to focus on critical issues and new functionalities instead of executing repetitive scenarios. Load tests increased the stability of subsequent releases, and Report Portal gave the team ongoing visibility into test execution and run history.
The project also delivered long-term organizational value. The client received a framework prepared for further development, and the cooperation with Sii was significantly expanded – from the originally planned 3 months to more than 3 years. During that time, the Sii-side team was expanded with additional testers and a new development team.