Summary
Key results
1 000+ automated test scripts executed in the SAP environment
A scalable automation approach spanning Salesforce, web applications, and SAP Fiori
Time-consuming testing and limited SAP system stability
The client was developing one of its key SAP programs supporting critical business processes. As the number of changes and transformation projects increased, ensuring high-quality testing became more challenging. SAP delivers quarterly updates – including new features, security patches, process changes, interface modifications, and API extensions – which means every iteration requires a full regression test. The manual approach was difficult to scale, heavily burdened QA teams, and increased the risk of delays across four major release cycles.
Without automation, the team could not quickly validate the quality of core SAP processes, increasing the risk of critical production defects and potential disruptions in operational workflows. At the same time, planned migrations and transformation initiatives required a stable, predictable testing model to mitigate deployment risks and accelerate system evolution.
To address these challenges, the client decided to implement regression test automation. The goal was to ensure quality during each SAP quarterly release, shorten time-to-market, enable regular end-to-end testing, and reduce testing windows by enabling continuous test execution. Automation was also expected to improve agility during change implementation and streamline the planning and monitoring of tests and results.
Experts from Sii Poland – a Tricentis partner with a team of over 1 400 QA engineers experienced in enterprise-grade environments – were engaged to deliver the project.
Comprehensive automation implementation and scaling with Tosca
Sii Poland assembled a multidisciplinary team consisting of a Tosca Architect, two Test Managers, and Tosca Test Automation Experts responsible for implementing Tricentis Tosca in the client’s SAP environment and establishing a sustainable automation model to support future initiatives.
The scope of work included:
- implementing and configuring Tricentis Tosca in the SAP environment
- integrating Tosca with CI/CD tools and Jira
- analyzing SAP processes and prioritizing scenarios for automation together with the client
- developing more than 1 000 test scripts based on manual test cases, user recordings, and user feedback
- leveraging a combination of Tosca and Python for complex scenarios requiring custom logic
- preparing standards and best practices for automation in future projects
- training and supporting offshore teams responsible for automation development and maintenance
Sii's team automated not only SAP processes, but also full end-to-end scenarios across multiple technologies, expanding automation to web applications, SAP Fiori, and Salesforce.
Long-term system stability and a scalable automation model powered by a Center of Excellence
Test automation significantly reduced regression execution time – from several days to just a few hours – enabling efficient quality assurance during each SAP update or release. Increased test coverage and the ability to run tests in parallel across multiple environments improved system stability and accelerated detection of potential defects. Many repetitive and time-consuming activities previously performed manually by business teams were fully automated, reducing workload and enabling employees to focus on higher-value tasks.
The implementation led to the creation of an internal SAP Center of Excellence responsible for the ongoing development of automation and enforcement of best practices jointly established with Sii’s experts. As a result, the client gained a predictable, scalable testing model applicable to future projects.
Today, the client’s team operates largely independently, consulting Sii experts only in situations requiring architectural support – such as technical challenges, test environment updates, or extending automation into new areas.
Key results
- 1 000+ automated test scripts developed based on SAP processes and user scenarios
- 1 500+ test instances included in the regression library
- regression time reduction from ~160 hours to 5.5 hours through automation
- up to 7 hours saved per cycle thanks to automated data validation
- 650+ documents validated automatically within 2 hours
- scalable automation model extended to Salesforce, web applications, and SAP Fiori
- creation of a SAP Center of Excellence responsible for further automation development and best-practice governance
- long-term collaboration and architectural support from Sii’s expert team