The challenge
With an ambitious product roadmap and a lean internal team, the organisation needed to accelerate release velocity without increasing operational risk.
Full regression cycles were taking up to two weeks. This slowed roadmap delivery, stretched internal resources, and increased the likelihood of defects reaching production.
The team needed a way to:
- Reduce regression time
- Improve test coverage
- Eliminate P1 issues in live
- Increase release confidence
- Scale testing without hiring additional headcount
“I’ve worked with third party testing suppliers in the past and it’s about doing your due diligence, being very specific around what both parties expect and ensuring it is a partnership.
The only way you can do that is to build the relationship, trust and have clearly defined goals in terms of what you expect to happen on both sides. We got that right and the results speak for themselves.”
Emma Murphy, Programme Manager, Textlocal (now Webex Interact)
The approach
Digivante partnered closely with the internal Test Manager to restructure and optimise the existing regression pack.
The objective wasn’t simply to execute tests faster. It was to create a scalable regression framework that could be executed by professional testers with no prior domain knowledge of the platform.
The regression pack was rewritten and standardised so that:
- Test cases were clear and repeatable
- Execution could be distributed across a professional testing community
- Onboarding friction was reduced
- Coverage improved without increasing internal workload
Testing covered over 300 story points and was delivered via the Digivante Portal, providing prioritised defect reporting and clear reproduction steps to accelerate fixes.
The results
The impact was immediate and measurable:
- 79% reduction in test execution time
- Regression window reduced from 2 weeks to 72 hours
- Up to 48 hours of testing completed over weekends
- 30% improvement in regression pack pass rate
- Significant reduction in P1 issues and production hotfixes
Full regression could now be completed within a single working week (often within one working day of execution time) aligning testing with sprint cycles rather than delaying them.
79%
reduction in time to test. Reduced test execution window from 2 weeks to 72 hours.
30%
Test pack quality improvements allowed a 30% increase to the pass rates.
P1
Reduced P1 issues found and hot fixes being required in production.
Business impact
By restructuring regression rather than simply outsourcing it, the Webex Interact increased release velocity, reduced production risk, improved development efficiency and scaled testing without increasing fixed cost.
The regression framework developed during this engagement enabled faster, more confident releases and supported the platform as it evolved into Webex Interact.
For growing SaaS organisations, testing velocity is not a support function, it is a growth enabler.
