bugs
10 Critical
19 Conversion
AND 50 CX
708 testers
693 variations OF
device,
OS and
browser
combinations
503
workdays
of testing
in just
6 days
“Despite multiple delays from dev, Digivante were flexible and supportive of our requirements and provided extremely short turn arounds when we were ready to execute the tests.”
Declan Clarke, Senior Product Manager, Channel 5
Overview
Company
Channel 5
Industry
Media
Testing Types
Functional
Platforms
Mobile/Media Stick
Challenges
- Rebuild the My5 app – ensure functionality is seamless across the 3 different platforms: Android, iOS and Amazon Fire Stick
- Testing across key supported devices & platforms
- Very short deadline to get the new apps released
Results
- Testing turned around in 3 days
- My5 apps tested on every relevant device and platform
- Summary report with prioritised list of bugs to be fixed
CHALLENGE
Challenged with the ever-evolving needs and high expectations of digital users, as well as fierce competition from the likes of ITV Hub, iPlayer and All 4, Channel 5 began digitally evolving their on-demand app service My5, with a high-level platform restructuring and functional testing plan that aimed to improve app functionality across all 3 versions of their app (Android, iOS & Amazon Firestick).
With a very short release deadline quickly approaching, Channel 5 enlisted the help of website testing service Digivante to ensure the functionality of their apps across all the devices and operating systems.
SOLUTION
To ensure that the seamless functionality of their new My5 platform would work as intended once launched, Digivante deployed a large team of expert professional functional testers on over 600 different devices, including iOS, Android and Amazon devices. Over the course of 6 days, 3 separate tests were sequenced across the 3 key platforms which were all collated into one reporting system, hosted on the Digivante portal.
Due to the nature of development, Channel 5 often had to push back deadlines to ensure a prestige level of quality and avoid bottle-necking their development cycles. Digivante continually matched Channel 5’s changing timeline and were able to postpone the launch of their tests at very short notice due to their dedicated internal and external teams.
RESULTS
A total of 79 bugs were found throughout the functional test (37 on iOS and 42 on Android & Amazon Fire Stick) including incorrect results being displayed, error pages and potential site crashes. The issues were reported in order of severity, supported by screen recordings and clear re-production steps, designed to help Channel 5’s development team understand the type of bugs present and where they were impacting users – minimising the amount of time Channel 5’s internal teams spent fixing the bugs.
The speed at which the testing was completed, and the simplicity of the reports allowed Channel 5 to launch the app at the earliest possible time with confidence.
ABOUT CHANNEL 5
Channel 5 is the UK’s third largest commercial channel and reaches 44m viewers every month. Channel 5’s free video-on-demand service, My5, is available across a vast range of devices and platforms such as web and mobile, smart TVs, set-top boxes, streaming players and devices as well as Blu-ray players.
EXPERIENCING SIMILAR CHALLENGES?
Talk to Khaled El Mayet, one of our Solution Consultants.
