Quick Time to Market with high quality for a global leader in VPN services software platform

Quick Facts

200 tests execution /in 30 min /in parallel/5 platforms: iOS, Android, MAC, Windows, Linux

95% of test runs have no failures caused by unreliable tests

All test runs use reproducible environments

Test Automation integrated in CI

Objective

To verify, assess, and improve the POI database for a navigation app.

Challenge

The client, a wireless location-based services corporation that provides services including Global Positioning System satellite navigation, local search, automotive navigation solutions, etc., needed timely POI data verification, newly opened POI’s collection, update, and PoI national importance assessment to keep the database 100% precise.

The client chose Intetics as their data collection partner to get fast and accurate results.

Solution

To launch the assessment process, the Intetics team studied the client’s platform infrastructure, discussed with the product owner the assessment approach, set up the reporting deadlines and agreed on frequency of test automation execution.

After the initial assessment, Intetics team took part in building a test automation system to run auto-tests across all platforms – Android, iOS, Mac, Windows, Linux. It allowed to ship and react quickly on all incoming challenges.

Every assessment stage ended up with a report describing the product weaknesses and bottlenecks in details. The whole process took 4 months. The final report demonstrates the overall system state as medium and requiring tech enhancements.

#1 Make test results more visible

Automation automatically triggered a github commit, and results became clear and informative

#2 Work together, not separately

Developers and manual QAs were included in process of creating, updating and running automation tests

#3 Run significantly more tests

Number of test cases increased by improving test speed and decreasing time-consuming steps

#4 Test in more environments

Test cases which emulate edge cases, poor network issues and censorship environment were added, so such problems are faced and fixed much faster now

#5 Parallel execution

Tests cases are designed for parallel run to split them between different agents and run faster

#6 Hardware Architecture 

Different types of hardware are used depending on platform like emulators, real devices, Mac and Windows VMs, running in clouds.

Technologies

Benefits and Results

Eliminated distance between development and QA teams

Test frameworks were created across all platforms

Test coverage, trustability & durability were improved

Product scalability was enhanced