Case Studies

Case Study: Akvelon Testing Framework

Business Need

Manual testing is very time consuming and is often not consistent due to various testing environments, complicated test preconditions, and the “human factor”. It often becomes extremely difficult to ensure that new functionality does not break existing logic while providing a common experience for all platforms.

ABI research claims, “The growth from the automation segment will push the revenues close to $800 million by the end of 2017.” Continuous testing is a critical part of the handoff between development and IT operations.

Solution

The Akvelon Testing Framework (ATF) enables UI and integration, test automation, performance testing, and simplifies test recording. This allows customers to approach all of their testing challenges with more confidence, reducing resources and time for manual/regression testing. ATF allows the successful integration of mobile testing into the software development lifecycle. It provides project teams with continuous feedback and enables them to test earlier, with greater coverage.

Test suite benefits from modular structure so that the exiting test subroutines can be reused, therefore speeding up development. New test development does not require recompiling of the testing application. Adding a new test is as easy as adding new XML with actions. Tests can be grouped and executed selectively depending on the groups they belong to (e.g. Smoke tests, Sanity tests, etc.). Resetting the execution environment is available for iOS to simulate edge-case security tests.

The flexible Fixture Server (Fixtures) provides comprehensive control over the ways an application can interact with the Web granting complete server response emulation without need to gain administrative access to the web application. Fixtures can also be prepared manually. Multiple scenarios can be emulated simultaneously with a set of custom rules to parse the request. Fixtures server can be customized to emulate server interaction for selected requests based on a number of protocol parameters. Fixtures can even be edited in runtime. Dynamic request sniffing and parsing allows testing to gain full control over app’s internet interaction flow.

Framework enables flexible adaption to obstructive execution environment conditions, such as:

  • Slow network speed that makes UI responsive or very slow to update
  • Overall low device or emulator performance due to CPU/RAM consuming requirements of an application in test

 

Benefits and Results

ATF streamlines the testing process by providing a flexible approach to automate the most complex test cases for top mobile platforms and allows:

  • Reduced time to market by automated testing (up to 90%)
  • Reduced testing costs by substantially decreasing amount of manually executed tests.
  • Minimized time to prepare and run test when adding new features
  • Utilization of extensive test failures by reporting functionality, to assist both QA and developers to analyze and fix issues, resulting in less time and streamlined workflow.
  • Detailed information about all bugs that do not depend on the “human factor”.
  • Reduced maintenance costs by providing atomic building blocks that can be reused to write new tests with less or no code.
  • Reduced amount of hours/testers involved in projects