Whil Software QA Case Study

THE CLIENT

Over 250 companies use Whil’s digital training for happier, healthier, and more engaged workforces. Supported by 250+ programs and 1500+ audio/video sessions based on mindfulness, neuroscience, emotional intelligence, and positive psychology, Whil integrates seamlessly into all major employee wellness, LMS, and EAP platforms to improve a corporate culture while reducing absenteeism, turnover, and health care costs.

Whil. Logo

THE QA CHALLENGES

Whil’s product is built on both web and mobile platforms using Agile with two-week sprints. Whil were augmenting their QA team with an east European QA firm for manual smoke and exploratory testing. To help manage the manual testing load, an effort was undertaken to incorporate automation into the QA process. With the growing complexity of the software and hence testing services, the shortfall in communication and collaboration between Whil’s onsite development team and the offshore QA firm became untenable and the automation scripting program failed to deliver value. After reviewing and evaluating several QA service companies, Whil decided to work with XBOSoft. They viewed XBOSoft, not as an outsourcing company, but as a part of their team, a partner who cared about their software as if it was their own. Whil’s objectives for XBOSoft were to review their current QA processes and institute an effective automation program.

THE XBOSOFT SOLUTIONS

Because communication was a top priority for Whil, XBOSoft initiated the project by assigning an onsite resource for 3 months to not only kick start the automation and QA program, but to build relationships, establish communication channels to XBOSoft’s offshore center, and learn the product and Whil’s company culture. Building on a solid foundation of partnership and understanding, XBO delivered the following:

A high-level Quality Process Assessment to provide a road map for software quality improvement over the long run. The QPA employs XBOSoft’s standard analysis methodology base on the simple concepts of “understand, evaluate, and improve”, and addressed the following areas; Automation, Requirements, QA & Testing, Overall Process, Interfaces & Integration, Design, and Documentation.

An Automation Assessment that provided Whil with a firm foundation for building out their Automation program. The Assessment covered Test Automation Objectives (what functions of the software are best to automate, i.e. most heavily used by end-users, and/or have the most risk associated with a failure occurrence), a Test Automation Strategy, Automation Test Case Design and Parameterization Guidelines (with detailed operation steps, checkpoints, branch control, reporting, result output, and pass/fail criteria), and an Automation Framework Design Guideline specifically for Whil’s software to enable maintainability and extendability.

Automation scripting, debugging, and execution. Whil wanted automated testing of business use cases (not low-level use cases), end to end that tested everything from API testing to integrating functions.

Software Platform or Tools Used Type of Testing
Web app and Native Apps
  • Desktop Platforms:
    • Safari, Chrome, Firefox on MacOS
    • IE 11, Edge, Chrome, Firefox on Windows 10
  • Mobile Platforms:
    • Android
    • iOS
Manual Testing
Web app and Native Apps
  • Desktop Platforms:
    • Safari, Chrome, Firefox on MacOS
    • IE 11, Edge, Chrome, Firefox on Windows 10
  • Mobile Platforms:
    • Android
    • iOS
  • Tools
    • Selenium (Python client)
    • Appium (Python client)
    • Behave Framework
Manual Testing

THE RESULTS

Delivered and executed on a complex test automation plan, increasing overall test coverage from 33% to 55% in 8 weeks. Over 70% web manual test cases have been covered to date. Ensured release of the completely redesigned web app on schedule. The new UI required extensive updates and maintenance to existing scripts.

CLIENT TESTIMONIALS

“Our users require 24/7 access across multiple browsers and all leading mobile devices. We needed test coverage across all platforms. XBOSoft provided the automation test expertise, a mobile test plan, and an improved test automation framework, and timely execution. The significantly raised our confidence in the regression test cycle.”

Rames Kamani, Lead QA

Download This Case Study!