Quality Process Assessment
Insight
XBOSoft’s Quality Process Assessment (QPA) examines the entire organization from the standpoint of quality – how do its people, processes, and use of technology and tools support the organization’s quality goals? Using our QPA methodology and framework, we uncover the root causes of issues that impact quality and provide a roadmap to application and process improvement.
The term “defect” usually applies to issues encountered by users and when the product does not meet requirements or behaves unexpectedly. However, XBOSoft’s QPA expands this to include errors that can occur throughout the lifecycle, from poorly defined requirements and unclear test cases to issues reproducing defects and marketing materials that may be misleading about capabilities.
Our Clients
Framework
Our QPA methodology considers the entire product lifecycle, recognizing that quality involves every stage from conception to customer use. We examine how each department influences subsequent stages and depends on previous ones:
This comprehensive view allows us to identify quality gaps throughout the process, not just in the QA department.
Our process follows three key steps:
Step 1 – Pre-Onsite Data Collection & Analysis
Step 2 – Onsite Review & Off-Site Analysis
Step 3 – Deliverables: Assessment Report & Quality Workshop
Impact
Many don’t realize the strong connection between support and the customer’s perception of quality. By closely examining help desk tickets, XBOSoft’s QPA determines pain points and provides actionable feedback with steps your organization should take earlier to prevent issues from being encountered in production.
Quality is the primary focus and goal of our assessment, leading to tangible benefits:
In previous QPAs, we’ve uncovered significant requirements issues. In one instance, we followed up with a requirements workshop and worked closely with the client to revamp their requirements elicitation process. This helped them decrease requirements changes downstream and, therefore, shorten their development cycle, in addition to reducing defects relating to incomplete or ambiguous requirements.
Measurements
The Assessment Report provides concrete measurements and analyses:
Many executives find our holistic approach and evaluation mind-boggling, as they are not used to viewing or analyzing the organization solely based on quality. Many only expect a defect analysis and defect-related metrics. Still, when we do our correlative evaluation and can tie defects directly to requirements-related metrics such as requirements volatility or correlate defects directly to customer service and tech support wait times and numbers of calls, they can see that quality or lack of quality permeates through the entire organization’s key performance indicators.
Challenges
Organizations often face challenges in maintaining quality across departmental boundaries. Our assessment addresses these challenges by:
Almost always, the individuals in the organization understand the issues and challenges within their scope of responsibility, yet don’t have a clear picture of how all the pieces fit together and impact the organization’s software quality as a whole. By working closely with periphery departments, we can piece together the entire quality picture, and how it’s impacted at various levels. For example, customer service calls and their root causes can usually be traced back to earlier stages in the product development.
In one organization we worked with, their marketing department emphasized product ease of use, but that value was not a significant development team strategy. This led to a mismatch of customer/end user expectations, and what was delivered. Regardless of working functionality, the perception of quality was poor from the end user’s perspective. Isn’t this what counts? By uncovering this simple issue and recommending changes to market positioning based on the software’s strengths, we reduced calls to the customer service department by 18 percent. This sounds small, but the effects for the entire department were affected since the remaining calls had a decreased wait time of 34% leading to better customer satisfaction and service.
Experience
We’ve worked with organizations of all shapes and sizes to examine their processes and offer guidance toward long-term, sustainable improvements. Smaller organizations with development teams of under 10 and a total staff of under 50 can sometimes have the owner involved in the product development process and staff with responsibilities that cross different functions. They are usually trying to get an MVP to market as soon as possible, or they could be needed to get to the next step in quality because they’ve released a product and realize that both customer support and software quality now need more focused attention. For these types of organizations, our QPA is particularly helpful in making process recommendations where there is no progress and helping them to see the need for processes in critical areas.
For larger teams, we have worked with some organizations that have development teams of well over 200. We’ve found over the years that information is siloed across many departments, often leading to:
In these cases, many of our recommendations centered around clearing up processes to remove duplication while ensuring that metrics are installed to measure process effectiveness. By understanding the communication gaps and why they happen, we can also help the organization to reduce work in progress.
Certifications
We hold PMP, ISTQB, and ISO27001 certifications, reflecting our adherence to rigorous standards in project management, software testing, information security, and internal controls.