Published: December 1, 2015
Updated: September 21, 2025
Agile is often talked about as a methodology, but for BlackLine it became a way to preserve the best parts of a fast-moving startup culture while growing into a large, distributed organisation. In the early years, every developer spoke directly with customers. Feedback was immediate, and changes happened quickly. As teams expanded, it became harder to keep that closeness and visibility. Agile provided the structure to keep both.
Greg Burns has been with BlackLine since its early days, joining as the company’s third employee in 2001. As Director of Software Development, he has overseen the evolution of BlackLine’s SaaS application and managed the company’s growth from a few people to hundreds. His experience scaling technology and processes across international teams provides a clear view of the agility needed in today’s competitive software market.
Ron Ben Yosef brings more than a decade of IT experience, from Quality Assurance Engineer to Project Manager, and holds certifications including PMP, Certified Agile Team Facilitator, and IC Agile Certified Agile Coach. As a Senior Scrum Master at BlackLine, his focus on team performance and process improvement has been central to the company’s Agile success.ation
When Greg Burns and Ron Ben Yosef began steering the transition, their goals were clear. They wanted to keep customer feedback central to decision-making, improve visibility across multiple teams, and ensure each group had a strong sense of ownership over its work. Scaling had introduced new challenges: information was scattered, priorities were harder to track, and developers no longer had daily contact with the people using the software. Agile offered a framework for solving these problems without losing speed.
The first step was reorganising from skill-based departments into small cross-functional teams, each with the skills needed to take a feature from concept to release. This meant that backend developers, frontend developers, QA engineers, and UX specialists worked side by side. Each team had a dedicated product owner to manage the backlog and keep priorities aligned with business needs, a scrum master to coach the team and remove blockers, and an engineering manager focused on people’s growth and engagement. With these roles clearly defined, teams could make their own decisions while staying aligned with the company’s broader goals.
BlackLine used Scrum for most feature teams, but the production support team worked in Kanban to respond quickly to incoming issues. Some teams blended the two approaches when priorities shifted often. Sprint goals became a fixture, giving stakeholders a clear picture of what to expect. Every sprint ended with a live demo, which allowed for feedback before work was finalised. Retrospectives focused on concrete action items with named owners so that improvements carried forward.
At the start, QA often lagged behind development, which created delays and reduced predictability. Over time, testing became embedded within the sprint. QA engineers joined in design discussions, planned test coverage in parallel with development, and built automation alongside new features. This integration made releases more reliable and reduced the number of defects that reached production.
The transition required patience and consistent reinforcement. New hires, including offshore members, joined established high-functioning teams before moving into their permanent squads. Offshore teams worked closely with dedicated points of contact to keep communication clear. Leaders in product, DevOps, and other business areas received Agile training so they understood their part in the process and worked with product owners instead of bypassing them.
Looking back, Greg and Ron highlight the same points. Teams succeed when they have the right structure, clearly defined roles, and the freedom to own their work. QA must be part of the process from the very beginning, and stakeholders need to understand how Agile works in practice. For BlackLine, these decisions turned Agile from a concept into a working system that delivers software quickly, consistently, and with the quality customers expect.
Our work with BlackLine reflects the approach we take with every client making the move to Agile. Agile adoption succeeds when the process fits the work and the team, not the other way around. In this engagement, our role went beyond testing deliverables. We embedded QA specialists directly into BlackLine’s Agile teams, aligning our work with sprint goals from day one. This meant test cases were written in parallel with development, automation was built alongside new features, and defects were addressed before they reached production.
Because BlackLine’s teams worked across time zones, we established clear points of contact and consistent communication rhythms. This reduced delays and allowed QA feedback to be acted on within the same sprint. We also helped standardize how acceptance criteria were defined, which improved story clarity and reduced rework. The result was measurable. Release readiness became more predictable, defect leakage into production dropped, and QA was no longer a separate phase, it became an integrated part of delivering value at speed.
If your organization is scaling Agile and wants QA that supports delivery rather than slowing it, XBOSoft can help you build the same kind of embedded, outcome-driven approach.
Start Your Agile Transition with XBOSoft
We’ll help you move from Waterfall to Agile without sacrificing quality — embedding QA practices that fit your team’s pace and culture from day one.
Talk to an Expert
Scaling QA in Agile and DevOps Environments
Practical strategies for integrating QA in fast-moving Agile and CI/CD environments without slowing delivery.
Visit the Hub
Agile Test Plan 2.0
A practical template for planning QA in Agile environments — with built-in flexibility to adapt to your team’s process.
Download the Template (free, email required)
Looking for more insights on Agile, DevOps, and quality practices? Explore our latest articles for practical tips, proven strategies, and real-world lessons from QA teams around the world.