Here are three questions that I like to answer when performing a root cause analysis for escaped bugs:
- How was the bug introduced in the first place?
- How did we not catch it earlier?
- What are we doing to prevent this problem in the future?
For the first two questions, I have a handy template for performing root cause analysis.
Generally, for the 3rd question, what are we doing to prevent the problem, we have short and longer term solutions. In the short term, we should add the appropriate test or check that missed the problem in the first place. That is the answer to the specific question for that particular issue.
For the longer term, we collect data about the escaped causes and reasons for escape. We collect that data in the bug tracking system as two fields with categories. When we have enough data, we can examine trends. I usually start with a simple Pareto analysis, showing the top few causes/reasons. Then work with the team to ask how can we improve our processes/practices. Its often useful to filter the Pareto analysis to the most painful bugs (those found by customers, high severity, etc.)
Please drop a comment below and let me know what you do for root cause?
By Photo courtesy of National Nuclear Security Administration / Nevada Site Office [Public domain], via Wikimedia Commons