Quality Assurance Metrics
Quality Assurance (QA) metrics and KPIs help assess the effectiveness of testing processes, defect management, and overall software quality.
1. Test Coverage Metrics
- Code Coverage â The percentage of the code executed during automated tests (unit, integration, system tests).
- Requirement Coverage â The percentage of requirements covered by test cases.
- Test Case Coverage â The percentage of test cases executed out of the total planned.
2. Defect Management Metrics
-
Defect Density â Number of defects per thousand lines of code (KLOC), indicating software stability.
-
Defect Leakage â Percentage of defects found in production versus total defects found during testing.
Formula:
-
Defect Removal Efficiency (DRE) â Measures how effectively defects are caught during testing.
Formula:
- Defect Severity Index â Tracks the impact of defects based on severity levels (critical, major, minor).
- Reopened Defects â The number of defects that were marked as fixed but reoccurred, indicating testing effectiveness.
3. Test Execution Metrics
- Test Pass Rate â The percentage of passed test cases compared to the total executed.
- Test Fail Rate â The percentage of failed test cases out of the total executed.
- Test Case Effectiveness â Percentage of test cases that detected defects, measuring how well tests identify issues.
- Blocked Test Cases â Number of test cases that could not be executed due to unresolved issues.
4. Automation & Efficiency Metrics
- Test Automation Coverage â Percentage of test cases automated versus total test cases.
- Test Execution Time â The total time taken to execute tests, useful for optimizing automation.
- Mean Time to Detect (MTTD) â The average time taken to identify a defect after it is introduced.
- Mean Time to Resolve (MTTR) â The average time taken to fix and verify a defect after detection.