A model for spectra-based software diagnosis

Citations Over TimeTop 1% of 2011 papers

Abstract

This article presents an improved approach to assist diagnosis of failures in software (fault localisation) by ranking program statements or blocks in accordance with to how likely they are to be buggy. We present a very simple single-bug program to model the problem. By examining different possible execution paths through this model program over a number of test cases, the effectiveness of different proposed spectral ranking methods can be evaluated in idealised conditions. The results are remarkably consistent to those arrived at empirically using the Siemens test suite and Space benchmarks. The model also helps identify groups of metrics that are equivalent for ranking. Due to the simplicity of the model, an optimal ranking method can be devised. This new method out-performs previously proposed methods for the model program, the Siemens test suite and Space. It also helps provide insight into other ranking methods.

Related Papers

• → Novel approach to reuse unused test cases in a GUI based application(2015)8 cited
• → Handling Model Changes: Regression Testing and Test-Suite Update with Model-Checkers(2007)19 cited
• → Analyzing Minimal Failure-Causing Schemas in Siemens Suite(2016)7 cited
• → ScalableTestGrids - An Open-Source and Flexible Benchmark Suite to Assess Modelica Tool Performance on Large-Scale Power System Test Cases(2021)3 cited
• Grindstone: A Test Suite for Parallel Performance Tools(1998)