Are the Defects Detected by the FindBugs Static Analysis Tool Relevant?

• João Eduardo de Araújo Filho PUC Minas
• Sílvio José de Souza PUC Minas
• Marco Túlio Valente UFMG

DOI: https://doi.org/10.5753/sbqs.2010.15448

Abstract

Abstract. In this paper, we describe an experiment designed to evaluate whether the defects detected by FindBugs – a static analysis tool – are relevant. In this experiment, we have retrospectively evaluated five versions of the Eclipse platform, using the FindBugs static analysis tool. Our results indicate that high relevant defects rate – superior to 40% – are only achieved after customizing the priorities of the defects detected by such tools in order to consider particular characteristics of the system under evaluation.

Keywords: Defects Detected, Static Analysis, FindBugs

References

Nathaniel Ayewah et al. Evaluating static analysis defect warnings on production software. In 7th Workshop on Program Analysis for Software Tools and Engineering (PASTE), pages 1–8, 2007.

Tom Copeland. PMD Applied. Centennial Books, 2005.

David Hovemeyer and William Pugh. Finding bugs is easy. SIGPLAN Notices, 39(12):92–106, 2004.

Sunghun Kim and Michael D. Ernst. Which warnings should I fix first? In 15th International Symposium on Foundations of Software Engineering (FSE), pages 45–54, 2007.

James R. Larus et al. Righting software. IEEE Software, 21(3):92–100, 2004.