TestCheck - A Checklist-Based Approach to Inspect Software Test Artifacts
Abstract
The quality of the tests applied to a software project is an important factor for the quality of a software product. This paper presents a checklist- based approach, TestCheck, for inspection of software testing artefacts (test plans, cases, and procedures). The steps followed to develop TestCheck and the checklists composing TestCheck are described. Moreover, the results of empirical studies applied that evaluated efficiency and effectiveness of the proposed approach for defect detection in test artefacts are presented, and they indicate TestCheck’s checklists make possible defects detection and this approach obtained better results when compared to an ad-hoc approach.
Keywords:
TestCheck, Checklist, Software Testing
References
Barcelos, R.F.; Travassos, G.H. (2006), ArqCheck: Uma abordagem para inspeção de documentos arquiteturais baseada em checklist; In: Simpósio Brasileiro de Qualidade de Software (SBQS), pp. 174-188, Vila Velha-ES.
Brito, J.; Dias-Neto, A.C. (2012), “Conduzindo Estudos Experimentais para Avaliação de uma Técnica de Inspeção de Artefatos de Teste de Software”, In: Experimental Software Engineering Latin American Workshop (ESELAW), Buenos Aires, Abril.
Boehm, B., Basili, V. (2001), “Software Defect Reduction Top 10 List”, IEEE Computer, vol. 34(1): pp. 135-137.
Conradi, R., Mohagheghi, P.; Arif, T.; “Object-Oriented Reading Techniques for Inspection of UML Models - An Industrial Experiment”. In: European Conference on Object-Oriented Programming, Darmstadt, Germany, Vol. 2743, pp. 69-81.
Crespo, A.N. et al. (2004); Uma Metodologia para Teste de Software no Contexto da Melhoria de Processo; In: Simpósio Brasileiro de Qualidade de Software (SBQS), Brasília, pp. 271-285,.
Davis, A. (1990); “Software Requirement Analysis and Specification”, Prentice-Hall International.
Dias-Neto, A.C., Natali, A.C.; Rocha, A.R., Travassos, G.H. (2006), “Caracterização do Estado da Prática das Atividades de Teste em um Cenário de Desenvolvimento de Software Brasileiro”, V Simpósio Brasileiro de Qualidade de Software, Vila Velha, pp. 27-41.
Dias-Neto, A.C.; Travassos, G.H. (2006), “Maraká: Uma Infra-Estrutura Computacional para Apoiar o Planejamento e Controle de Teste de Software”, V Simpósio Brasileiro de Qualidade de Software, Vila Velha, pp. 248-262.
Fagan. M. (1976); “Design and Code Inspections to Reduce Errors in Program Development”. IBM Systems Journal. Riverton. NJ. V.15. n.3.p.182-211.
Hedberg, H.; Sakka, J. (2006), “Technical Reviews in Agile Development: Case Mobile-DTM” - International Conference on Quality Software (QSIC'06) IEEE - Department of Information Processing Science, University of Oulu, Finland, pp. 347- 353.
IEEE Standard 829-2008 (2008): Standard for Software Test Documentation, IEEE Press.
Itoken, J. V.; Mantyla, M,V.; Lassenius, C. (2007), “Defect Detection Efficiency: Test Case Based vs. Exploratory Testing”, In: First International Symposium on Empirical Software Engineering and Measurement, pp. 61-70, DOI 10.1109/ESEM.2007.56.
Kalinoswki, M.; Spínola, R. O.; Dias-Neto, A. C.; Bott, A.; Travassos, G. H. (2007), Inspeções de Requisitos de Software em Desenvolvimento Incremental: Uma Experiência Prática. In: Simpósio Brasileiro de Qualidade de Software, Porto de Galinhas.
Babar, M.A. (2004). Scenarios, “Quality Attributes, and Patterns: Capturing and Using their Synergistic Relationships for Product Line Architectures”. Fraunhofer Institute Experimental Software Engineering, Germany.
Lanubile, F.; Mallardo, T. (2007), “ Inspecting automated test code: a preliminary study”, In Proceedings of the 8th international conference on Agile processes in software engineering and extreme programming (XP'07), Giulio Concas, Ernesto Damiani, Marco Scotto, and Giancarlo Succi (Eds.). Springer-Verlag, Berlin, Heidelberg, pp. 115-122.
Luo, L. (2010), Software Testing Techniques - Technology Maturation and Research Strategies; In: Institute for Software Research International - Carnegie Mellon University, Pittsburgh, Technical Report 17-939A.
Poon, P.L.; Tse, T. H.; Tang, S.F.; Kuo, F.C. (2011), “Contributions of tester experience and a checklist guideline to the identification of categories and choices for software testing”, Software Quality Control 19, 1 (March 2011), pp. 141-163. DOI=10.1007/s11219-010-9109-4 http://dx.doi.org/10.1007/s11219-010-9109-4.
Pressman, R.S. (2006), “Engenharia de Software”, 6. Ed: São Paulo: MCGRAW-Hill.
Shull, F., Carver, J., Travassos, G. H. (2001), “An empirical methodology for introducing software processes”, In Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering (ESEC/FSE-9). ACM, New York, NY, USA, pp. 288-296. DOI=10.1145/503209.503248.
Shull, F., Rus, I., Basili, V. (2000), “How perspective based reading can improve requirements inspections”, IEEE Computer, v. 33, n. 7, pp 73-79.
Brito, J.; Dias-Neto, A.C. (2012), “Conduzindo Estudos Experimentais para Avaliação de uma Técnica de Inspeção de Artefatos de Teste de Software”, In: Experimental Software Engineering Latin American Workshop (ESELAW), Buenos Aires, Abril.
Boehm, B., Basili, V. (2001), “Software Defect Reduction Top 10 List”, IEEE Computer, vol. 34(1): pp. 135-137.
Conradi, R., Mohagheghi, P.; Arif, T.; “Object-Oriented Reading Techniques for Inspection of UML Models - An Industrial Experiment”. In: European Conference on Object-Oriented Programming, Darmstadt, Germany, Vol. 2743, pp. 69-81.
Crespo, A.N. et al. (2004); Uma Metodologia para Teste de Software no Contexto da Melhoria de Processo; In: Simpósio Brasileiro de Qualidade de Software (SBQS), Brasília, pp. 271-285,.
Davis, A. (1990); “Software Requirement Analysis and Specification”, Prentice-Hall International.
Dias-Neto, A.C., Natali, A.C.; Rocha, A.R., Travassos, G.H. (2006), “Caracterização do Estado da Prática das Atividades de Teste em um Cenário de Desenvolvimento de Software Brasileiro”, V Simpósio Brasileiro de Qualidade de Software, Vila Velha, pp. 27-41.
Dias-Neto, A.C.; Travassos, G.H. (2006), “Maraká: Uma Infra-Estrutura Computacional para Apoiar o Planejamento e Controle de Teste de Software”, V Simpósio Brasileiro de Qualidade de Software, Vila Velha, pp. 248-262.
Fagan. M. (1976); “Design and Code Inspections to Reduce Errors in Program Development”. IBM Systems Journal. Riverton. NJ. V.15. n.3.p.182-211.
Hedberg, H.; Sakka, J. (2006), “Technical Reviews in Agile Development: Case Mobile-DTM” - International Conference on Quality Software (QSIC'06) IEEE - Department of Information Processing Science, University of Oulu, Finland, pp. 347- 353.
IEEE Standard 829-2008 (2008): Standard for Software Test Documentation, IEEE Press.
Itoken, J. V.; Mantyla, M,V.; Lassenius, C. (2007), “Defect Detection Efficiency: Test Case Based vs. Exploratory Testing”, In: First International Symposium on Empirical Software Engineering and Measurement, pp. 61-70, DOI 10.1109/ESEM.2007.56.
Kalinoswki, M.; Spínola, R. O.; Dias-Neto, A. C.; Bott, A.; Travassos, G. H. (2007), Inspeções de Requisitos de Software em Desenvolvimento Incremental: Uma Experiência Prática. In: Simpósio Brasileiro de Qualidade de Software, Porto de Galinhas.
Babar, M.A. (2004). Scenarios, “Quality Attributes, and Patterns: Capturing and Using their Synergistic Relationships for Product Line Architectures”. Fraunhofer Institute Experimental Software Engineering, Germany.
Lanubile, F.; Mallardo, T. (2007), “ Inspecting automated test code: a preliminary study”, In Proceedings of the 8th international conference on Agile processes in software engineering and extreme programming (XP'07), Giulio Concas, Ernesto Damiani, Marco Scotto, and Giancarlo Succi (Eds.). Springer-Verlag, Berlin, Heidelberg, pp. 115-122.
Luo, L. (2010), Software Testing Techniques - Technology Maturation and Research Strategies; In: Institute for Software Research International - Carnegie Mellon University, Pittsburgh, Technical Report 17-939A.
Poon, P.L.; Tse, T. H.; Tang, S.F.; Kuo, F.C. (2011), “Contributions of tester experience and a checklist guideline to the identification of categories and choices for software testing”, Software Quality Control 19, 1 (March 2011), pp. 141-163. DOI=10.1007/s11219-010-9109-4 http://dx.doi.org/10.1007/s11219-010-9109-4.
Pressman, R.S. (2006), “Engenharia de Software”, 6. Ed: São Paulo: MCGRAW-Hill.
Shull, F., Carver, J., Travassos, G. H. (2001), “An empirical methodology for introducing software processes”, In Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering (ESEC/FSE-9). ACM, New York, NY, USA, pp. 288-296. DOI=10.1145/503209.503248.
Shull, F., Rus, I., Basili, V. (2000), “How perspective based reading can improve requirements inspections”, IEEE Computer, v. 33, n. 7, pp 73-79.
Published
2012-07-11
How to Cite
BRITO, Jardelane; TROVÃO, Jeanne de Castro; DIAS-NETO, Arilo Claudio.
TestCheck - A Checklist-Based Approach to Inspect Software Test Artifacts. In: BRAZILIAN SOFTWARE QUALITY SYMPOSIUM (SBQS), 11. , 2012, Fortaleza.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2012
.
p. 113-127.
DOI: https://doi.org/10.5753/sbqs.2012.15311.
