TestCheck - A Checklist-Based Approach to Inspect Software Test Artifacts
Abstract
The quality of testing applied to a software project is an important factor to reach the quality of the final product. Several strategies can be applied to evaluate its quality. A possible strategy is to ensure the quality of artifacts produced during testing process. Thus, with the purpose of evaluating the quality of testing artifacts, contributing to defects detection before tests execution, this paper presents the development of a checklist-based approach, TestCheck, for inspection of software testing artifacts (test plans, cases, and procedures). In order to evaluate the proposed approach, three experimental studies were conducted. They analyzed and indicated the efficacy, efficiency, and maturity of the proposed approach in relation to detection of defects in testing artifacts.
Keywords:
TestCheck Approach, Checklist, Software Testing
References
Barcelos, R., F., (2006), “Uma abordagem para inspeção de documentos arquiteturais baseada em Checklist”, Dissertação de Mestrado, COPPE/UFRJ, Rio de Janeiro.
Barcelos, R.F.; Travassos, G.H., (2006) “ArqCheck: Uma abordagem para inspeção de documentos arquiteturais baseada em checklist” In: Simpósio Brasileiro de Qualidade de Software (SBQS), PP. 174-188, Vila Velha-ES.
Brito, J., Dias-Neto, A., C., (2012) “Conduzindo Estudos Experimentais para Avaliação de uma Técnica de Inspeção de Artefatos de Teste de Software” - Experimental Software Engineering Latin American Workshop (ESELAW)
Brito, J., Dias-Neto, A., C., (2012) “TestCheck – Uma Abordagem Baseada em Checklist para Inspecionar Artefatos de Teste de Software” – Simposio Brasileiro de Qualidade de Software (SBQS)
Brito, J.; Dias-Neto, A. C. (2013), “Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing Artifacts”. CLEI Electronic Journal, v. 16, p. 9.
Dias-Neto, A.C.; Travasso, G.H., “Maraká: Uma Infra-Estrutura Computacional para Apoiar o Planejamento e Controle de Teste de Software”, V Simpósio Brasileiro de Qualidade de Software, Vila Velha, 2006.
Fagan. M. E. Design and Code Inspections to Reduce Erros in Program Development.IBM Systems Journal. Riverton. NJ. V.15. n.3.p.182-211, 1976.
Hedberg, H., sakka J., (2006), “Technical Reviews in Agile Development: Case Mobile-DTM” - International Conference on Quality Software (QSIC'06) IEEE - Department of Information Processing Science, University of Oulu, Finland.
IEEE Standard 829-2008: Standard for Software and System Test Documentation (Revision of IEEE Std 829-1998)
Itoken, J., V. Mantyla, M,V., and Lassenius, C., “Defect Detection Efficiency: Test Case Based vs. Exploratory Testing ” Helsinki University of Technology, Software Business and Engineering Institute P.O. BOX 9210, FIN-02015 TKK, Finland, 2010.
Kaner, C., Exploratory Testing, Florida Institute of Technology, Quality Assurance Institute Worldwide Annual Software Testing Conference Orlando, FL, Novembro, 2006.
Kollanus, S., Koskinen, J., (2009), "Survey of Software Inspection Research" - Department of Computer Science and Information Systems, University of Jyväskylä, Finland - The Open Software Engineering Journal, pp. 15-34.
Laitenberger, O., DeBaud, J.M., (1997). Perspective-based Reading of Code documents at Robert Bosch GmbH. Information and Software Technology, 39:781–791.
Lanubile, F., Mallardo, T., “Inspecting Automated Test Code: A Preliminary Study” - Department di Informatica, University of Bari, IEEE Standard 829-1998: Standard for Software Test Documentation, IEEE Press., 2007.
Poon, L. P., Tse, T.H., Kuo, F.C., (2010) “Contributions of tester experience and a Checklist guideline to the identification of categories and choices for Software testing” In: Software Quality Journal
Shull, F., Carver, J., Travassos, G. H., “An empirical methodology for introducing software processes.” ACM SIGSOFT Software Engineering Notes, 2001.
Shull, F., Rus, I., Basili, V., “How perspective based reading can improve requirements inspections”, IEEE Computer, v. 33, n. 7, pp 73-79, 2000.
Barcelos, R.F.; Travassos, G.H., (2006) “ArqCheck: Uma abordagem para inspeção de documentos arquiteturais baseada em checklist” In: Simpósio Brasileiro de Qualidade de Software (SBQS), PP. 174-188, Vila Velha-ES.
Brito, J., Dias-Neto, A., C., (2012) “Conduzindo Estudos Experimentais para Avaliação de uma Técnica de Inspeção de Artefatos de Teste de Software” - Experimental Software Engineering Latin American Workshop (ESELAW)
Brito, J., Dias-Neto, A., C., (2012) “TestCheck – Uma Abordagem Baseada em Checklist para Inspecionar Artefatos de Teste de Software” – Simposio Brasileiro de Qualidade de Software (SBQS)
Brito, J.; Dias-Neto, A. C. (2013), “Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing Artifacts”. CLEI Electronic Journal, v. 16, p. 9.
Dias-Neto, A.C.; Travasso, G.H., “Maraká: Uma Infra-Estrutura Computacional para Apoiar o Planejamento e Controle de Teste de Software”, V Simpósio Brasileiro de Qualidade de Software, Vila Velha, 2006.
Fagan. M. E. Design and Code Inspections to Reduce Erros in Program Development.IBM Systems Journal. Riverton. NJ. V.15. n.3.p.182-211, 1976.
Hedberg, H., sakka J., (2006), “Technical Reviews in Agile Development: Case Mobile-DTM” - International Conference on Quality Software (QSIC'06) IEEE - Department of Information Processing Science, University of Oulu, Finland.
IEEE Standard 829-2008: Standard for Software and System Test Documentation (Revision of IEEE Std 829-1998)
Itoken, J., V. Mantyla, M,V., and Lassenius, C., “Defect Detection Efficiency: Test Case Based vs. Exploratory Testing ” Helsinki University of Technology, Software Business and Engineering Institute P.O. BOX 9210, FIN-02015 TKK, Finland, 2010.
Kaner, C., Exploratory Testing, Florida Institute of Technology, Quality Assurance Institute Worldwide Annual Software Testing Conference Orlando, FL, Novembro, 2006.
Kollanus, S., Koskinen, J., (2009), "Survey of Software Inspection Research" - Department of Computer Science and Information Systems, University of Jyväskylä, Finland - The Open Software Engineering Journal, pp. 15-34.
Laitenberger, O., DeBaud, J.M., (1997). Perspective-based Reading of Code documents at Robert Bosch GmbH. Information and Software Technology, 39:781–791.
Lanubile, F., Mallardo, T., “Inspecting Automated Test Code: A Preliminary Study” - Department di Informatica, University of Bari, IEEE Standard 829-1998: Standard for Software Test Documentation, IEEE Press., 2007.
Poon, L. P., Tse, T.H., Kuo, F.C., (2010) “Contributions of tester experience and a Checklist guideline to the identification of categories and choices for Software testing” In: Software Quality Journal
Shull, F., Carver, J., Travassos, G. H., “An empirical methodology for introducing software processes.” ACM SIGSOFT Software Engineering Notes, 2001.
Shull, F., Rus, I., Basili, V., “How perspective based reading can improve requirements inspections”, IEEE Computer, v. 33, n. 7, pp 73-79, 2000.
Published
2013-07-01
How to Cite
BRITO, Jardelane; DIAS NETO, Arilo Claudio.
TestCheck - A Checklist-Based Approach to Inspect Software Test Artifacts. In: BRAZILIAN SOFTWARE QUALITY SYMPOSIUM (SBQS), 12. , 2013, Salvador.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2013
.
p. 366-380.
DOI: https://doi.org/10.5753/sbqs.2013.15300.
