Usando Funções de Similaridade para Redução de Conjuntos de Casos de Teste em Estratégias de Teste Baseado em Modelos
Resumo
O uso de funções de similaridade para a redução de conjuntos de casos de teste é investigado neste trabalho. É dado enfoque a conjuntos de casos de teste funcionais gerados automaticamente a partir de modelos. No geral, estratégias de geração automática de casos de teste produzem conjuntos muito grandes e com muitos casos de teste redundantes, contribuindo para um aumento significativo e desnecessário nos custos de geração e execução de casos de teste. Redução com base em funções de similaridade visa produzir um conjunto com um número menor de casos de teste que contenha os casos de teste menos similares entre si. Com isto, espera-se obter uma cobertura mais efetiva de funcionalidades. As estratégias de similaridade consideradas são comparadas, através de estudos de caso, com seleção aleatória, com base em dois critérios: cobertura de transições e cobertura de defeitos.
Referências
Barbosa, D. L., Lima, H. S., Machado, P. D. L., Figueiredo, J. C. A., Juca, M. A., and Andrade, W. L. (2007). Automating functional testing of components from uml specifications. Int. Journal of Software Eng. and Knowledge Engineering, 17:339–358.
Basanieri, F., Bertolino, A., and Marchetti, E. (2002). The cow suite approach to planning and deriving test suites in uml projects. In UML ’02: Proceedings of the 5th International Conference on The Unified Modeling Language, pages 383–397, London, UK. Springer-Verlag.
Bertolino, A. (2007). Software testing research: Achievements, challenges, dreams. In Proceedings of FOSE’07: 2007 Future of Software Engineering ICSE, pages 85–103. IEEE Computer Society.
Binder, R. V. (2000). Testing Object-Oriented Systems Models, Patterns and Tools. Addison-Wesley.
Cartaxo, E. G., Andrade, W. L., Neto, F. G. O., and Machado, P. D. L. (2008). LTSBT: a tool to generate and select functional test cases for embedded systems. In SAC ’08: Proceedings of the 2008 ACM symposium on Applied computing, volume 2, pages 1540–1544, New York, NY, USA. ACM.
Cartaxo, E. G., de Oliveira Neto, F. G., and Machado, P. D. L. (2007). Automated test case selection based on a similarity function. In Proceedings of MOTES07 Model-based Testing Workshop in conjunction with the 37th Annual Congress of the Gesellschaft fuer Informatik, volume 110 of Lecture Notes in Informatics (LNI), pages 381–386.
Chen, T. and Lau, M. (1998). A new heuristic for test suite reduction. Information and Software Technology, 40(5):347–354.
de Mello Neto, L. F. and Simao, A. (2007). Minimização de conjuntos de casos de teste por meio de condições de suficiência. In 1st Brazilian Workshop on Systematic and Automated Software Testing, Joao Pessoa, PB, Brazil. SBBD-SBES.
de Vries, R. G. and Tretmans, J. (1998). On-the-fly conformance testing using SPIN. In Proceedings of Fourth Workshop on Automata Theoretic Verification with the Spin Model Checker, pages 115–128.
El-Far, I. K. and Whittaker, J. A. (2001). Model-based software testing. Encyclopedia on Software Engineering.
Grindal, M., Lindstrom, B., Offutt, J., and Andler, S. F. (2006). An evaluation of combination strategies for test case selection. Empirical Softw. Eng., 11(4):583–611.
Harrold, M. J., Gupta, R., and Soffa, M. L. (1993). A methodology for controlling the size of a test suite. ACM Trans. Softw. Eng. Methodol., 2(3):270–285.
Hartman, A. and Nagin, K. (2004). The agedis tools for model based testing. SIGSOFT Softw. Eng. Notes, 29(4):129–132.
Ho, W. M., Jezequel, J.-M., Guennec, A. L., and Pennaneac'h, F. (1999). UMLAUT: An extendible uml transformation framework. In ASE ’99: Proceedings of the 14th IEEE international conference on Automated software engineering, Washington, DC, USA. IEEE Computer Society.
Jard, C. and Jeron, T. (2005). Tgv: theory, principles and algorithms: A tool for the automatic synthesis of conformance test cases for non-deterministic reactive systems. Int. J. Softw. Tools Technol. Transf., 7(4):297–315.
Jorgensen, P. C. (2002). Software Testing A Craftsman’s Approach. CRC Press.
Lin, J.-C. and Yeh, P.-L. (2001). Automatic test data generation for path testing using GAs. Inf. Sci., 131(1-4):47–64.
Nascimento, L. H. O. and Machado, P. D. L. (2007). An experimental evaluation of approaches to feature testing in the mobile phone applications domain. In Proceedings of Domain-Specific Approaches to Software Test Automation (DoSTA) Satellite workshop of ESEC/FSE 2007, pages 27–33.
Nogueira, S., Cartaxo, E., Torres, D., Aranha, E., and Marques, R. (2007). Model based test generation: An industrial experience. In 1st Brazilian Workshop on Systematic and Automated Software Testing SBBD/SBES 2007, Joao Pessoa, PB, Brazil.
Pretschner, A. (2005). Model-based testing. In Proceedings of International Conference on Software Engineering ICSE, pages 722–723.
Wong, W. E., Horgan, J. R., Mathur, A. P., and Pasquini, A. (1999). Test set size minimization and fault detection effectiveness: a case study in a space application. J. Syst. Softw., 48(2):79–89.
Zhong, H., Zhang, L., and Mei, H. (2006). An experimental comparison of four test suite reduction techniques. In ICSE ’06: Proceedings of the 28th international conference on Software engineering, pages 636–640, New York, NY, USA. ACM.
Basanieri, F., Bertolino, A., and Marchetti, E. (2002). The cow suite approach to planning and deriving test suites in uml projects. In UML ’02: Proceedings of the 5th International Conference on The Unified Modeling Language, pages 383–397, London, UK. Springer-Verlag.
Bertolino, A. (2007). Software testing research: Achievements, challenges, dreams. In Proceedings of FOSE’07: 2007 Future of Software Engineering ICSE, pages 85–103. IEEE Computer Society.
Binder, R. V. (2000). Testing Object-Oriented Systems Models, Patterns and Tools. Addison-Wesley.
Cartaxo, E. G., Andrade, W. L., Neto, F. G. O., and Machado, P. D. L. (2008). LTSBT: a tool to generate and select functional test cases for embedded systems. In SAC ’08: Proceedings of the 2008 ACM symposium on Applied computing, volume 2, pages 1540–1544, New York, NY, USA. ACM.
Cartaxo, E. G., de Oliveira Neto, F. G., and Machado, P. D. L. (2007). Automated test case selection based on a similarity function. In Proceedings of MOTES07 Model-based Testing Workshop in conjunction with the 37th Annual Congress of the Gesellschaft fuer Informatik, volume 110 of Lecture Notes in Informatics (LNI), pages 381–386.
Chen, T. and Lau, M. (1998). A new heuristic for test suite reduction. Information and Software Technology, 40(5):347–354.
de Mello Neto, L. F. and Simao, A. (2007). Minimização de conjuntos de casos de teste por meio de condições de suficiência. In 1st Brazilian Workshop on Systematic and Automated Software Testing, Joao Pessoa, PB, Brazil. SBBD-SBES.
de Vries, R. G. and Tretmans, J. (1998). On-the-fly conformance testing using SPIN. In Proceedings of Fourth Workshop on Automata Theoretic Verification with the Spin Model Checker, pages 115–128.
El-Far, I. K. and Whittaker, J. A. (2001). Model-based software testing. Encyclopedia on Software Engineering.
Grindal, M., Lindstrom, B., Offutt, J., and Andler, S. F. (2006). An evaluation of combination strategies for test case selection. Empirical Softw. Eng., 11(4):583–611.
Harrold, M. J., Gupta, R., and Soffa, M. L. (1993). A methodology for controlling the size of a test suite. ACM Trans. Softw. Eng. Methodol., 2(3):270–285.
Hartman, A. and Nagin, K. (2004). The agedis tools for model based testing. SIGSOFT Softw. Eng. Notes, 29(4):129–132.
Ho, W. M., Jezequel, J.-M., Guennec, A. L., and Pennaneac'h, F. (1999). UMLAUT: An extendible uml transformation framework. In ASE ’99: Proceedings of the 14th IEEE international conference on Automated software engineering, Washington, DC, USA. IEEE Computer Society.
Jard, C. and Jeron, T. (2005). Tgv: theory, principles and algorithms: A tool for the automatic synthesis of conformance test cases for non-deterministic reactive systems. Int. J. Softw. Tools Technol. Transf., 7(4):297–315.
Jorgensen, P. C. (2002). Software Testing A Craftsman’s Approach. CRC Press.
Lin, J.-C. and Yeh, P.-L. (2001). Automatic test data generation for path testing using GAs. Inf. Sci., 131(1-4):47–64.
Nascimento, L. H. O. and Machado, P. D. L. (2007). An experimental evaluation of approaches to feature testing in the mobile phone applications domain. In Proceedings of Domain-Specific Approaches to Software Test Automation (DoSTA) Satellite workshop of ESEC/FSE 2007, pages 27–33.
Nogueira, S., Cartaxo, E., Torres, D., Aranha, E., and Marques, R. (2007). Model based test generation: An industrial experience. In 1st Brazilian Workshop on Systematic and Automated Software Testing SBBD/SBES 2007, Joao Pessoa, PB, Brazil.
Pretschner, A. (2005). Model-based testing. In Proceedings of International Conference on Software Engineering ICSE, pages 722–723.
Wong, W. E., Horgan, J. R., Mathur, A. P., and Pasquini, A. (1999). Test set size minimization and fault detection effectiveness: a case study in a space application. J. Syst. Softw., 48(2):79–89.
Zhong, H., Zhang, L., and Mei, H. (2006). An experimental comparison of four test suite reduction techniques. In ICSE ’06: Proceedings of the 28th international conference on Software engineering, pages 636–640, New York, NY, USA. ACM.
Publicado
13/10/2008
Como Citar
CARTAXO, Emanuela G.; MACHADO, Patrícia D. L.; OLIVEIRA NETO, Francisco G.; OURIQUES, João F. S..
Usando Funções de Similaridade para Redução de Conjuntos de Casos de Teste em Estratégias de Teste Baseado em Modelos. In: SIMPÓSIO BRASILEIRO DE ENGENHARIA DE SOFTWARE (SBES), 22. , 2008, Campinas.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2008
.
p. 1-16.
DOI: https://doi.org/10.5753/sbes.2008.21320.
