Um Estudo sobre a Avaliação do Custo de Aplicação da Análise de Mutantes na Validação de Máquinas de Estados Finitos
Resumo
Finite State Machine (FSM) is one of the most used techniques for the specification of the Reactive Systems behavioral aspect, for instance, communication protocols. The validation of these specifications, in the case of protocols, conformance testing, is a relevant topic and the aim of many researches. A tendency to characterize an error model to conduct the validation activity is identified. Recently, the adequacy of the use of Mutation Analysis Criterion (MA), traditionaly used in program testing, has been studied in the context of FSM validation. This paper presents the results of an experiment that was conducted aiming at contributing to evaluate the application cost of Mutation Analysis and, in this direction, an essential mutant operators set for FSM is invetigated, aiming at the cost reduction without compromissing the quality of testing and validation activities. The results presented contribute for establishement of a knowledge body on the perspective of defining an incremental, low-cost testing and validation strategy in the context of FSM.
Palavras-chave:
Finite State Machines, Error Model, Mutation Analysis, Incremental Testing, Essential Mutant Operators Set
Referências
Gill, A. Introduction to the Theory of Finite-State Machines, New York, McGraw-Hill, 1962.
Chow, T.S. "Testing Software Design Modeled by Finite-State Machines", IEEE Transactions on Software Engineering, SE(4(3)), pp. 178-187, 1978.
Fujiwara, S.; Bochmann, G.V.; Khendek,F.; Amalou, M.; Ghedamsi, A. "Test Selection Based on Finite State Models", IEEE Transaction on Software Engineering, Vol. 17, N. 6, Junho, 1991.
Gonenc, G. "A Method for the Design of Fault-Detection Experiments", IEEE Transaction on Computer, Vol C-19, pp 551-558, Junho, 1970.
Naito, S.; Tsunoyama, M. "Fault Detection for Sequential Machines by Transition-Tours", in Proceedings FTCS - Fault Tolerant Comput. Systems, pp. 238-243, 1981.
Sabnani, K.K.; Dahbura, A.T. "A Protocol Testing Procedure", Computer Networks and ISDN Syst., Vol. 15, N. 4, pp. 285-297, 1988.
Petrenko, A.; Bochmann, G.v. "On Fault Coverage of Tests for Finite State Specifications", http://www.iro.umontreal.ca/pub/teleinfo/TRs/Petr96b.ps.gz, 1996.
Probert, R.L.; Guo, F. "Mutation Testing of Protocols: Principles and Preliminary Experimental Results", in Proceedings of the IFIP TC6 Third International Workshop on Protocol Test Systems, North-Holland, pp. 57-76, 1991.
Chung, A.; Sidhu, D. "Fault Coverage of Probabilistic Test Sequences", in Proceedings of the IFIP TC6 Third International Workshop on Protocol Test Systems, North-Holland, pp. 305-316, 1991.
Wang, C.J.; Liu, M.T. "Generating Test Cases for EFSM with Given Fault Model", IEEE INFOCOM'93 - 12th Annual Joint Conference of the IEEE Computer and Communications Societies, Vol.2, pp. 774-781, 1993.
Fabbri, S.C.P.F.; Maldonado, J.C.; Masiero, P.C.; Delamaro, M.E. "Análise de Mutantes Baseada em Máquinas de Estado Finito", in Anais do 11o Simpósio Brasileiro de Redes de Computadores, Campinas, Maio, 1993.
Fabbri, S.C.P.F.; Maldonado, J.C.; Delamaro, M.E.; Masiero, P.C. "Mutation Analysis Testing for Finite State Machines", in Proc. ISSRE'94 - Fifth International Symposium on Software Reliability Engineering, pp.220-229, California, Novembro, 1994.
Fabbri, S.C.P.F. "A Análise de Mutantes no Contexto de Sistemas Reativos: Uma Contribuição para o Estabelecimento de Estratégias de Teste e Validação", Tese de Doutorado, IFSC-USP, Outubro, 1996.
Mathur, A. P.; "Performance, Effectiveness, and Reliability Issues in Software Testing", in Proceedings of the Fifteenth Annual International Computer Software and Applications Conference, Tóquio, Japão, 1991, pp. 604-605.
Offutt, A.J.; Rothermel, G.; Untch, R.H.; Zapf, C. "An Experimental Determination of Sufficient Mutant Operators", ACM Transactions on Software Engineering Methodology, accepted for publication, 1996.
Barbosa, E. F.; Vincenzi, A. M. R.; Maldonado, J. C. "Uma Contribuição para a Determinação de um Conjunto Essencial de Operadores de Mutação no Teste de Programas C", in Anais 12o Simpósio de Engenharia de Software, 1998.
Tan, Q.M.; Petrenko, A.; Bochmann, G.v. "A Test Generation Tool for Specifications in the Form of State Machines", [link], 1996.
Bochmann, G.v.; Petrenko, A. "Protocol Testing: Review of Methods and Relevance for Software Testing", in Proceedings of the ISSTA'1994 - International Symposium on Software Testing and Analysis, ACM - Software Engineering Notes, pp. 109-124, 1994.
Morell, L.J. "A Theory of Fault-Based Testing", IEEE Transactions on Software Engineering, Vol.18, N.8, Agosto, 1990.
Sidhu, D.P.; Leung, T.K. "Formal Methods for Protocol Testing: A Detailed Study", IEEE Transactions on Software Engineering, Vol.SE-15, N.4, pp.413-425, Abril, 1989.
DeMillo, R.A. "Mutation Analisys as a Tool for Software Quality Assurance", in Proc. of COMPSAC 80, Chicago-IL, Outubro, 1980.
Gabos, D.; Stiubiener, S. "Aspectos de Metodologia de Geração de Seqüências de Teste para Protocolos de Comunicação de Dados", in Anais 8o Simpósio de Redes de Computadores, 1990.
Fabbri, S.C.P.F.; Maldonado, J.C.; Delamaro, M.E.; Masiero, P.C. "Proteum/FSM - Uma Ferramenta para Apoiar a Validação de Máquinas de Estados Finitos pelo Critério Análise de Mutantes", in Anais do IX Simpósio Brasileiro de Engenharia de Software, pp.475-478, Recife, Pernambuco, Outubro, 1995.
Silva, G. S.; Pedrosa, A. C. P. "Um sistema para geração automática de seqüências de teste para protocolos de comunicação", in Anais dos trabalhos selecionados para o VIII Simpósio de Brasileiro de Redes de Computadores.
Perrim, D. "Local Maps", in Lecture Notes in Computer Science, 316, Automata Networks, France, Maio, 1986, pp. 29-41.
Rapps, S.; Weyuker, E.J. "Selecting Software Testing Data Using Data Flow Information", IEEE Transactions on Software Engineering, Vol.SE-11, pp.367-375, Abril, 1985.
Chow, T.S. "Testing Software Design Modeled by Finite-State Machines", IEEE Transactions on Software Engineering, SE(4(3)), pp. 178-187, 1978.
Fujiwara, S.; Bochmann, G.V.; Khendek,F.; Amalou, M.; Ghedamsi, A. "Test Selection Based on Finite State Models", IEEE Transaction on Software Engineering, Vol. 17, N. 6, Junho, 1991.
Gonenc, G. "A Method for the Design of Fault-Detection Experiments", IEEE Transaction on Computer, Vol C-19, pp 551-558, Junho, 1970.
Naito, S.; Tsunoyama, M. "Fault Detection for Sequential Machines by Transition-Tours", in Proceedings FTCS - Fault Tolerant Comput. Systems, pp. 238-243, 1981.
Sabnani, K.K.; Dahbura, A.T. "A Protocol Testing Procedure", Computer Networks and ISDN Syst., Vol. 15, N. 4, pp. 285-297, 1988.
Petrenko, A.; Bochmann, G.v. "On Fault Coverage of Tests for Finite State Specifications", http://www.iro.umontreal.ca/pub/teleinfo/TRs/Petr96b.ps.gz, 1996.
Probert, R.L.; Guo, F. "Mutation Testing of Protocols: Principles and Preliminary Experimental Results", in Proceedings of the IFIP TC6 Third International Workshop on Protocol Test Systems, North-Holland, pp. 57-76, 1991.
Chung, A.; Sidhu, D. "Fault Coverage of Probabilistic Test Sequences", in Proceedings of the IFIP TC6 Third International Workshop on Protocol Test Systems, North-Holland, pp. 305-316, 1991.
Wang, C.J.; Liu, M.T. "Generating Test Cases for EFSM with Given Fault Model", IEEE INFOCOM'93 - 12th Annual Joint Conference of the IEEE Computer and Communications Societies, Vol.2, pp. 774-781, 1993.
Fabbri, S.C.P.F.; Maldonado, J.C.; Masiero, P.C.; Delamaro, M.E. "Análise de Mutantes Baseada em Máquinas de Estado Finito", in Anais do 11o Simpósio Brasileiro de Redes de Computadores, Campinas, Maio, 1993.
Fabbri, S.C.P.F.; Maldonado, J.C.; Delamaro, M.E.; Masiero, P.C. "Mutation Analysis Testing for Finite State Machines", in Proc. ISSRE'94 - Fifth International Symposium on Software Reliability Engineering, pp.220-229, California, Novembro, 1994.
Fabbri, S.C.P.F. "A Análise de Mutantes no Contexto de Sistemas Reativos: Uma Contribuição para o Estabelecimento de Estratégias de Teste e Validação", Tese de Doutorado, IFSC-USP, Outubro, 1996.
Mathur, A. P.; "Performance, Effectiveness, and Reliability Issues in Software Testing", in Proceedings of the Fifteenth Annual International Computer Software and Applications Conference, Tóquio, Japão, 1991, pp. 604-605.
Offutt, A.J.; Rothermel, G.; Untch, R.H.; Zapf, C. "An Experimental Determination of Sufficient Mutant Operators", ACM Transactions on Software Engineering Methodology, accepted for publication, 1996.
Barbosa, E. F.; Vincenzi, A. M. R.; Maldonado, J. C. "Uma Contribuição para a Determinação de um Conjunto Essencial de Operadores de Mutação no Teste de Programas C", in Anais 12o Simpósio de Engenharia de Software, 1998.
Tan, Q.M.; Petrenko, A.; Bochmann, G.v. "A Test Generation Tool for Specifications in the Form of State Machines", [link], 1996.
Bochmann, G.v.; Petrenko, A. "Protocol Testing: Review of Methods and Relevance for Software Testing", in Proceedings of the ISSTA'1994 - International Symposium on Software Testing and Analysis, ACM - Software Engineering Notes, pp. 109-124, 1994.
Morell, L.J. "A Theory of Fault-Based Testing", IEEE Transactions on Software Engineering, Vol.18, N.8, Agosto, 1990.
Sidhu, D.P.; Leung, T.K. "Formal Methods for Protocol Testing: A Detailed Study", IEEE Transactions on Software Engineering, Vol.SE-15, N.4, pp.413-425, Abril, 1989.
DeMillo, R.A. "Mutation Analisys as a Tool for Software Quality Assurance", in Proc. of COMPSAC 80, Chicago-IL, Outubro, 1980.
Gabos, D.; Stiubiener, S. "Aspectos de Metodologia de Geração de Seqüências de Teste para Protocolos de Comunicação de Dados", in Anais 8o Simpósio de Redes de Computadores, 1990.
Fabbri, S.C.P.F.; Maldonado, J.C.; Delamaro, M.E.; Masiero, P.C. "Proteum/FSM - Uma Ferramenta para Apoiar a Validação de Máquinas de Estados Finitos pelo Critério Análise de Mutantes", in Anais do IX Simpósio Brasileiro de Engenharia de Software, pp.475-478, Recife, Pernambuco, Outubro, 1995.
Silva, G. S.; Pedrosa, A. C. P. "Um sistema para geração automática de seqüências de teste para protocolos de comunicação", in Anais dos trabalhos selecionados para o VIII Simpósio de Brasileiro de Redes de Computadores.
Perrim, D. "Local Maps", in Lecture Notes in Computer Science, 316, Automata Networks, France, Maio, 1986, pp. 29-41.
Rapps, S.; Weyuker, E.J. "Selecting Software Testing Data Using Data Flow Information", IEEE Transactions on Software Engineering, Vol.SE-11, pp.367-375, Abril, 1985.
Publicado
13/10/1999
Como Citar
CARVALHO, Renata A. de; FABBRI, Sandra Camargo P. F.; MALDONADO, José Carlos.
Um Estudo sobre a Avaliação do Custo de Aplicação da Análise de Mutantes na Validação de Máquinas de Estados Finitos. In: SIMPÓSIO BRASILEIRO DE ENGENHARIA DE SOFTWARE (SBES), 13. , 1999, Florianópolis/SC.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
1999
.
p. 292-307.
DOI: https://doi.org/10.5753/sbes.1999.23930.
