Contributions to improve the combined selection of concurrent software testing techniques

  • Italo Santos USP
  • Andre B. P. Furlanetti USP
  • Silvana M. Melo UFGD
  • Paulo Sergio Lopes de Souza USP
  • Márcio E. Delamaro USP
  • Simone R. S. Souza USP

Resumo


[Context] There are a variety of testing techniques available that present different and often complementary characteristics (e.g., cost of application, effectiveness in revealing defects, types of defects). Considering these complementary characteristics make the selection process even more complex. Testers must make decisions on which techniques they will use in a specific situation. Combining different testing techniques outperforms the use of any single technique alone. [Objective] This paper proposes an approach to support the combined selection of testing techniques for concurrent software projects. The approach is implemented in the SeleCTT-v2 tool, supporting testers to find complementary testing techniques in the body of knowledge proposed in SeleCTT-v1. [Method] We conducted a case study to evaluate the combined selection approach (SeleCTT-v2) with the previous version of the SeleCTT-v1 and to investigate how testers perform a combined selection task for concurrent software projects. [Results and Conclusions] The results indicated a rise in the effectiveness of the combined selection of concurrent testing techniques suggested, which demonstrates SeleCTT-v2 is less likely to make an incorrect recommendation of combined techniques for a concurrent software project, thus avoiding costs associated with the incorrect application of a testing technique. If the testers could access a tool that supports the selection process, the effectiveness of the results would have reached a higher value, as evidenced by our approach. Performing the combination of testing techniques is essential to ensure that software under test has all their features tested to prevent possible errors.

Palavras-chave: testing techniques selection, concurrent software testing, concurrent programming, combined selection
Publicado
19/10/2020
SANTOS, Italo; FURLANETTI, Andre B. P.; MELO, Silvana M.; SOUZA, Paulo Sergio Lopes de; DELAMARO, Márcio E.; SOUZA, Simone R. S.. Contributions to improve the combined selection of concurrent software testing techniques. In: SIMPÓSIO BRASILEIRO DE TESTES DE SOFTWARE SISTEMÁTICO E AUTOMATIZADO (SAST), 5. , 2020, Natal/RN. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2020 . p. 69–78.