Testing as a Service (TaaS): A Systematic Literature Map

  • Gustavo Girardon UNIPAMPA
  • Victor Costa UNIPAMPA
  • Rodrigo Machado UNIPAMPA
  • Maicon Bernadino UNIPAMPA
  • Fábio Paulo Basso UNIPAMPA
  • Elder de Macedo Rodrigues UNIPAMPA

Resumo


Background: The knowledge and application of tools to automate testing is essential to ensure software reliability and therefore its quality. Due to the increasing demand for quality in software projects executed in short time-scales, Testing as a Service (TaaS) appeared in the literature as contributions for cost reduction and productivity of automated tests. Aims: Once quality attributes from these contributions are not deeply discussed by the literature of the area, our goal is to investigate and identify these attributes from the TaaS platforms and providers commonly reported in the literature. Method: A protocol was formulated and executed according to the guidelines for performing systematic literature map in Software Engineering. Results: The TaaS providers and platform proposals found were classified according to the number of mentions in the literature, highlighting the most commonly mentioned and widespread. As well as the propagation and explanation of the main advantages and disadvantages reported in the literature on Testing as a Service. Conclusions: TaaS provides means for cost reduction and increase in productivity in comparison to traditional test approaches. This is a reality observed in 76 options for Test as a Service cloud platforms distributed over 52 papers. In addition, as their quality attributes, we also found eight groups of disadvantages and 21 of advantages. Thus, this systematic literature map is a valuable contribution for decision making on performance testing strategies.

Referências

Ammann,P.andOffutt,J.(2016). Introductiontosoftwaretesting. CambridgeUniversity Press.

Floss, B. and Tilley, S. (2013). Software testing as a service: An academic research pers- pective. In 2013 IEEE Seventh International Symposium on Service-Oriented System Engineering, pages 421–424.

Gao, J., Bai, X., Tsai, W., and Uehara, T. (2013). Testing as a service (taas) on clouds. In 2013 IEEE Seventh International Symposium on Service-Oriented System Enginee- ring, pages 212–223.

Garriga, M., Mateos, C., Flores, A., Cechich, A., and Zunino, A. (2016). Restful service composition at a glance: A survey. Journal of Network and Computer Applications, 60:32 – 53.

Harikrishna,P.andAmuthan,A.(2016). A survey of testing as a service in cloud computing. In 2016 International Conference on Computer Communication and Informatics (ICCCI), pages 1–5.

Mell, P. M. and Grance, T. (2011). Sp 800-145. the nist definition of cloud computing. Technical report, Gaithersburg, MD, United States.

Myers, G. J. and Sandler, C. (2004). The Art of Software Testing. John Wiley & Sons, USA.

Perry,W.E.(2007). Effective methods for soft ware testing: Includes complete guidelines, Checklists, and Templates. John Wiley & Sons.

Petersen,K.,Feldt,R.,Mujtaba,S.,andMattsson,M.(2008). Systematic mapping studies in software engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering, EASE’08, pages 68–77, Swindon, UK. BCS Learning & Development Ltd.

Russell,S.J.andNorvig,P.(2016). Artificial intelligence: a modern approach. Malaysia; Pearson Education Limited,.

Souza,F.C.,Santos,A.,Andrade,S.,Durelli,R.,Durelli,V.,andOliveira,R.(2018). Au- tomating Search Strings for Secondary Studies, chapter 558, pages 839–848. Springer International Publishing.

Yu,L.,Zhang,L.,Xiang,H.,Su,Y.,Zhao,W.,andZhu,J.(2009). A framework of testing as a service. In 2009 International Conference on Management and Service Science, pages 1–4.

Zhang, Q., Cheng, L., and Boutaba, R. (2010). Cloud computing: state-of-the-art and research challenges. Journal of Internet Services and Applications, 1(1):7–18.
Publicado
22/10/2019
GIRARDON, Gustavo; COSTA, Victor; MACHADO, Rodrigo; BERNADINO, Maicon; BASSO, Fábio Paulo; RODRIGUES, Elder de Macedo. Testing as a Service (TaaS): A Systematic Literature Map. In: ESCOLA REGIONAL DE ENGENHARIA DE SOFTWARE (ERES), 3. , 2019, Rio do Sul. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2019 . p. 65-72.