Testing as a Service (TaaS): A Systematic Literature Map
Resumo
Background: The knowledge and application of tools to automate testing is essential to ensure software reliability and therefore its quality. Due to the increasing demand for quality in software projects executed in short time-scales, Testing as a Service (TaaS) appeared in the literature as contributions for cost reduction and productivity of automated tests. Aims: Once quality attributes from these contributions are not deeply discussed by the literature of the area, our goal is to investigate and identify these attributes from the TaaS platforms and providers commonly reported in the literature. Method: A protocol was formulated and executed according to the guidelines for performing systematic literature map in Software Engineering. Results: The TaaS providers and platform proposals found were classified according to the number of mentions in the literature, highlighting the most commonly mentioned and widespread. As well as the propagation and explanation of the main advantages and disadvantages reported in the literature on Testing as a Service. Conclusions: TaaS provides means for cost reduction and increase in productivity in comparison to traditional test approaches. This is a reality observed in 76 options for Test as a Service cloud platforms distributed over 52 papers. In addition, as their quality attributes, we also found eight groups of disadvantages and 21 of advantages. Thus, this systematic literature map is a valuable contribution for decision making on performance testing strategies.
Referências
Floss, B. and Tilley, S. (2013). Software testing as a service: An academic research pers- pective. In 2013 IEEE Seventh International Symposium on Service-Oriented System Engineering, pages 421–424.
Gao, J., Bai, X., Tsai, W., and Uehara, T. (2013). Testing as a service (taas) on clouds. In 2013 IEEE Seventh International Symposium on Service-Oriented System Enginee- ring, pages 212–223.
Garriga, M., Mateos, C., Flores, A., Cechich, A., and Zunino, A. (2016). Restful service composition at a glance: A survey. Journal of Network and Computer Applications, 60:32 – 53.
Harikrishna,P.andAmuthan,A.(2016). A survey of testing as a service in cloud computing. In 2016 International Conference on Computer Communication and Informatics (ICCCI), pages 1–5.
Mell, P. M. and Grance, T. (2011). Sp 800-145. the nist definition of cloud computing. Technical report, Gaithersburg, MD, United States.
Myers, G. J. and Sandler, C. (2004). The Art of Software Testing. John Wiley & Sons, USA.
Perry,W.E.(2007). Effective methods for soft ware testing: Includes complete guidelines, Checklists, and Templates. John Wiley & Sons.
Petersen,K.,Feldt,R.,Mujtaba,S.,andMattsson,M.(2008). Systematic mapping studies in software engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering, EASE’08, pages 68–77, Swindon, UK. BCS Learning & Development Ltd.
Russell,S.J.andNorvig,P.(2016). Artificial intelligence: a modern approach. Malaysia; Pearson Education Limited,.
Souza,F.C.,Santos,A.,Andrade,S.,Durelli,R.,Durelli,V.,andOliveira,R.(2018). Au- tomating Search Strings for Secondary Studies, chapter 558, pages 839–848. Springer International Publishing.
Yu,L.,Zhang,L.,Xiang,H.,Su,Y.,Zhao,W.,andZhu,J.(2009). A framework of testing as a service. In 2009 International Conference on Management and Service Science, pages 1–4.
Zhang, Q., Cheng, L., and Boutaba, R. (2010). Cloud computing: state-of-the-art and research challenges. Journal of Internet Services and Applications, 1(1):7–18.
