Marcus Norberto
Maicon Bernardino
ABSTRACT
Context: The technological evolution of wireless networks and the technological advancement of mobile devices make them ever more present in daily life, becoming almost indispensable solutions. With the popularization of mobile devices, developers need to be committed to building applications that can be reliable, robust, secure and that ensure adequate performance for their end users. A good practice to ensure the performance of mobile applications is through a performance testing approach. Although the literature can be used by specialists and non-specialists for decision-making and selection approaches for performance testing, it is limited in the sense of providing an overview. Goal: Our main objective is to contribute to the performance testing body of knowledge. Method: A protocol was formulated and executed according to the guidelines for performing systematic literature mappings in Software Engineering. Results: This study identifies, through a systematic mapping, the tools, strategies, approaches, methods and processes of performance testing in mobile applications. Providing answers and filling a research gap identified in the literature. Conclusions: It is worth highlighting the results on rating performance metrics and problems reported on performance testing for mobile applications. Therefore, this systematic literature map is a valuable contribution to making decisions about performance testing strategies for mobile applications.
- Ahmad Salah Al-Ahmad, Syed Ahmad Aljunid, and Anis Shobirin Abdullah Sani. 2013. Mobile cloud computing testing review. (2013), 176--180.Google Scholar
- Domenico Amalfitano, Anna Rita Fasolino, Porfirio Tramontana, and Bryan Robbins. 2013. Testing Android Mobile Applications: Challenges, Strategies, and Approaches. Vol. 89. Elsevier Inc. 1--52 pages.Google Scholar
- V.R. Basili, C. Caldiera, and H.D. Rombach. 1994. Goal question metric paradigm. Encyclopedia of software engineering 1 (1994), 528--532.Google Scholar
- Jorge Biolchini, Paula Gomes Mian, Ana Candida Cruz Natali, and Guilherme Horta Travassos. 2005. Systematic review in software engineering. System Engineering and Computer Science Department COPPE/UFRJ, Technical Report ES 679 (2005), 45.Google Scholar
- Susanne Braun, Frank Elberzhager, and Konstantin Holl. 2017. Automation Support for Mobile App Quality Assurance---A Tool Landscape. Procedia Computer Science 110 (2017), 117--124.Google ScholarCross Ref
- Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement 20 (1960), 37--46.Google Scholar
- Biplab Deka, Zifeng Huang, Chad Franzen, Jeffrey Nichols, Yang Li, and Ranjitha Kumar. 2017. ZIPT: Zero-Integration Performance Testing of Mobile App Designs. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 727--736.Google ScholarDigital Library
- Utkarsh Goel, Ajay Miyyapuram, Mike P Wittie, and Qing Yang. 2013. MITATE: Mobile Internet testbed for application traffic experimentation. In International Conference on Mobile and Ubiquitous Systems:Computing, Networking, and Services. Springer, 224--236.Google Scholar
- Ray Hyman. 1982. Quasi-Experimentation: Design and Analysis Issues for Field Settings (Book). Journal of Personality Assessment 46 (1982), 96--97.Google ScholarCross Ref
- Mona Erfani Joorabchi, Ali Mesbah, and Philippe Kruchten. 2013. Real challenges in mobile app development. In 2013 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement. IEEE, 15--24.Google ScholarCross Ref
- Heejin Kim, Byoungju Choi, and W Eric Wong. 2009. Performance testing of mobile applications at the unit test level. In In 3rd IEEE International Conference on Secure Software Integration and Reliability Improvement. IEEE, 171--180.Google ScholarDigital Library
- Heejin Kim, Byoungju Choi, and Seokjin Yoon. 2009. Performance Testing Based on Test-driven Development for Mobile Applications. In In 3rd International Conference on Ubiquitous Information Management and Communication. ACM, 612--617.Google Scholar
- Haeng-Kon Kim. 2012. Mobile applications software testing methodology. (2012), 158--166.Google Scholar
- Pavneet Singh Kochhar, Ferdian Thung, Nachiappan Nagappan, Thomas Zimmermann, and David Lo. 2015. Understanding the Test Automation Culture of App Developers. In IEEE 8th International Conference on Software Testing, Verification and Validation. IEEE, 1--10.Google Scholar
- J. Richard Landis and Gary G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics 33 (1977), 159--174.Google ScholarCross Ref
- Mario Linares-Vásquez, Kevin Moran, and Denys Poshyvanyk. 2017. Continuous, evolutionary and large-scale: A new perspective for automated mobile app testing. In 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, 399--410.Google ScholarCross Ref
- Zhenyu Liu, Yun Hu, and Lizhi Cai. 2014. Software quality testing model for mobile application. In International Conference on Mobile Web and Information Systems. 192--204.Google ScholarCross Ref
- A. Malini, N. Venkatesh, K. Sundarakantham, and S. Mercyshalinie. 2014. Mobile application testing on smart devices using MTAAS framework in cloud. In International Conference on Computing and Communication Technologies. IEEE, 1--5.Google Scholar
- E.Y. Nakagawa, K.R.F. Scannavino, S.C.P.F. Fabbri, and F.C. Ferrari. 2017. Revisão Sistemática da Literatura em Engenharia de Software: Teoria e Prática. Elsevier Editora Ltda.Google Scholar
- Vikrant Nandakumar, Vijay Ekambaram, and Vivek Sharma. 2013. Appstrument-a unified app instrumentation and automated playback framework for testing mobile applications. In International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services. Springer International Publishing, 474--486.Google Scholar
- Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic Mapping Studies in Software Engineering. In 12th International Conference on Evaluation and Assessment in Software Engineering. BCS Learning & Development Ltd., 68--77.Google Scholar
- C Mano Prathibhan, A Malini, N Venkatesh, and K Sundarakantham. 2014. An automated testing framework for testing android mobile applications in the cloud. In 2014 IEEE International Conference on Advanced Communications, Control and Computing Technologies. IEEE, 1216--1219.Google ScholarCross Ref
- Stuart J Russell and Peter Norvig. 2016. Artificial intelligence: a modern approach. Malaysia; Pearson Education Limited,.Google ScholarDigital Library
- IS Santos, VLL Dantas, RM Santos, and RMC ANDRADE. 2012. Testes de Aplicações Móveis: uma análise das pesquisas científicas via revisão sistemática. Lbd.Dcc.Ufmg.Br (2012), 203--217.Google Scholar
- Francisco Carlos Souza, Alinne Santos, Stevão Andrade, Rafael Durelli, Vinicius Durelli, and Rafael Oliveira. 2018. Automating Search Strings for Secondary Studies. Springer International Publishing, Chapter 558, 839--848.Google Scholar
- V. S. Sundara Rajan, A. Malini, and K. Sundarakantham. 2014. Performance evaluation of online mobile application using Test My App. In 2014 IEEE International Conference on Advanced Communications, Control and Computing Technologies. IEEE, 1148--1152.Google Scholar
- Michiel Willocx, Jan Vossaert, and Vincent Naessens. 2016. Comparing Performance Parameters of Mobile App Development Strategies. In 2016 IEEE/ACM International Conference on Mobile Software Engineering and Systems. IEEE, 38--47.Google Scholar
- Claes Wohlin. 2014. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In In 8th International Conference on Evaluation and Assessment in Software Engineering (EASE 2014. Citeseer, 321--330.Google ScholarDigital Library
- Samer Zein, Norsaremah Salleh, and John Grundy. 2016. A systematic mapping study of mobile application testing techniques. Journal of Systems and Software 117 (2016), 334--356.Google ScholarDigital Library
Index Terms
- Performance Testing in Mobile Application: a Systematic Literature Map
Recommendations
Performance testing based on test-driven development for mobile applications
ICUIMC '09: Proceedings of the 3rd International Conference on Ubiquitous Information Management and CommunicationDue to the tight schedule of product development for mobile applications and lack of performance testing methods, the product-oriented performance testing that is mostly done in the end of the development shows problems such as identifying a cause of ...
A systematic mapping study of mobile application testing techniques
We performed a systematic mapping study on mobile application testing techniques.79 empirical studies are mapped to a classification schema.Classification scheme includes, structure the topic, evaluation type and contribution facets.Several research ...
Automated functional testing of mobile applications: a systematic mapping study
Context Testing is a critical and costly activity in the life cycle of a mobile application, due to the growing request of new applications and to the rapid evolution of mobile devices and frameworks. Testing automation may represent an effective ...
Comments