Testes de Aplicações Móveis: uma análise das pesquisas científicas via revisão sistemática

  • Ismayle S. Santos UFC
  • Valéria L. L. Dantas UFC
  • Rainara M. Santos UFC
  • Rossana M. C. Andrade UFC

Resumo


Com o avanço tecnológico das redes sem fio, os dispositivos móveis (e.g., celulares e tablets) se tornaram mais populares, resultando na demanda de aplicativos mais complexos. Fatores inerentes do ambiente móvel, tais como a mobilidade e as limitações do dispositivo móvel, exigem uma adaptação no processo tradicional de teste de software. Buscando investigar o estado atual das pesquisas na área de testes para aplicações móveis, realizou- se uma revisão sistemática em fontes de pesquisa científica nacionais e internacionais. A estratégia de busca identificou 2167 artigos potencialmente relevantes, dos quais 50 foram analisados de acordo com questões de pesquisa relativas a processo, ferramentas e desafios da área.
Palavras-chave: Testes de Aplicações Móveis, análise das pesquisas científicas, revisão sistemática

Referências

Andrade, R.M.C.; Maia, P.H.M.; Castro, R.N.S.; Dantas, V.L.L.; de C. Andrade, T., (2011). Industry is from mars, academia is from venus. In Proceedings of the 25th Brazilian Symposium on Software Engineering, pp. 108–113.

Andrade, W. L. ; Neto, F. G. O.; Machado, P. D. L. (2007). Geração de Casos de Teste de Interrupção para Aplicações de Celulares. In VIII Workshop de Teste e Tolerância a Falhas (WTF 2007), Belém. Porto Alegre: SBC, 2007, vol. 1, pp. 129-142.

Amalfitano, D.; Fasolino, R. A.; Tramontana, P. (2011). A GUI Crawling-Based Technique for Android Mobile Application Testing. In Proceedings of the 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops. IEEE Computer Society, Washington, USA, pp. 252-261.

Au, F. T. W.; Baker, S.; Warren, I.; Dobbie, G. (2008) Automated usability testing framework. In Proceedings of the ninth Conference on Australasian User Interface, vol. 76, Australian Computer Society, Inc., Darlinghurst, Australia, pp. 55-64.

Baillie, L.; Schatz, R. (2005) Exploring multimodality in the laboratory and the field. In Proceedings of the 7th International Conference on Multimodal Interfaces, pp.100-107.

Baride, S.; Dutta, K. (2011). A cloud based software testing paradigm for mobile applications. In SIGSOFT Software. Eng. Notes, vol. 36, n. 3 (May 2011), pp. 1-4.

Bergvall-Kåreborn, B.; Larsson, S. (2008) A case study of real-world testing. In Proceedings of the 7th International Conference on Mobile and Ubiquitous Multimedia (MUM '08). ACM, New York, NY, USA, pp. 113-116.

Bertini, E; Gabrielli, S.; Kimani, S (2006) Appropriating and assessing heuristics for mobile computing. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '06). ACM, New York, NY, USA, pp. 119-126.

Bertolino, A.; Angelis, G.; Lonetti, F.; Sabetta, A. (2008) Let The Puppets Move! Automated Testbed Generation for Service-oriented Mobile Applications. In Proceedings of the 2008 34th Euromicro Conference Software Engineering and Advanced Applications. IEEE Computer Society, DC, USA, pp. 321-328.

Bezerra, Y. M., Pereira, T. A. B.; Silveira, G. E. (2009) A Systematic Review of Software Product Lines Applied to Mobile Middleware, In Proceedings of the 2009 Sixth International Conference on Information Technology,DC,USA, pp. 1024-1029.

Biel, B.; Grill, T.; Gruhn, V. (2010) Exploring the benefits of the combination of a software architecture analysis and a usability evaluation of a mobile application. In Journal of Systems and Software, vol. 83, n. 11, pp. 2031-2044.

Binder, R. V.; Hanlon, J. E. (2005) The advanced mobile application testing environment. In Proceedings of the 1st International Workshop on Advances in Model-Based Testing (A-MOST '05). ACM, New York, NY, USA, pp. 1-1.

Bo, J.; Xiang, L.; Xiaopeng, G. (2007) MobileTest: A Tool Supporting Automatic Black Box Test for Software on Smart Mobile Devices. In Proceedings of the 2nd International Workshop on Automation of Software Test. IEEE, Washington, USA.

Carta, T.; Paternò, F.; Santana, V. (2011). Support for remote usability evaluation of web mobile applications. In Proceedings of the 29th ACM international conference on Design of communication (SIGDOC '11). ACM, NY, USA, pp. 129-136.

Cartaxo, E. G.; Andrade, W. L.; Neto, F. G. O.; Machado, P. D. L. (2008). LTS-BT: a tool to generate and select functional test cases for embedded systems. In Proceedings of the 2008 ACM Symposium on Applied Computing, pp.1540-1544.

Coursaris, K. C.; Kim, J. D. (2011). A Meta-Analytical Review of Empirical Mobile Usability Studies. Journal of Usability Studies vol. 6, n. 3, Article 11, 55 pages.

Crease, M.; Lumsden, J.; Longworth, B. (2007) A technique for incorporating dynamic paths in lab-based mobile evaluations. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers, vol. 1, Swinton, UK, pp. 99-108.

Dantas, V. L.L.; Marinho, F. G.; Costa, A. L.; Andrade, R. M. C. (2009). Testing Requirements for Mobile Applications. In: Proceedings of the 24th International Symposium on Computer and Information Sciences - ISCIS 2009. Institute of Electrical and Electronics Engineers (IEEE) Xplore Digital Library, pp. 555-560.

Delamaro, M. E.; Vincenzi, A. M. R.; Maldonado, J. C. (2006) A strategy to perform coverage testing of mobile applications. In Proceedings of the 2006 international workshop on Automation of software test. ACM, New York, USA, pp. 118-124.

Durelli, V. H. S.; Araujo, R. F.; Silva, M. A. G.; Oliveira, R. A. P.; Maldonado, J. C.; Delamaro, M. E. (2011) What a Long, Strange Trip It`s Been: Past, Present and Future Perspectives on Software Testing Research. In Proceedings of the Brazilian Symposium on Software Engineering.

Eugster, P.; Garbinato, B.; Holzer, A. (2009) Pervaho: A specialized middleware for mobile context-aware applications. In Journal Electronic Commerce Research, vol. 9, n. 4 (December 2009), pp. 245-268.

Fernandes, T.; Dias, A. (2006). Processo de Testes para Desenvolvimento de Jogos Celulares. In: Proceedings of the V Brazilian Symposium on Computer Games and Digital Entertainment (SBGames Computing). Short Paper. 2006.

Figueiredo, A. L. L.; Andrade, W. L.; Machado, P.D.L. (2006). Generating interaction test cases for mobile phone systems from use case specifications. In SIGSOFT Software Engineering. Notes vol. 31, no 6 (November 2006), pp. 1-10.

Goker, A.; Myrhaug, H. (2008). Evaluation of a mobile information system in context. In Journal Information Processing and Management: an International Journal, vol. 44, n. 1 (January 2008), pp. 39-65.

Hwang, S.; Chae, H. (2008) Design & Implementation of Mobile GUI Testing Tool. In Proceedings of the 2008 International Conference on Convergence and Hybrid Information Technology. IEEE Computer Society, DC, USA, pp. 704-707.

Hu, C.; Neamtiu, I. (2011). Automating GUI testing for Android applications. In Proceedings of the 6th International Workshop on Automation of Software Test (AST '11). ACM, New York, NY, USA, pp. 77-83.

IEEE (2004). Guide to the Software Engineering Body of Knowledge. IEEE Society.

Isomursu, M.; Kuutti, K.; Vainamo, S. (2004) Experience clip: method for user participation and evaluation of mobile concepts. In Proceedings of the eighth Conference on Participatory Design: Artful integration: interweaving media, materials and practices - Volume 1 (PDC 04), Vol. 1. ACM, New York, NY, USA, pp. 83-92.

Jambon, F.; Meillon, B. (2009) User experience evaluation in the wild. In Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). ACM, New York, NY, USA, pp. 4069-4074.

Jensen, K. L. (2007) New methods for conducting experiments with mobile systems and services in the field. In Proceedings of the 9th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '07). ACM, New York, NY, USA, pp. 167-170.

Kaikkonen, A.; Roto, V. (2003). Navigating in a mobile XHTML application. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, pp. 329-336.

Kim, H.; Choi, B.; Yoon, S. (2009a) Performance testing based on test-driven development for mobile applications. In Proceedings of the 3rd International Conference on Ubiquitous Information Management and Communication (ICUIMC '09). ACM, New York, NY, USA, pp. 612-617.

Kim, H.; Choi, B.; Wong, W. E. (2009b) Performance Testing of Mobile Applications at the Unit Test Level. In Proceedings of the 2009 Third IEEE International Conference on Secure Software Integration and Reliability Improvement (SSIRI '09). IEEE Computer Society, Washington, DC, USA, pp. 171-180.

Kitchenham, B.(2004) Procedures for Performing Systematic Reviews, Joint Technical Report Software Engineering Group, Department of Computer Science Keele University, United King and Empirical Software Engineering,National ICT Australia.

Korhonen, H.; Koivisto, Elina M. I. (2006) Playability heuristics for mobile games. In Proceedings of the 8th Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '06). ACM, New York, NY, USA, pp. 9-16.

Koskela, T.; Kassinen, O.; Ala-Kurikka, J.; Ylianttila, M. (2007) Empirical evaluation of mobile peer-to-peer wellness group communication application for Symbian OS. In Proceedings of the 6th International Conference on Mobile and Ubiquitous Multimedia (MUM '07). ACM, New York, NY, USA, pp. 98-102.

Kwon, O.; Hwang, S. (2008) Mobile GUI Testing Tool based on Image Flow. In Proceedings of the Seventh IEEE/ACIS International Conference on Computer and Information Science. IEEE Computer Society, Washington, DC, USA, pp. 508-512.

Lencevicius, R.; Metz, E. (2006) Performance assertions for mobile devices. In Proceedings of the International Symposium on Software Testing and Analysis. ACM, pp. 225-232.

Lehtiniemi, A.; Seppänen, J. (2007) Evaluation of automatic mobile playlist generator. In Proceedings of the 4th International Conference on Mobile Technology, Applications, and Systems. ACM, New York, NY, USA, pp. 452-459.

Leichtenstern, K.; André, E.; Rehm, M. (2010) Using the hybrid simulation for early user evaluations of pervasive interactions. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, pp. 315-324.

Lesemann, E.; Woletz, N.; Koerber, S. (2007) Combining methods to evaluate mobile usability. In Proceedings of the 9th International Conference on Human Computer Interaction with Mobile Devices and Services, ACM, NY, USA, pp. 444-447.

Lima, F. F. P.; Nogueira, T. P.; Braga, A. D.;. Neto, J. S. R; Filho, J. B. F.; Lima, C. R. F.; Leite, S. J. C.; Viana, W.; Dantas, V. L. L.; Andrade, R. M. C. (2010) Manutenção Adaptativa de Software Embarcado para Telefones Celulares Apoiado por Ferramentas de Automação, In IX Simpósio Brasileiro de Qualidade de Software

Looije, R.; Brake, G. M.; Neerincx, M. A. (2007) Usability engineering for mobile maps. In Proceedings of the 4th International Conference on Mobile Technology, Applications, and Systems. ACM, New York, NY, USA, pp. 532-539.

Nascimento, L. H. O. and Machado, P. D. L. (2007). An experimental evaluation of approaches to feature testing in the mobile phone applications domain. In Workshop on Domain Specific Approaches to Software Test Automation: in conjunction with the 6th ESEC/FSE joint meeting (DOSTA '07). ACM, NY, USA, pp. 27-33.

Nguyen, M. D.; Waeselynck, H.; Riviere, N. (2008) Testing mobile computing applications: toward a scenario language and tools. In Proceedings of the 2008 International Workshop on Dynamic Analysis. ACM, NY, USA, pp. 29-35.

Nikkanen, M. (2004) User-centered development of a browser-agnostic mobile e-mail application. In Proceedings of the third Nordic Conference on Human-Computer Interaction (NordiCHI '04). ACM, New York, NY, USA, pp. 53-56.

Puhakka, T.; Palola, M. (2006) Towards automating testing of communicational B3G applications. In Proceedings of the 3rd International Conference on Mobile Technology, Applications & Systems (Mobility '06). ACM, New York, NY, USA.

Reichl, P; Froehlich, P.; Baillie, L; Schatz, R.; Dantcheva, A. (2007) The LiLiPUT prototype: a wearable lab environment for user tests of mobile telecommunication applications. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI EA '07). ACM, New York, NY, USA, pp. 1833-1838.

Ridene, Y. and Barbier, F. (2011). A model-driven approach for automating mobile applications testing. In Proceedings of the 5th European Conference on Software Architecture: Companion Volume (ECSA '11). ACM, New York, NY, USA, 7 pages.

Sá, M.; Carriço, L. (2008) Defining scenarios for mobile design and evaluation. In CHI '08 extended abstracts on Human factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, pp. 2847-2852.

Sá, M.; Carriço, L.; Duarte, L.; Reis, T. (2008) A framework for mobile evaluation. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, pp. 2673-2678.

Sama, M.; Harty, J. (2009) Using code instrumentation to enhance testing on J2ME: a lesson learned with JInjector. In Proceedings of the 10th Workshop on Mobile Computing Systems and Applications (HotMobile '09). ACM, New York, USA.

Schultz, D. (2006) 10 usability tips & tricks for testing mobile applications. Interactions vol. 13, n. 6 (November 2006), pp.14-15.

She, S; Sivapalan, S.; Warren, I. (2009) Hermes: A Tool for Testing Mobile Device Applications. In Proceedings of the 2009 Australian Software Engineering Conference (ASWEC '09). IEEE Computer Society, DC, USA, pp. 121-130.

Shrestha, S. (2007) Mobile web browsing: usability study. In Proceedings of the 4th International Conference on Mobile Technology, Applications, and Systems. ACM, NY, USA, pp. 187-194.

Zeidler, C.; Kittl, C. e Petrovic, O. (2007). An Integrated Product Development Process for Mobile Software. In: Proceedings of the IX International Conference on the Management of Mobile Business (ICBM), 2007, p. 23-31.

Zhifang, L.; Bin, L.; Xiaopeng, G. (2010). Test automation on mobile device. In Proceedings of the 5th Workshop on Automation of Software Test, pp. 1-7.

Weiss, D.; Zduniak, M. (2007) Automated integration tests for mobile applications in java 2 micro edition. In Proceedings of the 10th International Conference on Business Information Systems (BIS'07), Springer-Verlag, Berlin, Heidelberg, pp. 478-487.

Wac, K.; Ickin, S.; Hong, J; Janowski, L.; Fiedler, M.; Dey, K. A. (2011). Studying the experience of mobile applications used in different contexts of daily life. In Proceedings of the 1st ACM SIGCOMM Workshop on Measurements Up the Stack. ACM, pp. 7-12.
Publicado
11/07/2012
SANTOS, Ismayle S.; DANTAS, Valéria L. L.; SANTOS, Rainara M.; ANDRADE, Rossana M. C.. Testes de Aplicações Móveis: uma análise das pesquisas científicas via revisão sistemática. In: SIMPÓSIO BRASILEIRO DE QUALIDADE DE SOFTWARE (SBQS), 11. , 2012, Fortaleza. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2012 . p. 203-217. DOI: https://doi.org/10.5753/sbqs.2012.15317.