Benefits and Challenges of a Physical Device Farm for Automated Software Testing: A Case Study of the STELA Tool Implementation
Resumo
Software testing ensures seamless user experience that is achievable through manual or automated testing. Automated testing offers benefits, such as time reduction and parallel task execution. Physical device farms are used to conduct automated tests across different Android versions. The Software Test Execution Lab for Automation (STELA), designed as a Physical Device Farm, was recently implemented at a software institute by an automation team. This tool, housed in a lab with a capacity of 400 mobile devices, aided the testing team in executing automated tests. Interviews with 22 testing team members highlighted time optimization and a simplified interface as the primary benefits of STELA. Since its implementation, approximately 979 tests have been conducted, saving approximately 1915 minutes. This study examines the pros and cons of using a Physical Device Farm for software testing.
Palavras-chave:
Software Testing, Physical Device Farm, Automated Testing, Experience Report
Referências
Haipeng Cai, Ziyi Zhang, Li Li, and Xiaoqin Fu. 2019. A large-scale study of application incompatibilities in android. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis. 216–227.
Hao Lin, Jiaxing Qiu, Hongyi Wang, Zhenhua Li, Liangyi Gong, Di Gao, Yunhao Liu, Feng Qian, Zhao Zhang, Ping Yang, and Tianyin Xu. 2023. Virtual Device Farms for Mobile App Testing at Scale: A Pursuit for Fidelity, Efficiency, and Accessibility. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking. Association for Computing Machinery, New York, NY, USA, Article 45, 17 pages. DOI: 10.1145/3570361.3613259
Goutam Kumar Saha. 2008. Understanding software testing concepts. Ubiquity 2008, February, Article 2 (feb 2008), 1 pages. DOI: 10.1145/1361367.1348484
Janice Singer, Susan E. Sim, and Timothy C. Lethbridge. 2008. Software Engineering Data Collection for Field Studies. Springer London, London, 9–34. DOI: 10.1007/978-1-84800-044-5_1
Hao Lin, Jiaxing Qiu, Hongyi Wang, Zhenhua Li, Liangyi Gong, Di Gao, Yunhao Liu, Feng Qian, Zhao Zhang, Ping Yang, and Tianyin Xu. 2023. Virtual Device Farms for Mobile App Testing at Scale: A Pursuit for Fidelity, Efficiency, and Accessibility. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking. Association for Computing Machinery, New York, NY, USA, Article 45, 17 pages. DOI: 10.1145/3570361.3613259
Goutam Kumar Saha. 2008. Understanding software testing concepts. Ubiquity 2008, February, Article 2 (feb 2008), 1 pages. DOI: 10.1145/1361367.1348484
Janice Singer, Susan E. Sim, and Timothy C. Lethbridge. 2008. Software Engineering Data Collection for Field Studies. Springer London, London, 9–34. DOI: 10.1007/978-1-84800-044-5_1
Publicado
30/09/2024
Como Citar
CHAVES, Lennon; OLIVEIRA, Flavia; TIAGO, Leonardo; CASTRO, Renata.
Benefits and Challenges of a Physical Device Farm for Automated Software Testing: A Case Study of the STELA Tool Implementation. In: SIMPÓSIO BRASILEIRO DE TESTES DE SOFTWARE SISTEMÁTICO E AUTOMATIZADO (SAST), 9. , 2024, Curitiba/PR.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 89-91.
DOI: https://doi.org/10.5753/sast.2024.3880.
