TString: a tool to locate the target string’s screen based on automatic exploration

• Lais Felipe UFPE https://orcid.org/0009-0007-5861-387X
• Breno Miranda UFPE https://orcid.org/0000-0001-9608-9393
• Maria Couto UFPE https://orcid.org/0000-0001-5387-9029

DOI: https://doi.org/10.5753/sast.2024.3886

Resumo

Developing localized software applications for multiple languages can significantly expand a developer’s potential consumer base, offering strong economic incentives. When targeting the global market, it is essential to adapt content to the specific region, culture, or country that the software will serve. Therefore, Localization (l10n) and Internationalization (i18n) testing are crucial for ensuring a seamless user experience, regardless of the locale settings on the application. A key task in localization testing is validating textual content (strings), which often relies heavily on the tester’s experience to locate screens containing the strings that need validation. However, the limited availability of automated tools for localization and internationalization testing results in labor-intensive, repetitive manual work. This research seeks to address these challenges by (i) introducing TString, a tool designed to assist localization and internationalization testers in identifying screens containing specific strings for validation, and (ii) conducting a preliminary evaluation to assess the usefulness of TString in an industrial context. To assess the tool’s usability, the System Usability Scale (SUS) was employed. A group of localization/internationalization testers received an overview of the tool and subsequently completed the SUS questionnaire. The tool achieved highly positive results, with scores ranging from 92.5 to 100, indicating strong acceptance and a high likelihood of meeting the testers’ needs.

Palavras-chave: Localization, Internationalization, L10n, i18n, string, tool

Referências

Aiman M. Ayyal Awwad andWolfgang Slany. 2016. Automated Bidirectional Languages Localization Testing for Android Apps with Rich GUI. Mobile Information Systems 2016 (2016), 13 pages.

Aaron Bangor, Philip T. Kortum, and James T. Miller. 2008. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction 24 (2008), 574–597. DOI: 10.1080/10447310802205776

BIDIRECTIONALITY. [n. d.]. [link]

Francis Bond and Ryan Foster. 2013. Linking and extending an open multilingual wordnet. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1352–1362.

John Brooke. 1995. SUS: A quick and dirty usability scale. Usability Eval. Ind. 189 (11 1995).

Maria Couto and Breno Miranda. 2023. An Industrial Experience Report on the Challenges in Training Localization and Internationalization Testers. In Proceedings of the 8th Brazilian Symposium on Systematic and Automated Software Testing (Campo Grande, Brazil) (SAST ’23). Association for Computing Machinery, New York, NY, USA, 3 pages. DOI: 10.1145/3624032.3624045

Maria Couto and Breno Miranda. 2023. l10n-trainer: a Tool to Assist in the Training of Localization (l10n) and Internationalization (i18n) Testers. In Proceedings of the XXXVII Brazilian Symposium on Software Engineering (Campo Grande, Brazil) (SBES ’23). Association for Computing Machinery, New York, NY, USA, 6 pages. DOI: 10.1145/3613372.3613420

Camilo Escobar-Velásquez, Michael Osorio-Riaño, Juan Dominguez-Osorio, Maria Arevalo, and Mario Linares-Vásquez. 2020. An Empirical Study of i18n Collateral Changes and Bugs in GUIs of Android apps. In 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME). 581–592. DOI: 10. 1109/ICSME46990.2020.00061

Luis Leiva and Vicent Alabau. 2014. The impact of visual contextualization on UI localization. (04 2014). DOI: 10.1145/2556288.2556982

Yuanchun Li, Ziyue Yang, Yao Guo, and Xiangqun Chen. 2017. DroidBot: a lightweight UI-Guided test input generator for android. In 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C). 23–26. DOI: 10.1109/ICSE-C.2017.8

Rob McCarney, James Warner, Steve Iliffe, Robbert Van Haselen, Mark Griffin, and Peter Fisher. 2007. The Hawthorne Effect: a randomised, controlled trial. BMC medical research methodology 7 (2007), 1–8.

Rajkumar. 2023. A complete beginners guide to localization testing. [link]

Rudolf Ramler and Robert Hoschek. 2017. Process and Tool Support for Internacionalization and Localization Testing. Product-Focused SW Process Improvement (2017), 385–393.

JunmeiWang and JihongWu. 2019. Research on Mobile Application Automation Testing Technology Based on Appium. In 2019 International Conference on Virtual Reality and Intelligent Systems (ICVRIS). 247–250. DOI: 10.1109/ICVRIS.2019.00068

Xin Xia, David Lo, Feng Zhu, Xinyu Wang, and Bo Zhou. 2013. Software Internationalization and Localization: An Industrial Experience. Proceedings of the IEEE International Conference on Engineering of Complex Computer Systems, ICECCS, 222–231. DOI: 10.1109/ICECCS.2013.40

Chunsheng Zhao, Zhiyong He, and Wei Zeng. 2010. Study on International Software Localization Testing. 2010 Second World Congress on Software Engineering 2 (2010), 257–260.

Liu Zhifang, Liu Bin, and Gao Xiaopeng. 2010. Test Automation on Mobile Device. In Proceedings of the 5th Workshop on Automation of Software Test (Cape Town, South Africa) (AST ’10). Association for Computing Machinery, New York, NY, USA, 1–7. DOI: 10.1145/1808266.1808267