Kastney Frazão
Davi Viana
ABSTRACT
To evaluate educational games, several techniques have been proposed considering different quality attributes. However, there are still several educational games for the mobile context that have low scores in the app stores. These stores allow users to make comments to evaluate the applications, as this data can be useful for the development team that aims to meet users' expectations. The analysis of comments made by users can help identify which attributes impact the use of mobile educational games. In this paper, an inspection checklist is proposed to evaluate mobile educational games. To complement the attributes identified in the analysis of comments, attributes from existing techniques for evaluating mobile educational games were also considered. The final evaluation form contains a total of 82 attributes distributed in evaluation categories, such as: user interface, mobility, pedagogy, gameplay, among others. To evaluate the proposed technique, an evaluation was carried out with the checklist in two mobile educational games available in the Google Play Store, different from those used to define the technique. The initial results indicate that the proposed checklist allows the identification of problems pointed out by users in the comments left in the app store.
- Alhuseen O Alsayed, Anwar L Bilgrami, and WA Foster. 2017. Improving software quality management: testing, review, inspection and walkthrough. International Journal of Latest Research in Science and Technology 6, 1 (2017), 7--12.Google Scholar
- Bill Brykczynski. 1999. A survey of software inspection checklists. ACM SIGSOFT Software Engineering Notes 24, 1 (1999), 82.Google ScholarDigital Library
- Rafaela Vilela da Rocha, Ig Ibert Bittencourt, and Seiji Isotani. 2015. Análise, Projeto, Desenvolvimento e Avaliação de Jogos Sérios e Afins: uma revisão de desafios e oportunidades. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), Vol. 26. 692.Google ScholarCross Ref
- Necmiye Genc-Nayebi and Alain Abran. 2017. A systematic literature review: Opinion mining studies from mobile app store user reviews. Journal of Systems and Software 125 (2017), 207--219.Google ScholarCross Ref
- Mark Harman, Yue Jia, and Yuanyuan Zhang. 2012. App store mining and analysis: MSR for app stores. In 2012 9th IEEE working conference on mining software repositories (MSR). IEEE, 108--111.Google Scholar
- Hammad Khalid, Emad Shihab, Meiyappan Nagappan, and Ahmed E Hassan. 2014. What do mobile app users complain about? IEEE software 32, 3 (2014), 70--77.Google Scholar
- Hasiah Mohamed, Azizah Jaafar, et al. 2010. Heuristics evaluation in computer games. In 2010 International Conference on Information Retrieval & Knowledge Management (CAMP). IEEE, 188--193.Google Scholar
- Jakob Nielsen and Rolf Molich. 1990. Heuristic evaluation of user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems. 249--256.Google ScholarDigital Library
- Dennis Pagano and Walid Maalej. 2013. User feedback in the appstore: An empirical study. In 2013 21st IEEE international requirements engineering conference (RE). IEEE, 125--134.Google Scholar
- Sebastiano Panichella, Andrea Di Sorbo, Emitza Guzman, Corrado A Visaggio, Gerardo Canfora, and Harald C Gall. 2015. How can i improve my app? classifying user reviews for software maintenance and evolution. In 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, 281--290.Google ScholarDigital Library
- R Savi, C Gresse von Wangenheim, AF Borgatto, L Buglione, and VR Ulbricht. 2012. MEEGA-A model for the evaluation of games for teaching software engineering. Technical Report. Technical Report INCoD.Google Scholar
- Statista. 2018. Market share of mobile operating system in Brazil from January 2012 to December 2018. https://www.statista.com/statistics/262167/market-share-held-by-mobile-operating-systems-in-brazil/Google Scholar
- Syamsul Bahrin Zaibon and Norshuhada Shiratuddin. 2010. Heuristics evaluation strategy for mobile game-based learning. In 2010 6th IEEE International Conference on Wireless, Mobile, and Ubiquitous Technologies in Education. IEEE, 127--131.Google ScholarDigital Library
Index Terms
- Analyzing App Store Comments and Quality Attributes for Defining an Inspection Checklist for Mobile Educational Games
Recommendations
TIMEG: Development and Evaluation of an Inspection Checklist Tool for Mobile Educational Games
SBES '21: Proceedings of the XXXV Brazilian Symposium on Software EngineeringThe software inspection process allows identifying defects during the development cycle. In the context of mobile serious games, specific inspection checklists can be employed to guarantee their quality. However, there are few tools to support the use ...
A Review of Heuristics Evaluation Component for Mobile Educational Games
AbstractMobile educational games research has gained a lot of attention among researchers. This is due to mobile games popularity and engagement among younger generation. However, developing an effective mobile educational game is always a challenge. ...
Same app, different app stores: a comparative study
MOBILESoft '17: Proceedings of the 4th International Conference on Mobile Software Engineering and SystemsTo attract more users, implementing the same mobile app for different platforms has become a common industry practice. App stores provide a unique channel for users to share feedback on the acquired apps through ratings and textual reviews. However, ...
Comments