Development and Evaluation of the Game LEAGUE OF QUALITY: ISO/IEC 25000 in an Educational Context

• Eloisa Toffano Seidel Masson UniCEUB
• Antonio Haddad UniCEUB
• Angelica Toffano S. Calazans UniCEUB https://orcid.org/0000-0002-2783-4473
• Roberto Avila Paldes UniCEUB
• Edna Dias Canedo UnB http://orcid.org/0000-0002-2159-339X

DOI: https://doi.org/10.5753/sbqs.2025.13846

Resumo

Context: Teaching software quality concepts can be challenging due to their abstract nature and limited engagement with traditional instructional methods. To address this, educational games have emerged as an effective strategy for improving motivation and learning outcomes, particularly in Information Technology programs. Aims: This paper reports on the development and evaluation of the educational game LEAGUE OF QUALITY: ISO/IEC 25000, which aims to teach software product quality concepts based on ISO/IEC 25000. The goal is to introduce diversity into the course and enhance students’ skills, engagement, and knowledge. Method: The development of the game followed four phases: pre-production, pilot testing, production, and finalization. The game was applied in classroom settings with IT students at a Brazilian university. Data was collected from both students and professors regarding their perceptions of the game’s effectiveness and usability. Results: Most students reported that the concepts presented in the game were applicable to real-world professional scenarios. They found the dynamics of the game clear, accessible, and engaging, contributing positively to their understanding. The game provided a better learning experience, especially for students with little prior knowledge. Professors also observed increased motivation, participation, and improved learning outcomes. Conclusions: LEAGUE OF QUALITY proved to be an effective and engaging educational tool for teaching software product quality. It enhanced student motivation, especially among those with limited prior knowledge, and promoted better understanding and retention of key concepts. Both students and professors reported increased engagement, with students highlighting the game’s relevance to real-world practice and its positive impact on the learning experience.

Palavras-chave: Teaching in Higher Education, Knowledge Sharing, Teaching Innovation

Referências

Elvira-Maria Arvanitou, Apostolos Ampatzoglou, Alexander Chatzigeorgiou, Matthias Galster, and Paris Avgeriou. 2018. A mapping study on design-time quality attributes and metrics (journal-first abstract). In 25th International Conference on Software Analysis, Evolution and Reengineering, SANER 2018, Campobasso, Italy, March 20-23, 2018, Rocco Oliveto, Massimiliano Di Penta, and David C. Shepherd (Eds.). IEEE Computer Society, DOI: 10.1109/SANER.2018.8330240 474.

M. Arztmann, L. Hornstra, J. Jeuring, and L Kester. 2022. Effects of games in STEM education: a meta-analysis on the moderating role of student background characteristics. Studies in Science Education 59(1) (2022), 109–145.

Paulo Eduardo Battistella and Christiane Gresse von Wangenheim. 2016. Games for Teaching Computing in Higher Education – A Systematic Review. IEEE Technology and Engineering Education (ITEE) 1, 3 (2016), 8–18. chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/ [link]

Elizabeth A. Boyle, Thomas Hainey, Thomas M. Connolly, Grant Gray, Jeffrey Earp, Michela Ott, Theodore Lim, Manuel Ninaus, Cláudia Sofia Ribeiro, and João Madeiras Pereira. 2016. An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games. Comput. Educ. 94 (2016), 178–192. DOI: 10.1016/J.COMPEDU.2015.11.003

Lea C. Brandl and Andreas Schrader. 2024. Serious Games in Higher Education in the Transforming Process to Education 4.0—Systematized Review. Educ. Sci. 14, 281 (2024), 1–12. DOI: 10.3390/educsci14030281

Angelica Calazans, Eloisa Masson, Mauro Souza, Isabel Brito, Roberto Paldes, Ricardo Kosloski, Cristiane Ramos, and Fernando Guimaraes. 2019. Ensino Superior com metodologias ativas: na prática, como se faz. Clube de autores, 978-85-953-5158-5. 203 pages.

Yandson Costa, Dayanne Gomes, Sebastião Santos, Nathasha Pinto, Davi Viana, Geraldo Braz Junior, and Luis Rivero. 2020. Identifying Improvement Opportunities in Software Engineering Education at the Maranhão State: Listening to Voices from Academy and Industry. In 34th Brazilian Symposium on Software Engineering, SBES 2020, Natal, Brazil, October 19-23, 2020, Everton Cavalcante, Francisco Dantas, and Thaís Batista (Eds.). ACM, DOI: 10.1145/3422392.3422495 860–869.

Nartional Congress da República, Presidência. 2018. Brazilian General Data Protection Law (LGPD). Nartional Congress, accessed in April 10, 2022 1, 1 (2018), 1–31. [link]

Maria Adriana Ferreira da Silva, Alana Gabrielly Pereira Pinheiro, Pedro Henrique Aires da Silva, and Alysson Filgueira Milanez. 2022. GameTest:Umprotótipo de jogo para apoiar o ensino-aprendizagem de Teste de Software. Conjecturas (2022), 1–19. DOI: 10.53660/CONJ-1104-R14

Joeldson Costa Damasceno, Jonathan Jalles Silva Batista, and Charles Andrye Galvão Madeira. 2022. Gamificação como Ferramenta de Ensino Aprendizagem na Produção de Artefatos do CMMI. In TRILHA DE EDUCAÇÃO – ARTIGOS COMPLETOS - SIMPÓSIO BRASILEIRO DE JOGOS E ENTRETENIMENTO DIGITAL (SBGAMES). SBC, [link] 796–805. DOI: 10.5753/sbgames_estendido.2022.226003

Isaac Elgrably and Sandro Oliveira. 2023. Uma Abordagem para o Ensino de Testes de Software utilizando Metodologias Ativas em Cursos Superiores de Computação. In Anais Estendidos do XII Congresso Brasileiro de Informática na Educação (Passo Fundo/RS). SBC, Porto Alegre, RS, Brasil, 10.5753/cbie_estendido.2023.234630, 13–25. [link]

International Electrotechnical Commission International Organization for Standardization. 2011. ISO/IEC 25000: Systems and software engineering - Systems and software product Quality equirements and Evaluation (SQuaRE) - System and software quality models. ISO/IEC 1 (2011), 1–27.

International Electrotechnical Commission International Organization for Standardization. 2014. ISO/IEC 25000: Systems and software engineering - Systems and software product Quality equirements and Evaluation (SQuaRE) - Guide to SQuaRE. ISO/IEC 1 (2014), 1–27.

International Electrotechnical Commission International Organization for Standardization. 2016. ISO/IEC 25023: Systems and software engineering - Systems and software product Quality equirements and Evaluation (SQuaRE) - Measurement of system and software product quality. ISO/IEC 1 (2016), 1–45.

International Electrotechnical Commission International Organization for Standardization. 2024. ISO/IEC 25002:2024: Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Quality model overview and usage. ISO/IEC 1 (2024), 1–17.

Stamatis Karnouskos, Roopak Sinha, Paulo Leitão, Luis Ribeiro, and Thomas. I. Strasser. 2018. The Applicability of ISO/IEC 25023 Measures to the Integration of Agents and Automation Systems. In IECON 2018 - 44th Annual Conference of the IEEE Industrial Electronics Society. IEEE, [link] 2927–2934. DOI: 10.1109/IECON.2018.8592777

Petros Lameras, Sylvester Arnab, Ian Dunwell, Craig D. Stewart, Samantha Clarke, and Panagiotis Petridis. 2017. Essential features of serious games design in higher education: Linking learning attributes to game mechanics. Br. J. Educ. Technol. 48, 4 (2017), 972–994. DOI: 10.1111/BJET.12467

Ariany M. Almeida Maia, Lauana Maria C. de Oliveira, Maria Elanne M.Rodrigues, Windson Viana, and Anna Beatriz Marques. 2023. Adotando aulas invertidas e gamificação no ensino de Qualidade de Processos de Software com foco no MPS.BR. In WORKSHOP SOBRE EDUCAÇÃO EM COMPUTAÇÃO (WEI). SBC, [link] 1–12. DOI: 10.5753/wei.2023.230905

Eloisa Toffano Seidel Masson, Angélica Toffano Seidel Calazans, Ian Nery Bandeira, Geovana Ramos Sousa Silva, and Edna Dias Canedo. 2023. Scrum in Practice: City Reconstruction as a Pedagogical Game Challenge. In Proceedings of the XXII Brazilian Symposium on Software Quality, SBQS 2023, Brasilia, Brazil, November 7-10, 2023, Edna Dias Canedo, Daniel de Paula Porto, Fábio Lúcio Lopes de Mendonça, Rafael Timóteo de Sousa Júnior, Monalessa Perini Barcellos, Ismayle de Sousa Santos, Sheila S. Reinehr, Sérgio Soares, Uirá Kulesza, Érica Ferreira de Souza, Adriano Albuquerque, Carla I. M. Bezerra, Rodrigo Pereira dos Santos, Alessandro F. Garcia, Simone Dornelas Costa, and Adolfo Gustavo Serra Seca Neto (Eds.). ACM, DOI: 10.1145/3629479.3629480 321–331.

Andressa Medeiros and Jorge Marques Prates. 2020. Metodologias Ativas no Ensino de Teste de Software para Alunos com Dedicação Parcial. In Congresso Brasileiro de informatica na Educação - CBIE 2023 - Computer on the beach. SBC, 10.14210/cotb.v11n1.p548-555, 1–13.

Gao Mingyu, Uwe van Heesch, and Karmila Rafiqah M. Rafiq. 2024. Educational Games and Game-based Approaches in Higher Education: A Systematic Review (2014-2023). International Journal of Academic Research in Progressive Education and Development 13(1) (2024), 899–919. DOI: 10.6007/IJARPED/v13-i1/20555

Maria Alciléia Alves Rocha, Higor Barboza Hermes, Aline Alves Moreno Cantilier, and Luana Mendes Alves. 2020. O Qualif e os jogos digitais que apoiam o ensinoaprendizagem sobre qualidade de software. Vértices (Campos dos Goitacazes) 22(2) (2020), 181–207. DOI: 10.19180/1809-2667.v22n22020p181-207

Maria Alciléia Alves Rocha, Higor Barboza Hermes, Aline Alves Moreno Cantilieri, and Luana Mendes Alves. 2019. Um mapeamento sistemático dos jogos que apoiam o ensino-aprendizagem sobre qualidade de software Maria Alciléia Alves Rocha. In Proceedings of the X Congresso integrado de tecnologia da informação - CITI 2019, CITI 2019, Rio de Janeiro, Brazil, 2019. IFF -Insituto Federal Fluminense , [link] 1–10.

Terence P. Rout. 2003. ISO/IEC 15504 - Evolution to an international standard. Softw. Process. Improv. Pract. 8, 1 (2003), 27–40. DOI: 10.1002/SPIP.167

Rafael Savi, Christiane Gresse von Wangenheim, and Adriano Ferreti Borgatto. 2011. A Model for the Evaluation of Educational Games for Teaching Software Engineering. In 25th Brazilian Symposium on Software Engineering, SBES 2011, Sao Paulo, Brazil, September 28-30, 2011. IEEE Computer Society, DOI: 10.1109/SBES.2011.27 194–203.

Andreza Renara Silva, Jorge Luiz Sousa, Patrícia de Vasconcelos, and Jacilane Rabelo. 2023. MPS.Br Game: Proposta de Jogo Educacional. In Proceedings of the XIV Computer on the Beach, 30 de Março a 01 de Abril de 2023, Florianópolis, SC, Brasil. Univale, [link] 495–497. DOI: 10.14210/cotb.v14.p495-497

Andrea Trenta. 2023. Accounting AI Measures as ISO/IEC 25000 Standards Measures. In Joint Proceedings of the 5th International Workshop on Experience with SQuaRE series and its Future Direction and the 11th InternationalWorkshop on Quantitative Approaches to Software Quality co-located with the 30th Asia Pacific Software Engineering Conference (APSEC 2023), Seoul, South Korea, December 4, 2023 (CEUR Workshop Proceedings, Vol. 3612), Tsuyoshi Nakajima, Toshihiro Komiyama, Horst Lichter, Thanwadee Sunetnanta, and Toni Anwar (Eds.). CEURWS. org, [link] 22–28.

Elliot Varoy, Kerry Lee, Andrew Luxton-Reilly, and Nasser Giacaman. 2023. Draw a Computing Student: Facilitating Semi-Structured Interviews Through Drawing. In Proceedings of the 54th ACM Technical Symposium on Computer Science Education, Volume 1, SIGCSE 2023, Toronto, ON, Canada, March 15-18, 2023, Maureen Doyle, Ben Stephenson, Brian Dorn, Leen-Kiat Soh, and Lina Battestilli (Eds.). ACM, DOI: 10.1145/3545945.3569795 903–909.

D. Vlachopoulos and A. Makri. 2017. The effect of games and simulations on higher education: a systematic literature review. Technol High Educ 14(22) (2017), 1–33. DOI: 10.1186/s41239-017-0062-1

Soumia Yamoul, Lynda Ouchaouka, Mohammed Moussetad, and Mohamed Radid. 2023. Systematic Review of Serious Games in Higher Education: Objectives, Benefits, Limitations, and Perspectives. In 7th IEEE Congress on Information Science and Technology, CiSt 2023, Agadir - Essaouira, Morocco, December 16-22, 2023. IEEE, DOI: 10.1109/CiSt56084.2023.10409880 450–455.