Critical Failure: A Card Game to Support the Learning of Non-Functional Testing: Exploring Software Quality Attributes through Competition and Engagement

• Andre L. S. e Oliveira UFPB http://orcid.org/0009-0004-5613-5913
• Matheus Nascimento UFPB
• Antonio Filho UFPB
• Ana Cecilia Nascimento UFPB
• Erik Freire Ramos UFPB
• Christopher A. T. da Silva UFPB
• Yuska Paola Costa Aguiar UFPB http://orcid.org/0000-0002-1932-2240

DOI: https://doi.org/10.5753/sbqs.2025.15261

Abstract

Teaching non-functional testing and software quality attributes presents persistent challenges due to the abstract and theoretical nature of the content. To address this, we developed Critical Failure, a card game designed to support learning through playful competition and active engagement. Inspired by poker mechanics and adapted for educational use, the game encourages players to evaluate and critique each other’s hands as software systems, simulating the evaluation of quality attributes such as performance, usability, and security. The game was created as part of a Software Testing course to offer a more interactive alternative to traditional lectures. The game was played by a group of 17 students who provided highly positive feedback on its clarity, engagement, and educational value. Suggestions for improvement were incorporated into the final version, refining both gameplay balance and alignment with course content. The activity demonstrated strong potential as a didactic tool, helping students not only recognize various non-functional requirements but also understand how they interact and impact the testing process. This article presents the design of the game and reports on its initial classroom use as an exploratory activity, intended to gather impressions, refine mechanics, and assess its potential as a complementary tool for teaching non-functional testing concepts.

Keywords: non-functional testing, software quality attributes, active learning, Critical Failure, original game design

References

S. S. Riaz Ahamed. 2010. Studying the Feasibility and Importance of Software Testing: An Analysis. arXiv:1001.4193 [cs.SE] [link]

Thiago Beppe, Italo Linhares de Araújo, Bruno Aragão, Ismayle De Sousa Santos, Davi Ximenes, and Rossana Andrade. 2018. GreaTest: a card game to motivate the software testing learning. SBES ’18: Proceedings of the XXXII Brazilian Symposium on Software Engineering, 298–307. DOI: 10.1145/3266237.3266254

Sharon Bertsch, Bryan Pesta, Richard Wiscott, and Michael Mcdaniel. 2007. The generation effect: A meta-analytic review. Memory & cognition 35 (04 2007), 201–10. DOI: 10.3758/BF03193441

Raquel Blanco, Manuel Trinidad, María José Suárez-Cabal, Alejandro Calderón, Mercedes Ruiz, and Javier Tuya. 2023. Can gamification help in software testing education? Findings from an empirical study. Journal of Systems and Software 200 (2023), 111647. DOI: 10.1016/j.jss.2023.111647

Felipe Carvalho and Mariano Pimentel. 2020. Atividades autorais online: aprendendo com criatividade. [link] SBC Horizontes.

Carolina de Melo Costa, Yuska Paola Costa Aguiar, Luiz Gusttavo Oliveira de Souza, Jayanne Laysa Cruz Morais, and Pedro Alves da Silveira. 2024. Card Game as an Educational Strategy in Software Testing: Debug a game to explore content on Levels and Types of Testing.. In Proceedings of the XXIII Brazilian Symposium on Software Quality (SBQS ’24). Association for Computing Machinery, New York, NY, USA, 605–612. DOI: 10.1145/3701625.3701685

Dextrous Creative. 2025. Dextrous Creative. [link] Accessed on May 15, 2025.

Isaac Elgrably and Sandro Oliveira. 2023. Uma Abordagem para o Ensino de Testes de Software utilizando Metodologias Ativas em Cursos Superiores de Computação. Anais Estendidos do Congresso Brasileiro de Informática na Educação (CBIE), 13–25. DOI: 10.5753/cbie_estendido.2023.234630

Oliveira et al. 2025. Critical Failure Card Game – Brazilian Portuguese Version. [link] Accessed on October 12, 2025.

Oliveira et al. 2025. Critical Failure Card Game – English Version. [link] Accessed on October 12, 2025.

Vahid Garousi, Austen Rainer, Per Lauvås, and Andrea Arcuri. 2020. Softwaretesting education: A systematic literature mapping. Journal of Systems and Software 165 (2020), 110570. DOI: 10.1016/j.jss.2020.110570

Renata Faria Gomes and Valéria Lelli. 2021. GAMUT: GAMe-based learning approach for teaching Unit Testing. In Proceedings of the XX Brazilian Symposium on Software Quality (Virtual Event, Brazil) (SBQS ’21). Association for Computing Machinery, NewYork, NY, USA, Article 27, 11 pages. DOI: 10.1145/3493244.3493263

Google. 2025. Google Gemini. [link] Accessed on May 15, 2025.

Stéphanie Jean-Daubias. 2023. JADE: a board game to teach software ergonomics. Interaction Design and Architecture(s) Journal 56 (March 2023), 29–52. DOI: 10. 55612/s-5002-056-002

Gabriela Martins de Jesus, Fabiano Cutigi Ferrari, Leo Natan Paschoal, Simone do Rocio Senger de Souza, Daniel de Paula Porto, and Vinicius Humberto Serapilha Durelli. 2020. Is It Worth Using Gamification on Software Testing Education? An Extended Experience Report in the Context of Undergraduate Students. Journal of Software Engineering Research and Development 8 (Aug. 2020), 6:1 – 6:19. DOI: 10.5753/jserd.2020.738

JUnit Team. 2025. JUnit 5. [link] Accessed on May 15, 2025.

Yasmin B. Kafai and Quinn Burke. 2015. Constructionist Gaming: Understanding the Benefits of Making Games for Learning. Educational Psychologist 50, 4 (2015), 313–334. DOI: 10.1080/00461520.2015.1124022

OpenAI. 2025. ChatGPT. [link] Accessed on May 15, 2025.

Leo Natan Paschoal and Simone do Rocio Senger de Souza. 2018. A Survey on Software Testing Education in Brazil. In Proceedings of the XVII Brazilian Symposium on Software Quality (Curitiba, Brazil) (SBQS ’18). Association for Computing Machinery, New York, NY, USA, 334–343. DOI: 10.1145/3275245.3275289

Giani Petri, Christiane Gresse von Wangenheim, and Adriano Borgatto. 2017. A Large-Scale Evaluation of a Model for the Evaluation of Games for Teaching Software Engineering. DOI: 10.1109/ICSE-SEET.2017.11

E. Sheppard. 2025. ISO/IEC 25010:2023 Systems and Software Engineering — Systems and Software Quality Requirements and Evaluation (SQuaRE) — Product Quality Model Characteristics, Sub-characteristics, Definitions, and Their Proposed Application to Electric Vehicle Supply Equipment (EVSE) Software. DOI: 10.5281/zenodo.14758339 Accessed on October 12, 2025.

Norman Slamecka and Peter Graf. 1978. The Generation Effect: Delineation of a Phenomenon. Journal of Experimental Psychology: Human Learning and Memory 4 (11 1978), 592–604. DOI: 10.1037/0278-7393.4.6.592

Philipp Straubinger and Gordon Fraser. 2024. Gamifying a Software Testing Course with Continuous Integration. arXiv:2401.17740 [cs.SE] [link]

Philipp Straubinger, Tim Greller, and Gordon Fraser. 2025. Teaching Software Testing and Debugging with the Serious Game Sojourner under Sabotage. arXiv:2504.19291 [cs.SE] [link]

John Sweller. 2011. CHAPTER TWO - Cognitive Load Theory. Psychology of Learning and Motivation, Vol. 55. Academic Press, 37–76. DOI: 10.1016/B978-0-12-387691-1.00002-8

Simone Tonhão, Marcelo Shigenaga, Julio Herculani, Andressa Medeiros, Aline Amaral, Williamson Silva, Thelma Colanzi, and Igor Steinmacher. 2023. Gamification in Software Engineering Education: a Tertiary Study. In Proceedings of the XXXVII Brazilian Symposium on Software Engineering (Campo Grande, Brazil) (SBES ’23). Association for Computing Machinery, New York, NY, USA, 358–367. DOI: 10.1145/3613372.3614193

Universidade Federal da Paraíba. 2025. SIGAA - Sistema Integrado de Gestão de Atividades Acadêmicas. [link] Accessed on May 15, 2025.

Pedro Henrique Valle, Ellen Barbosa, and José Maldonado. 2015. Um Mapeamento Sistemático Sobre Ensino de Teste de Software. DOI: 10.5753/cbie.sbie.2015.71

Jari Vanhanen, Timo O.A. Lehtinen, and Casper Lassenius. 2018. Software engineering problems and their relationship to perceived learning and customer satisfaction on a software capstone project. Journal of Systems and Software 137 (2018), 50–66. DOI: 10.1016/j.jss.2017.11.021