Experiência do Usuário em Jogos Digitais: Uma Catalogação de Instrumentos de Avaliação
Resumo
As influências, métricas e aplicações da experiência do usuário vêm sendo investigadas em diversos contextos, inclusive em jogos digitais, sendo esta identificada como força motriz para impulsionar escolhas no desenvolvimento de jogos. Nesse contexto, jogos digitais demandam formas particulares de avaliação de UX, devido às particularidades da sua interação. Sendo assim, é necessário que profissionais e pesquisadores façam escolhas conscientes ao planejar essas avaliações. Esta pesquisa visa prover um catálogo de instrumentos de avaliação de UX em jogos, reunindo informações para orientar a seleção desses instrumentos no planejamento da avaliação de experiência do jogador.
Palavras-chave:
Experiência do jogador, Avaliação de UX, Jogos, Métodos de Avaliação
Referências
Larry E Wood. 1997. Semi-structured interviewing for user-centered design. Interactions 4, 2 (1997), 48–61.
Yadid Ayzenberg, Javier Hernandez Rivera, and Rosalind Picard. 2012. FEEL: frequent EDA and event logging–a mobile social interaction stress monitoring system. In CHI’12 extended abstracts on human factors in computing systems. ACM, 2357–2362.
Jeremy N Bailenson, Kim Swinth, Crystal Hoyt, Susan Persky, Alex Dimov, and Jim Blascovich. 2005. The independent and interactive effects of embodied-agent appearance and behavior on self-report, cognitive, and behavioral markers of copresence in immersive virtual environments. Presence: Teleoperators & Virtual Environments 14, 4 (2005), 379–393.
Wolmet Barendregt. 2006. Evaluating fun and usability in computer games with children.
Thomas Beauvisage. 2009. Computer usage in daily life. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 575–584.
Regina Bernhaupt. 2015. User experience evaluation methods in the games development life cycle. In Game User Experience Evaluation. Springer, 1–8.
Frank Biocca, Chad Harms, and Jenn Gregg. 2001. The networked minds measure of social presence: Pilot test of the factor structure and concurrent validity. In 4th annual international workshop on presence, Philadelphia, PA. 1–9.
Brenda Brathwaite and Ian Schreiber. 2008. Challenges for Game Designers, Charles River Media. Inc., Rockland, MA (2008).
Eduardo H Calvillo-Gámez, Paul Cairns, and Anna L Cox. 2015. Assessing the core elements of the gaming experience. In Game user experience evaluation. Springer, 37–62.
Nayana Carneiro, Ticianne Darin, and Windson Viana. 2018. Análise da Aplicação de Games User Research à Avaliação de Jogos Baseados em Localização. In Anais Estendidos do XVII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais. SBC.
M-T Cheng, H-C She, and Leonard A Annetta. 2015. Game immersion experience: its hierarchical structure and impact on game-based science learning. Journal of Computer Assisted Learning 31, 3 (2015), 232–253.
Lidiane Pereira Coelho and Diana Pereira Coelho de Mesquita. 2013. Língua, cultura e identidade: conceitos intrínsecos e interdependentes. EntreLetras 4, 1 (2013).
Ticianne Darin, Bianca Coelho, and Bosco Borges. 2019. Which Instrument Should I Use? Supporting Decision-Making About the Evaluation of User Experience. In International Conference on Human-Computer Interaction. Springer, 49–67.
Michael Anthony DeAnda and Carly A Kocurek. 2016. Game design as technical communication: Articulating game design through textbooks. Technical Communication Quarterly 25, 3 (2016), 202–210.
Pieter Desmet. 2003. Measuring emotion: Development and application of an instrument to measure emotional responses to products. In Funology. Springer, 111–123.
Xiaowen Fang, Jingli Zhang, and Susy S Chan. 2013. Development of an instrument for studying flow in computer game play. International journal of human-computer interaction 29, 7 (2013), 456–470.
Tracy Fullerton. 2018. Game design workshop: a playcentric approach to creating innovative games. AK Peters/CRC Press.
Marco Granato, Davide Gadia, Dario Maggiorini, and Laura A Ripamonti. 2018. Software and hardware setup for emotion recognition during video game fruition. In Proceedings of the 4th EAI International Conference on Smart Objects and Technologies for Social Good. ACM, 19–24.
Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91–97.
Johan Högberg, Juho Hamari, and Erik Wästlund. 2019. Gameful Experience Questionnaire (GAMEFULQUEST): an instrument for measuring the perceived gamefulness of system use. User Modeling and User-Adapted Interaction (2019), 1–42.
WA IJsselsteijn, YAW De Kort, and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven (2013).
Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203–220.
Troy C Kohwalter, Esteban GW Clua, and Leonardo GP Murta. 2013. Game flux analysis with provenance. In International Conference on Advances in Computer Entertainment Technology. Springer, 320–331.
Jeppe Komulainen, Jari Takatalo, Miikka Lehtonen, and Göte Nyman. 2008. Psychologically structured approach to user experience in games. In Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges. ACM, 487–490.
N Lazzaro. 2008. The four fun keys. Game Usability: Advancing the Player Experience (K. Isbister and N. Schaffer, Eds.).
JJ-W Lin, Henry Been-Lirn Duh, Donald E Parker, Habib Abi-Rached, and Thomas A Furness. 2002. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In Proceedings ieee virtual reality 2002. IEEE, 164–171.
Katerina Mania and Alan Chalmers. 2001. The effects of levels of immersion on memory and presence in virtual environments: A reality centered approach. CyberPsychology & Behavior 4, 2 (2001), 247–264.
Michael Meehan, Sharif Razzaque, Mary C Whitton, and Frederick P Brooks. 2003. Effect of latency on presence in stressful virtual environments. In IEEE Virtual Reality, 2003. Proceedings. IEEE, 141–148.
Christiane Moser, Verena Fuchsberger, and Manfred Tscheligi. 2012. Rapid assessment of game experiences in public settings. In Proceedings of the 4th International Conference on Fun and Games. ACM, 73–82.
Dinara Moura, Magy Seif el Nasr, and Christopher D Shaw. 2011. Visualizing and understanding players’ behavior in video games: discovering patterns and supporting aggregation and comparison. In Proceedings of the 2011 ACM SIGGRAPH symposium on video games. ACM, 11–15.
Lennart Nacke and Anders Drachen. 2011. Towards a framework of player experience research. In Proceedings of the second international workshop on evaluating player experience in games at FDG, Vol. 11.
A Ant Ozok. 2009. Survey design and implementation in HCI. HumanComputer Interaction: Development Process 253 (2009).
Natalia Padilla-Zea, José Rafael López-Arcos, Jose Luis Gonzalez Sanchez, Francisco L Gutierrez Vela, and Ana Abad-Arranz. 2013. A method to evaluate emotions in educational video games for children. Journal of universal computer science 19, 8 (2013), 1066–1085.
Mikki H Phan, Joseph R Keebler, and Barbara S Chaparro. 2016. The development and validation of the game user experience satisfaction scale (GUESS). Human factors 58, 8 (2016), 1217–1247.
Darque Pinto, Bruno Peixoto, Aliane Krassmann, Miguel Melo, Luciana Cabral, and Maximino Bessa. 2019. Virtual Reality in Education: Learning a Foreign Language. In World Conference on Information Systems and Technologies. Springer, 589–597.
Niklas Ravaja, Mikko Salminen, Jussi Holopainen, Timo Saari, Jari Laarni, and Aki Järvinen. 2004. Emotional response patterns and sense of presence during video games: Potential criterion variables for game design. In Proceedings of the third Nordic conference on Human-computer interaction. ACM, 339 347.
Shaghayegh Roohi, Jari Takatalo, J Matias Kivikangas, and Perttu Hämäläinen. 2018. Neural Network Based Facial Expression Analysis of GameEvents: A Cautionary Tale. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. ACM, 429–437.
José Luis González Sánchez, Francisco Luis Gutiérrez Vela, Francisco Montero Simarro, and Natalia Padilla-Zea. 2012. Playability: analysing user experience in video games. Behaviour & Information Technology 31, 10 (2012), 1033–1054.
Nikolaos Savva, Alfonsina Scarinzi, and Nadia Bianchi-Berthouze. 2012. Continuous recognition of player’s affective body expression as dynamic quality of aesthetic experience. IEEE Transactions on Computational Intelligence and AI in games 4, 3 (2012), 199–212.
Jesse Schell. 2014. The Art of Game Design: A book of lenses. AK Peters/CRC Press.
Chen Shu-Hui, Wu Wann-Yih, and Jason Dennison. 2018. Validation of EGameFlow: A Self-Report Scale for Measuring User Experience in Video Game Play. Computers in Entertainment (CIE) 16, 3 (2018), 6.
Judith Sirera and Yujie Yang. [n.d.]. The Interactive Sensual Evaluation Instrument. ([n. d.]).
Jari Takatalo, Jukka Häkkinen, Jyrki Kaistinen, and Göte Nyman. 2010. Presence, involvement, and flow in digital games. In Evaluating user experience in games. Springer, 23–46.
Vero Vanden Abeele, Lennart E Nacke, Elisa D Mekler, and Daniel Johnson. 2016. Design and preliminary validation of the player experience inventory. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. ACM, 335–341.
Arnold POS Vermeeren, Effie Lai-Chong Law, Virpi Roto, Marianna Obrist, Jettie Hoonhout, and Kaisa Väänänen-Vainio-Mattila. 2010. User experience evaluation methods: current state and development needs. In Proceedings of the 6th Nordic conference on human-computer interaction: Extending boundaries. ACM, 521–530.
Jorick Vissers, Lode De Bot, and Bieke Zaman. 2013. MemoLine: evaluating long-term UX with children. In Proceedings of the 12th International Conference on Interaction Design and Children. ACM, 285– 288.
Tanja Walsh, Piia Nurkka, Helen Petrie, and Jaana Olsson. 2013. The effect of language in answering qualitative questions in user experience evaluation web-surveys. In Proceedings of the 25th Australian ComputerHuman Interaction Conference: Augmentation, Application, Innovation, Collaboration. ACM, 73–82.
Tanja Walsh, Piia Nurkka, and Rod Walsh. 2010. Cultural diferences in smartphone user experience evaluation. In Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia. ACM, 24.
Josef Wiemeyer, Lennart Nacke, Christiane Moser, et al. 2016. Player experience. In Serious Games. Springer, 243–271.
Bob G Witmer, Christian J Jerome, and Michael J Singer. 2005. The factor structure of the presence questionnaire. Presence: Teleoperators & Virtual Environments 14, 3 (2005), 298–312.
Claes Wohlin. 2014. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th international conference on evaluation and assessment in software engineering. Citeseer, 38.
Yadid Ayzenberg, Javier Hernandez Rivera, and Rosalind Picard. 2012. FEEL: frequent EDA and event logging–a mobile social interaction stress monitoring system. In CHI’12 extended abstracts on human factors in computing systems. ACM, 2357–2362.
Jeremy N Bailenson, Kim Swinth, Crystal Hoyt, Susan Persky, Alex Dimov, and Jim Blascovich. 2005. The independent and interactive effects of embodied-agent appearance and behavior on self-report, cognitive, and behavioral markers of copresence in immersive virtual environments. Presence: Teleoperators & Virtual Environments 14, 4 (2005), 379–393.
Wolmet Barendregt. 2006. Evaluating fun and usability in computer games with children.
Thomas Beauvisage. 2009. Computer usage in daily life. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 575–584.
Regina Bernhaupt. 2015. User experience evaluation methods in the games development life cycle. In Game User Experience Evaluation. Springer, 1–8.
Frank Biocca, Chad Harms, and Jenn Gregg. 2001. The networked minds measure of social presence: Pilot test of the factor structure and concurrent validity. In 4th annual international workshop on presence, Philadelphia, PA. 1–9.
Brenda Brathwaite and Ian Schreiber. 2008. Challenges for Game Designers, Charles River Media. Inc., Rockland, MA (2008).
Eduardo H Calvillo-Gámez, Paul Cairns, and Anna L Cox. 2015. Assessing the core elements of the gaming experience. In Game user experience evaluation. Springer, 37–62.
Nayana Carneiro, Ticianne Darin, and Windson Viana. 2018. Análise da Aplicação de Games User Research à Avaliação de Jogos Baseados em Localização. In Anais Estendidos do XVII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais. SBC.
M-T Cheng, H-C She, and Leonard A Annetta. 2015. Game immersion experience: its hierarchical structure and impact on game-based science learning. Journal of Computer Assisted Learning 31, 3 (2015), 232–253.
Lidiane Pereira Coelho and Diana Pereira Coelho de Mesquita. 2013. Língua, cultura e identidade: conceitos intrínsecos e interdependentes. EntreLetras 4, 1 (2013).
Ticianne Darin, Bianca Coelho, and Bosco Borges. 2019. Which Instrument Should I Use? Supporting Decision-Making About the Evaluation of User Experience. In International Conference on Human-Computer Interaction. Springer, 49–67.
Michael Anthony DeAnda and Carly A Kocurek. 2016. Game design as technical communication: Articulating game design through textbooks. Technical Communication Quarterly 25, 3 (2016), 202–210.
Pieter Desmet. 2003. Measuring emotion: Development and application of an instrument to measure emotional responses to products. In Funology. Springer, 111–123.
Xiaowen Fang, Jingli Zhang, and Susy S Chan. 2013. Development of an instrument for studying flow in computer game play. International journal of human-computer interaction 29, 7 (2013), 456–470.
Tracy Fullerton. 2018. Game design workshop: a playcentric approach to creating innovative games. AK Peters/CRC Press.
Marco Granato, Davide Gadia, Dario Maggiorini, and Laura A Ripamonti. 2018. Software and hardware setup for emotion recognition during video game fruition. In Proceedings of the 4th EAI International Conference on Smart Objects and Technologies for Social Good. ACM, 19–24.
Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91–97.
Johan Högberg, Juho Hamari, and Erik Wästlund. 2019. Gameful Experience Questionnaire (GAMEFULQUEST): an instrument for measuring the perceived gamefulness of system use. User Modeling and User-Adapted Interaction (2019), 1–42.
WA IJsselsteijn, YAW De Kort, and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven (2013).
Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203–220.
Troy C Kohwalter, Esteban GW Clua, and Leonardo GP Murta. 2013. Game flux analysis with provenance. In International Conference on Advances in Computer Entertainment Technology. Springer, 320–331.
Jeppe Komulainen, Jari Takatalo, Miikka Lehtonen, and Göte Nyman. 2008. Psychologically structured approach to user experience in games. In Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges. ACM, 487–490.
N Lazzaro. 2008. The four fun keys. Game Usability: Advancing the Player Experience (K. Isbister and N. Schaffer, Eds.).
JJ-W Lin, Henry Been-Lirn Duh, Donald E Parker, Habib Abi-Rached, and Thomas A Furness. 2002. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In Proceedings ieee virtual reality 2002. IEEE, 164–171.
Katerina Mania and Alan Chalmers. 2001. The effects of levels of immersion on memory and presence in virtual environments: A reality centered approach. CyberPsychology & Behavior 4, 2 (2001), 247–264.
Michael Meehan, Sharif Razzaque, Mary C Whitton, and Frederick P Brooks. 2003. Effect of latency on presence in stressful virtual environments. In IEEE Virtual Reality, 2003. Proceedings. IEEE, 141–148.
Christiane Moser, Verena Fuchsberger, and Manfred Tscheligi. 2012. Rapid assessment of game experiences in public settings. In Proceedings of the 4th International Conference on Fun and Games. ACM, 73–82.
Dinara Moura, Magy Seif el Nasr, and Christopher D Shaw. 2011. Visualizing and understanding players’ behavior in video games: discovering patterns and supporting aggregation and comparison. In Proceedings of the 2011 ACM SIGGRAPH symposium on video games. ACM, 11–15.
Lennart Nacke and Anders Drachen. 2011. Towards a framework of player experience research. In Proceedings of the second international workshop on evaluating player experience in games at FDG, Vol. 11.
A Ant Ozok. 2009. Survey design and implementation in HCI. HumanComputer Interaction: Development Process 253 (2009).
Natalia Padilla-Zea, José Rafael López-Arcos, Jose Luis Gonzalez Sanchez, Francisco L Gutierrez Vela, and Ana Abad-Arranz. 2013. A method to evaluate emotions in educational video games for children. Journal of universal computer science 19, 8 (2013), 1066–1085.
Mikki H Phan, Joseph R Keebler, and Barbara S Chaparro. 2016. The development and validation of the game user experience satisfaction scale (GUESS). Human factors 58, 8 (2016), 1217–1247.
Darque Pinto, Bruno Peixoto, Aliane Krassmann, Miguel Melo, Luciana Cabral, and Maximino Bessa. 2019. Virtual Reality in Education: Learning a Foreign Language. In World Conference on Information Systems and Technologies. Springer, 589–597.
Niklas Ravaja, Mikko Salminen, Jussi Holopainen, Timo Saari, Jari Laarni, and Aki Järvinen. 2004. Emotional response patterns and sense of presence during video games: Potential criterion variables for game design. In Proceedings of the third Nordic conference on Human-computer interaction. ACM, 339 347.
Shaghayegh Roohi, Jari Takatalo, J Matias Kivikangas, and Perttu Hämäläinen. 2018. Neural Network Based Facial Expression Analysis of GameEvents: A Cautionary Tale. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. ACM, 429–437.
José Luis González Sánchez, Francisco Luis Gutiérrez Vela, Francisco Montero Simarro, and Natalia Padilla-Zea. 2012. Playability: analysing user experience in video games. Behaviour & Information Technology 31, 10 (2012), 1033–1054.
Nikolaos Savva, Alfonsina Scarinzi, and Nadia Bianchi-Berthouze. 2012. Continuous recognition of player’s affective body expression as dynamic quality of aesthetic experience. IEEE Transactions on Computational Intelligence and AI in games 4, 3 (2012), 199–212.
Jesse Schell. 2014. The Art of Game Design: A book of lenses. AK Peters/CRC Press.
Chen Shu-Hui, Wu Wann-Yih, and Jason Dennison. 2018. Validation of EGameFlow: A Self-Report Scale for Measuring User Experience in Video Game Play. Computers in Entertainment (CIE) 16, 3 (2018), 6.
Judith Sirera and Yujie Yang. [n.d.]. The Interactive Sensual Evaluation Instrument. ([n. d.]).
Jari Takatalo, Jukka Häkkinen, Jyrki Kaistinen, and Göte Nyman. 2010. Presence, involvement, and flow in digital games. In Evaluating user experience in games. Springer, 23–46.
Vero Vanden Abeele, Lennart E Nacke, Elisa D Mekler, and Daniel Johnson. 2016. Design and preliminary validation of the player experience inventory. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. ACM, 335–341.
Arnold POS Vermeeren, Effie Lai-Chong Law, Virpi Roto, Marianna Obrist, Jettie Hoonhout, and Kaisa Väänänen-Vainio-Mattila. 2010. User experience evaluation methods: current state and development needs. In Proceedings of the 6th Nordic conference on human-computer interaction: Extending boundaries. ACM, 521–530.
Jorick Vissers, Lode De Bot, and Bieke Zaman. 2013. MemoLine: evaluating long-term UX with children. In Proceedings of the 12th International Conference on Interaction Design and Children. ACM, 285– 288.
Tanja Walsh, Piia Nurkka, Helen Petrie, and Jaana Olsson. 2013. The effect of language in answering qualitative questions in user experience evaluation web-surveys. In Proceedings of the 25th Australian ComputerHuman Interaction Conference: Augmentation, Application, Innovation, Collaboration. ACM, 73–82.
Tanja Walsh, Piia Nurkka, and Rod Walsh. 2010. Cultural diferences in smartphone user experience evaluation. In Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia. ACM, 24.
Josef Wiemeyer, Lennart Nacke, Christiane Moser, et al. 2016. Player experience. In Serious Games. Springer, 243–271.
Bob G Witmer, Christian J Jerome, and Michael J Singer. 2005. The factor structure of the presence questionnaire. Presence: Teleoperators & Virtual Environments 14, 3 (2005), 298–312.
Claes Wohlin. 2014. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th international conference on evaluation and assessment in software engineering. Citeseer, 38.
Publicado
30/09/2019
Como Citar
BORGES, Bosco; SIDARTA, Izac; DE SOUZA, Antonio Marcos; COELHO, Bianca; DARIN, Ticianne.
Experiência do Usuário em Jogos Digitais: Uma Catalogação de Instrumentos de Avaliação. In: WORKSHOP SOBRE INTERAÇÃO E PESQUISA DE USUÁRIOS NO DESENVOLVIMENTO DE JOGOS (WIPLAY), 1. , 2019, Vitória.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2019
.
p. 69-78.
DOI: https://doi.org/10.5753/wiplay.2019.7841.
