Player Experience Evaluation: a Brief Panorama of Instruments and Research Opportunities
DOI:
https://doi.org/10.5753/jis.2020.765Keywords:
User Experience, Player Experience, UX evaluation, Games, Evaluation methodsAbstract
The influences, metrics, and applications of User Experience (UX) have been investigated in various contexts and is acknowledged as a driving force to promote game development choices. Recently, there has been a growing interest and need to explore the experience in the context of digital games, which require particular forms ofPlayer Experience (PX) components due to their interaction. These particularities of digital games bring some specific models, characteristics and evaluation methods based on this field. Therefore, both industry professionals and researchers must make informed choices when planning these assessments. This research aims to provide a brief panorama on how PX have been evaluated, and discuss its related concepts, based on the analysis 58 PX evaluation instruments. The data analysis provides a glance on the directions the research on PX evaluation is taking and indicates future research opportunities.
Downloads
Download data is not yet available.
References
Abeele, V. V., Spiel, K., Nacke, L., Johnson, D., and Gerling, K. (2020). Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of HumanComputer Studies, 135:102370.
Ayzenberg, Y., Hernandez Rivera, J., and Picard, R. (2012). Feel: frequent eda and event logging-a mobile social interaction stress monitoring system. In CHI’12 extended abstracts on human factors in computing systems, pages 2357–2362.
Barendregt, W. (2006). Evaluating fun and usability in computer games with children. Dissertation Abstracts International, 68(01).
Bernhaupt, R. (2015). User experience evaluation methods in the games development life cycle. In Game user experience evaluation, pages 1–8. Springer.
Regina Bernhaupt, Katherine Isbister & Sara de Freitas (2015) Introduction to this Special Issue on HCI and Games, Human–Computer Interaction, 30:3-4, 195-201, DOI: 10.1080/07370024.2015.1016573
Boberg, M., Karapanos, E., Holopainen, J., and Lucero, A.(2015). Plexq: Towards a playful experiences questionnaire. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, pages 381–391.
Borges, B., Sidarta, I., de Souza, A. M., Coelho, B., and Darin, T. (2019). Experiência do usuário em jogos digitais: Uma catalogação de instrumentos de avaliação. In Anais do I Workshop sobre Interação e Pesquisa de Usuários no Desenvolvimento de Jogos, pages 69–78. SBC.
Brathwaite, B. and Schreiber, I. (2008). Challenges for game designers. 2008. Challenges for game designers (1sted.). Rockland, MA: Charles River Media. Rockland, MA: Charles River Media.
Brockmyer, J. H., Fox, C. M., Curtiss, K. A., McBroom, E.,Burkhart, K. M., and Pidruzny, J. N. (2009). The development of the game engagement questionnaire: A measure of engagement in video gameplaying. Journal of Experimental Social Psychology, 45(4):624–634.
CalvilloGámez, E.H., Cairns,P.,and Cox,A.L.(2015). Assessing the core elements of the gaming experience. In Game user experience evaluation, pages 37–62. Springer.
Carneiro, N., Darin, T., and Viana, W. (2019). What are we talking about when we talk about locationbased games evaluation? A systematic mapping study. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, IHC ’19, Vitória, Espírito Santo, Brazil. Association for Computing Machinery.
Carter, M., Downs, J., Nansen, B., Harrop, M., and Gibbs,M. (2014). Paradigms of games research in hci: a review of 10 years of research at chi. In Proceedings of the first ACM SIGCHI annual symposium on Computerhuman interaction in play, pages 27–36.
Cheng, M.T., She, H.C., and Annetta, L. A. (2015). Game immersion experience: its hierarchical structure and impact on game based science learning. Journal of Computer Assisted Learning, 31(3):232–253.
Coelho, L. P. and de Mesquita, D. P. C. (2013). Língua, cultura e identidade: conceitos intrínsecos e interdependentes. EntreLetras, 4(1).
Costanti, G. (2018). Descolada de gigantes do setor, produção de indie games cresce no país.
Darin, T., Coelho, B., and Borges, B. (2019). Which instrument should i use? Supporting decision making aboutthe evaluation of user experience. In International Conference on HumanComputer Interaction, pages 49–67. Springer.
DeAnda, M. A. and Kocurek, C. A. (2016). Game design as technical communication: Articulating game design through textbooks. Technical Communication Quarterly, 25(3):202–210.
Denisova, A., Nordin, A. I., and Cairns, P. (2016). The convergence of player experience questionnaires. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play, pages 33–37.
Desmet, P. (2003). Measuring emotion: Developmentand application of an instrument to measure emotional responses to products. In Funology, pages 111–123.Springer.
Drachen, A., Nacke, L. E., Yannakakis, G., and Pedersen, A. L. (2010). Correlation between heart rate, electrodermal activity and player experience in firstperson shooter games. InProceedings of the 5th ACM SIGGRAPH Symposium on Video Games, pages 49–54
Ermi, L. and Mäyrä, F. (2005). Fundamental components of the gameplay experience: Analysing immersion. Worldsinplay: International perspectives on digital games research, 37(2):37–53.
Finstad,K.(2006).The system usability scale and nonnative english speakers. Journal of usability studies, 1(4):185–188.
Fitzgerald, A., Huang, S., Sposato, K., Wang, D., Claypool, M., and Agu, E. (2020). The exergame enjoyment questionnaire (eeq): An instrument for measuring exergame enjoyment. InProceedings of the 53rd Hawaii InternationalConference on System Sciences.
Fu, F.L., Su, R.C., and Yu, S.C. (2009). Egameflow: A scale to measure learners’ enjoyment of elearning games. Computers & Education, 52(1):101–112.
Fullerton, T. (2014). Game design workshop: a playcentric approach to creating innovative games. CRC press.
Granato, M., Gadia, D., Maggiorini, D.,and Ripamonti, L.A.(2018). Software and hardware setup for emotion recognition during video game fruition. In Proceedings of the 4th EAI International Conference on Smart Objects and Technologies for Social Good, pages 19–24.
Hassenzahl, M. and Tractinsky, N. (2006). User experience: a research agenda. Behaviour & information technology,25(2):91–97.
Högberg, J., Hamari, J., and Wästlund, E. (2019). Gameful experience questionnaire (gamefulquest): an instrument for measuring the perceived gamefulness of system use. User Modeling and UserAdapted Interaction, 29(3):619–660
IJsselsteijn, W., Poels, K., and De Kort, Y. A. (2008). The game experience questionnaire: Development of a selfreport measure to assess player experiences of digital games. TU Eindhoven, Eindhoven, The Netherlands, page 42.
International Organization for Standardization.(2018). Ergonomics of human-system interaction – Part 11: Usability: Definitions and concepts(ISO Standard No.9241-11:2018). Available at https://www.iso.org/standard/63500.html
Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., and Walton, A. (2008). Measuring and defining the experience of immersion in games. International journal of humancomputer studies, 66(9):641–661
Komulainen, J., Takatalo, J., Lehtonen, M., and Nyman, G.(2008). Psychologically structured approach to user experience in games. In Proceedings of the 5th Nordic conference on Humancomputer interaction: building bridges,pages 487–490.
Lai, Y.C., Wang, S.T., and Yang, J.C. (2012). An investigation of the exergames experience with flow state, enjoyment, and physical fitness. In 2012 IEEE 12th International Conference on Advanced Learning Technologies, pages 58–60. IEEE.
Law, E. L.C., Roto, V., Hassenzahl, M., Vermeeren, A. P., and Kort, J. (2009). Understanding, scoping and defining user experience: a survey approach. In Proceedings of the SIGCHI conference on human factors in computing systems, pages 719–728.
Lazar, J., Feng, J. H., and Hochheiser, H. (2017).Research methods in humancomputer interaction. Morgan Kaufmann.
Lazzaro, M. (2008a). Game usability: advice from the experts for advancing the player experience. Morgan Kaufmann, pages 315–345.
Lazzaro, N. (2008b). The four fun keys. game usability: Advancing the player experience (K. Isbister and N. Schaffer, eds.). 1st edition. CRC Press. ISBN 9780123744470
Lin,J.W., Duh, H.B.L., Parker, D.E., AbiRached, H., and Furness, T.A.(2002). Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In Proceedings ieee virtual reality 2002, pages164–171. IEEE.
Malone, T. W. (1982). Heuristics for designing enjoyable user interfaces: Lessons from computer games. In Proceedings of the 1982 conference on Human factors in computing systems, pages 63–68.
Melo, B. and Darin, T. (2019). Scope and definition of user experience in Brazil: a survey to explore community’s perspectives. In Proceedings of the 18th Brazilian Symposiumon Human Factors in Computing Systems, pages 1–11.
Moser, C., Fuchsberger, V., and Tscheligi, M. (2012). Rapid assessment of game experiences in public settings. InProceedings of the 4th International Conference on Fun and Games, pages 73–82.
Nacke, L. and Drachen, A. (2011). Towards a framework of player experience research. In Proceedings of the second international workshop on evaluating player experience in games at FDG, volume 11.
Nacke, L.E., MirzaBabaei, P.,and Drachen, A.(2019). User experience (UX) research in games. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, pages 1–4.
Ozok, A. A. (2009). Survey design and implementation in HCI. HumanComputer Interaction: Development Process,253.
PadillaZea, N., LópezArcos, J.R., Gonzalez Sanchez, J.L., Gutierrez Vela, F. L., and Abad-Arranz, A. (2013). A method to evaluate emotions in educational video games for children. Journal of universal computer science, 19(8): 1066–1085.
Petri, G., von Wangenheim, C.G., and Borgatto, A.F. (2016). Meega+: an evolution of a model for the evaluation of educational games. INCoD/GQS, 3.
Poels, K., De Kort, Y., and Ijsselsteijn, W. (2007a). "It is always a lot of fun!” exploring dimensions of digital game experience using focus group methodology. In Proceedings of the 2007 conference on Future Play, pages 83–89
Poels, K., DeKort, Y., and IJsselsteijn,W. (2012). Identification and categorization of digital game experiences:a qualitative study integrating. Westminster Papers in Communication and Culture. Harrow, 2004, currens, 9(1):107–129.
Poels, K., de Kort, Y. A., and IJsselsteijn, W. A. (2007b). D3.3: Game experience questionnaire: development of a selfreport measure to assess the psychological impact of digital games.
Qin,H., Patrick Rau, P.L., and Salvendy, G.(2009). Measuring player immersion in the computer game narrative. Intl. Journal of Human–Computer Interaction, 25(2):107–133.
Ravaja, N., Salminen, M., Holopainen, J., Saari, T., Laarni,J., and Järvinen, A. (2004). Emotional response patternsand sense of presence during video games: Potential criterion variables for game design. In Proceedings of the third Nordic conference on Humancomputer interaction,pages 339–347.
Sánchez, J. L. G., Vela, F. L. G., Simarro, F. M., and PadillaZea, N. (2012). Playability: analysing user experience in video games. Behaviour & Information Technology,31(10):1033–1054.
Savi, R.,von Wangenheim, C.G., and Borgatto, A.F.(2011).A model for the evaluation of educational games for teaching software engineering. In2011 25th Brazilian Symposium on Software Engineering, pages 194–203. IEEE.
Schell,J.(2014).The Art of Game Design: A Book of Lenses. CRC Press.
Schubert, T.,Friedmann, F.,and Regenbrecht, H. (2001).The experience of presence: Factor analytic insights. Presence: Teleoperators & Virtual Environments, 10(3):266–281.
Seif ElNasr, M., Desurvire, H., Nacke, L., Drachen, A.,Calvi, L., Isbister, K., and Bernhaupt, R. (2012). Game user research. In CHI ’12 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’12, page 2679–2682, New York, NY, USA. Association for ComputingMachinery.
Sherry, J. L., Lucas, K., Greenberg, B. S., and Lachlan, K.(2006). Video game uses and gratifications as predictor of use and game preference. Playing video games: Motives, responses, and consequences, 24(1):213–224
Sweetser, P. and Wyeth, P. (2005). Gameflow: a model for evaluating player enjoyment in games.Computers in Entertainment (CIE), 3(3):3–3.
Takatalo, J., Häkkinen, J., Kaistinen, J., and Nyman, G.(2010). Presence, involvement, and flow in digital games. In Evaluating user experience in games, pages 23–46.Springer.
Van de Vijver, F. and Leung, K. (2001). Personality in cultural context: Methodological issues. Journal of personality, 69(6):1007–1031.
VanEeden,E.v.and Chow,W.(2019). Global entertainment & media outlook 2019–2023. pwc.
VasconcelosRaposo, J., Bessa, M., Melo, M., Barbosa, L.,Rodrigues, R.,Teixeira, C.M.,Cabral,L., and Sousa, A.A.(2016). Adaptation and validation of the igroup presence questionnaire (ipq) in aportuguese sample. Presence: Teleoperators and virtual environments, 25(3):191–203.
Vissers, J., De Bot, L., and Zaman, B. (2013). Memoline:evaluating longterm ux with children. InProceedings ofthe 12th International Conference on Interaction Design and Children, pages 285–288.
Walsh, T., Nurkka, P., Petrie, H., and Olsson, J. (2013). The effect of language in answering qualitative questions in user experience evaluation websurveys. In Proceedings of the 25th Australian ComputerHuman Interaction Conference: Augmentation, Application, Innovation, Collaboration, pages 73–82.
Walsh, T., Nurkka, P., and Walsh, R. (2010). Cultural differences in smartphone user experience evaluation. In Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia, pages 1–9.
Wiemeyer, J., Nacke, L., Moser, C., et al. (2016). Player experience. InSerious Games, pages 243–271. Springer.
Witmer, B. G., Jerome, C. J., and Singer, M. J. (2005). The factor structure of the presence questionnaire. Presence: Teleoperators & Virtual Environments, 14(3):298–312.
Witmer, B. G. and Singer, M. J. (1998). Measuring presencein virtual environments: A presence questionnaire. Presence, 7(3):225–240.
Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering. InProceedings of the 18th international conference on evaluation and assessment in software engineering, pages 1–10.
Ayzenberg, Y., Hernandez Rivera, J., and Picard, R. (2012). Feel: frequent eda and event logging-a mobile social interaction stress monitoring system. In CHI’12 extended abstracts on human factors in computing systems, pages 2357–2362.
Barendregt, W. (2006). Evaluating fun and usability in computer games with children. Dissertation Abstracts International, 68(01).
Bernhaupt, R. (2015). User experience evaluation methods in the games development life cycle. In Game user experience evaluation, pages 1–8. Springer.
Regina Bernhaupt, Katherine Isbister & Sara de Freitas (2015) Introduction to this Special Issue on HCI and Games, Human–Computer Interaction, 30:3-4, 195-201, DOI: 10.1080/07370024.2015.1016573
Boberg, M., Karapanos, E., Holopainen, J., and Lucero, A.(2015). Plexq: Towards a playful experiences questionnaire. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, pages 381–391.
Borges, B., Sidarta, I., de Souza, A. M., Coelho, B., and Darin, T. (2019). Experiência do usuário em jogos digitais: Uma catalogação de instrumentos de avaliação. In Anais do I Workshop sobre Interação e Pesquisa de Usuários no Desenvolvimento de Jogos, pages 69–78. SBC.
Brathwaite, B. and Schreiber, I. (2008). Challenges for game designers. 2008. Challenges for game designers (1sted.). Rockland, MA: Charles River Media. Rockland, MA: Charles River Media.
Brockmyer, J. H., Fox, C. M., Curtiss, K. A., McBroom, E.,Burkhart, K. M., and Pidruzny, J. N. (2009). The development of the game engagement questionnaire: A measure of engagement in video gameplaying. Journal of Experimental Social Psychology, 45(4):624–634.
CalvilloGámez, E.H., Cairns,P.,and Cox,A.L.(2015). Assessing the core elements of the gaming experience. In Game user experience evaluation, pages 37–62. Springer.
Carneiro, N., Darin, T., and Viana, W. (2019). What are we talking about when we talk about locationbased games evaluation? A systematic mapping study. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, IHC ’19, Vitória, Espírito Santo, Brazil. Association for Computing Machinery.
Carter, M., Downs, J., Nansen, B., Harrop, M., and Gibbs,M. (2014). Paradigms of games research in hci: a review of 10 years of research at chi. In Proceedings of the first ACM SIGCHI annual symposium on Computerhuman interaction in play, pages 27–36.
Cheng, M.T., She, H.C., and Annetta, L. A. (2015). Game immersion experience: its hierarchical structure and impact on game based science learning. Journal of Computer Assisted Learning, 31(3):232–253.
Coelho, L. P. and de Mesquita, D. P. C. (2013). Língua, cultura e identidade: conceitos intrínsecos e interdependentes. EntreLetras, 4(1).
Costanti, G. (2018). Descolada de gigantes do setor, produção de indie games cresce no país.
Darin, T., Coelho, B., and Borges, B. (2019). Which instrument should i use? Supporting decision making aboutthe evaluation of user experience. In International Conference on HumanComputer Interaction, pages 49–67. Springer.
DeAnda, M. A. and Kocurek, C. A. (2016). Game design as technical communication: Articulating game design through textbooks. Technical Communication Quarterly, 25(3):202–210.
Denisova, A., Nordin, A. I., and Cairns, P. (2016). The convergence of player experience questionnaires. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play, pages 33–37.
Desmet, P. (2003). Measuring emotion: Developmentand application of an instrument to measure emotional responses to products. In Funology, pages 111–123.Springer.
Drachen, A., Nacke, L. E., Yannakakis, G., and Pedersen, A. L. (2010). Correlation between heart rate, electrodermal activity and player experience in firstperson shooter games. InProceedings of the 5th ACM SIGGRAPH Symposium on Video Games, pages 49–54
Ermi, L. and Mäyrä, F. (2005). Fundamental components of the gameplay experience: Analysing immersion. Worldsinplay: International perspectives on digital games research, 37(2):37–53.
Finstad,K.(2006).The system usability scale and nonnative english speakers. Journal of usability studies, 1(4):185–188.
Fitzgerald, A., Huang, S., Sposato, K., Wang, D., Claypool, M., and Agu, E. (2020). The exergame enjoyment questionnaire (eeq): An instrument for measuring exergame enjoyment. InProceedings of the 53rd Hawaii InternationalConference on System Sciences.
Fu, F.L., Su, R.C., and Yu, S.C. (2009). Egameflow: A scale to measure learners’ enjoyment of elearning games. Computers & Education, 52(1):101–112.
Fullerton, T. (2014). Game design workshop: a playcentric approach to creating innovative games. CRC press.
Granato, M., Gadia, D., Maggiorini, D.,and Ripamonti, L.A.(2018). Software and hardware setup for emotion recognition during video game fruition. In Proceedings of the 4th EAI International Conference on Smart Objects and Technologies for Social Good, pages 19–24.
Hassenzahl, M. and Tractinsky, N. (2006). User experience: a research agenda. Behaviour & information technology,25(2):91–97.
Högberg, J., Hamari, J., and Wästlund, E. (2019). Gameful experience questionnaire (gamefulquest): an instrument for measuring the perceived gamefulness of system use. User Modeling and UserAdapted Interaction, 29(3):619–660
IJsselsteijn, W., Poels, K., and De Kort, Y. A. (2008). The game experience questionnaire: Development of a selfreport measure to assess player experiences of digital games. TU Eindhoven, Eindhoven, The Netherlands, page 42.
International Organization for Standardization.(2018). Ergonomics of human-system interaction – Part 11: Usability: Definitions and concepts(ISO Standard No.9241-11:2018). Available at https://www.iso.org/standard/63500.html
Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., and Walton, A. (2008). Measuring and defining the experience of immersion in games. International journal of humancomputer studies, 66(9):641–661
Komulainen, J., Takatalo, J., Lehtonen, M., and Nyman, G.(2008). Psychologically structured approach to user experience in games. In Proceedings of the 5th Nordic conference on Humancomputer interaction: building bridges,pages 487–490.
Lai, Y.C., Wang, S.T., and Yang, J.C. (2012). An investigation of the exergames experience with flow state, enjoyment, and physical fitness. In 2012 IEEE 12th International Conference on Advanced Learning Technologies, pages 58–60. IEEE.
Law, E. L.C., Roto, V., Hassenzahl, M., Vermeeren, A. P., and Kort, J. (2009). Understanding, scoping and defining user experience: a survey approach. In Proceedings of the SIGCHI conference on human factors in computing systems, pages 719–728.
Lazar, J., Feng, J. H., and Hochheiser, H. (2017).Research methods in humancomputer interaction. Morgan Kaufmann.
Lazzaro, M. (2008a). Game usability: advice from the experts for advancing the player experience. Morgan Kaufmann, pages 315–345.
Lazzaro, N. (2008b). The four fun keys. game usability: Advancing the player experience (K. Isbister and N. Schaffer, eds.). 1st edition. CRC Press. ISBN 9780123744470
Lin,J.W., Duh, H.B.L., Parker, D.E., AbiRached, H., and Furness, T.A.(2002). Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In Proceedings ieee virtual reality 2002, pages164–171. IEEE.
Malone, T. W. (1982). Heuristics for designing enjoyable user interfaces: Lessons from computer games. In Proceedings of the 1982 conference on Human factors in computing systems, pages 63–68.
Melo, B. and Darin, T. (2019). Scope and definition of user experience in Brazil: a survey to explore community’s perspectives. In Proceedings of the 18th Brazilian Symposiumon Human Factors in Computing Systems, pages 1–11.
Moser, C., Fuchsberger, V., and Tscheligi, M. (2012). Rapid assessment of game experiences in public settings. InProceedings of the 4th International Conference on Fun and Games, pages 73–82.
Nacke, L. and Drachen, A. (2011). Towards a framework of player experience research. In Proceedings of the second international workshop on evaluating player experience in games at FDG, volume 11.
Nacke, L.E., MirzaBabaei, P.,and Drachen, A.(2019). User experience (UX) research in games. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, pages 1–4.
Ozok, A. A. (2009). Survey design and implementation in HCI. HumanComputer Interaction: Development Process,253.
PadillaZea, N., LópezArcos, J.R., Gonzalez Sanchez, J.L., Gutierrez Vela, F. L., and Abad-Arranz, A. (2013). A method to evaluate emotions in educational video games for children. Journal of universal computer science, 19(8): 1066–1085.
Petri, G., von Wangenheim, C.G., and Borgatto, A.F. (2016). Meega+: an evolution of a model for the evaluation of educational games. INCoD/GQS, 3.
Poels, K., De Kort, Y., and Ijsselsteijn, W. (2007a). "It is always a lot of fun!” exploring dimensions of digital game experience using focus group methodology. In Proceedings of the 2007 conference on Future Play, pages 83–89
Poels, K., DeKort, Y., and IJsselsteijn,W. (2012). Identification and categorization of digital game experiences:a qualitative study integrating. Westminster Papers in Communication and Culture. Harrow, 2004, currens, 9(1):107–129.
Poels, K., de Kort, Y. A., and IJsselsteijn, W. A. (2007b). D3.3: Game experience questionnaire: development of a selfreport measure to assess the psychological impact of digital games.
Qin,H., Patrick Rau, P.L., and Salvendy, G.(2009). Measuring player immersion in the computer game narrative. Intl. Journal of Human–Computer Interaction, 25(2):107–133.
Ravaja, N., Salminen, M., Holopainen, J., Saari, T., Laarni,J., and Järvinen, A. (2004). Emotional response patternsand sense of presence during video games: Potential criterion variables for game design. In Proceedings of the third Nordic conference on Humancomputer interaction,pages 339–347.
Sánchez, J. L. G., Vela, F. L. G., Simarro, F. M., and PadillaZea, N. (2012). Playability: analysing user experience in video games. Behaviour & Information Technology,31(10):1033–1054.
Savi, R.,von Wangenheim, C.G., and Borgatto, A.F.(2011).A model for the evaluation of educational games for teaching software engineering. In2011 25th Brazilian Symposium on Software Engineering, pages 194–203. IEEE.
Schell,J.(2014).The Art of Game Design: A Book of Lenses. CRC Press.
Schubert, T.,Friedmann, F.,and Regenbrecht, H. (2001).The experience of presence: Factor analytic insights. Presence: Teleoperators & Virtual Environments, 10(3):266–281.
Seif ElNasr, M., Desurvire, H., Nacke, L., Drachen, A.,Calvi, L., Isbister, K., and Bernhaupt, R. (2012). Game user research. In CHI ’12 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’12, page 2679–2682, New York, NY, USA. Association for ComputingMachinery.
Sherry, J. L., Lucas, K., Greenberg, B. S., and Lachlan, K.(2006). Video game uses and gratifications as predictor of use and game preference. Playing video games: Motives, responses, and consequences, 24(1):213–224
Sweetser, P. and Wyeth, P. (2005). Gameflow: a model for evaluating player enjoyment in games.Computers in Entertainment (CIE), 3(3):3–3.
Takatalo, J., Häkkinen, J., Kaistinen, J., and Nyman, G.(2010). Presence, involvement, and flow in digital games. In Evaluating user experience in games, pages 23–46.Springer.
Van de Vijver, F. and Leung, K. (2001). Personality in cultural context: Methodological issues. Journal of personality, 69(6):1007–1031.
VanEeden,E.v.and Chow,W.(2019). Global entertainment & media outlook 2019–2023. pwc.
VasconcelosRaposo, J., Bessa, M., Melo, M., Barbosa, L.,Rodrigues, R.,Teixeira, C.M.,Cabral,L., and Sousa, A.A.(2016). Adaptation and validation of the igroup presence questionnaire (ipq) in aportuguese sample. Presence: Teleoperators and virtual environments, 25(3):191–203.
Vissers, J., De Bot, L., and Zaman, B. (2013). Memoline:evaluating longterm ux with children. InProceedings ofthe 12th International Conference on Interaction Design and Children, pages 285–288.
Walsh, T., Nurkka, P., Petrie, H., and Olsson, J. (2013). The effect of language in answering qualitative questions in user experience evaluation websurveys. In Proceedings of the 25th Australian ComputerHuman Interaction Conference: Augmentation, Application, Innovation, Collaboration, pages 73–82.
Walsh, T., Nurkka, P., and Walsh, R. (2010). Cultural differences in smartphone user experience evaluation. In Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia, pages 1–9.
Wiemeyer, J., Nacke, L., Moser, C., et al. (2016). Player experience. InSerious Games, pages 243–271. Springer.
Witmer, B. G., Jerome, C. J., and Singer, M. J. (2005). The factor structure of the presence questionnaire. Presence: Teleoperators & Virtual Environments, 14(3):298–312.
Witmer, B. G. and Singer, M. J. (1998). Measuring presencein virtual environments: A presence questionnaire. Presence, 7(3):225–240.
Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering. InProceedings of the 18th international conference on evaluation and assessment in software engineering, pages 1–10.
Downloads
Published
2020-12-09
How to Cite
BORGES, J. B.; JUY, C. L.; DE ANDRADE MATOS, I. S.; ANGELO SILVEIRA, P. V.; DARIN, T. de G. R. Player Experience Evaluation: a Brief Panorama of Instruments and Research Opportunities. Journal on Interactive Systems, Porto Alegre, RS, v. 11, n. 1, p. 74–91, 2020. DOI: 10.5753/jis.2020.765. Disponível em: https://sol.sbc.org.br/journals/index.php/jis/article/view/765. Acesso em: 2 may. 2024.
Issue
Section
Regular Paper
License
Copyright (c) 2020 João Bosco Borges Aragão Filho, Carmen Li Juy, Izac Sidarta de Andrade Matos, Paulo Vitor Angelo Silveira, Ticianne de Gois Ribeiro Darin
This work is licensed under a Creative Commons Attribution 4.0 International License.
JIS is free of charge for authors and readers, and all papers published by JIS follow the Creative Commons Attribution 4.0 International (CC BY 4.0) license.
