Uso de Entrevistas na Avaliação de Jogos Baseados em Localização: Lições e Desafios
Resumo
Games User Research (GUR) é um campo de estudo que tem buscado formar um conjunto de técnicas para avaliar a interação dos jogadores em diversos tipos de jogos. Buscando somar esforços aos avanços nessa área, este trabalho foca na avaliação da interação com jogos baseados em localização (JBL), buscando compreender quais aspectos da \textit{player experience} em JBL podem ser explorados por meio de entrevistas e como isso tem sido feito pelas comunidades de prática e pesquisa. Para isso, foram analisados trabalhos que aplicaram o método em tal contexto e conduzido um \textit{survey} de opinião com os respectivos autores. Como resultado, são apresentadas desafios de pesquisa e lições para o uso de entrevistas nesse tipo de avaliação, visando incentivar sua aplicação consciente e sistematizada, além de prover auxílio a praticantes e pesquisadores, especialmente iniciantes.
Palavras-chave:
Jogos baseados em localização, Métodos de avaliação, Interação, Entrevistas
Referências
Ola Ahlqvist. 2018. Location-Based Games. International Encyclopedia of Geography: People, the Earth, Environment and Technology (2018), 1–6.
Lynne Baillie, Lee Morton, Stephen Uzor, and David C Moffatt. 2010. An investigation of user responses to specifically designed activities in a multimodal location based game. Journal on Multimodal User Interfaces 3, 3 (2010), 179–188.
Rafael Ballagas, André Kuntze, and Steffen P Walz. 2008. Gaming tourism: Lessons from evaluating rexplorer, a pervasive game for tourists. In International Conference on Pervasive Computing. Springer, 244–261.
Steve Benford, Andy Crabtree, Martin Flintham, Adam Drozd, Rob Anastasi, Mark Paxton, Nick Tandavanitj, Matt Adams, and Ju Row-Farr. 2006. Can you see me now? ACM Transactions on Computer-Human Interaction (TOCHI) 13, 1 (2006), 100–133.
Ann Blandford, Dominic Furniss, and Stephann Makri. 2016. Qualitative HCI Research: Going Behind the Scenes. Morgan & Claypool Publishers.
Lisa Blum, RichardWetzel, Rod McCall, Leif Oppermann, and Wolfgang Broll. 2012. The final TimeWarp: using form and content to support player experience and presence when designing location-aware mobile augmented reality games. In Proceedings of the designing interactive systems conference. ACM, 711–720.
Carolyn Boyce and Palena Neale. 2006. Conducting in-depth interviews: A guide for designing and conducting in-depth interviews for evaluation input. (2006).
Eduardo Calvillo-Gámez, Jodi Crisp, and Pablo Romero. 2011. Empirical validation of the involvement component of the pervasive GameFlow model. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology. ACM, 48.
Nayana Carneiro, Ticianne Darin, and Windson Viana. 2019. What Are We Talking About When We Talk About Location-Based Games Evaluation? A Systematic Mapping Study. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. ACM, 13.
Thomas Chatzidimitris, Damianos Gavalas, and Despina Michael. 2016. SoundPacman: Audio augmented reality in location-based games. In 18th Mediterranean Electrotechnical Conference (MELECON). IEEE, 1–6.
Wilson Chauncey. 2014. Interview Techniques for UX Practitioners. A User-Centered Design Method (2014).
Luca Chittaro and Riccardo Sioni. 2012. Turning the classic snake mobile game into a location–based exergame that encourages walking. In International Conference on Persuasive Technology. Springer, 43–54.
Scott B Crawford, Stormy M Monks, and Radosveta N Wells. 2018. Virtual reality as an interview technique in evaluation of emergency medicine applicants. AEM education and training 2, 4 (2018), 328–333.
John W Creswell and Cheryl N Poth. 2018. Qualitative inquiry and research design: Choosing among five approaches. Sage publications.
Ticianne Darin, Rossana Andrade, and Jaime Sánchez. 2019. Principles for Evaluating Usability in Multimodal Games for People Who Are Blind. In International Conference on Human-Computer Interaction. Springer, 209–223.
Adriana De Souza e Silva and DanielMSutko. 2011. Theorizing locative technologies through philosophies of the virtual. Communication Theory 21, 1 (2011), 23–42.
Katerina Diamantaki, Charalampos Rizopoulos, Dimitris Charitos, and Nikos Tsianos. 2011. Theoretical and methodological implications of designing and implementing multiuser location-based games. Personal and Ubiquitous Computing 15, 1 (2011), 37–49.
Anders Drachen, Pejman Mirza-Babaei, and Lennart E Nacke. 2018. Games user research. Oxford University Press.
Inger Ekman. 2007. Sound-based gaming for sighted audiences–experiences from a mobile multiplayer location aware game. In Proceedings of the 2nd audio mostly conference. 148–153.
Magy Seif El-Nasr, Shree Durga, Mariya Shiyko, and Carmen Sceppa. 2015. Data-driven retrospective interviewing (DDRI): a proposed methodology for formative evaluation of pervasive games. Entertainment Computing 11 (2015), 1–19.
Marsha E Fonteyn, Benjamin Kuipers, and Susan J Grobe. 1993. A description of think aloud method and protocol analysis. Qualitative health research 3, 4 (1993), 430–441.
Sarah Holmes. 2019. Play-based 7 interview techniques with young children. Using Innovative Methods in Early Years Research: Beyond the Conventional (2019), 92.
Katherine Isbister and Noah Schaffer. 2008. Game usability: Advancing the player experience. CRC press.
Vlasios Kasapakis and Damianos Gavalas. 2015. Pervasive gaming: Status, trends and design principles. Journal of Network and Computer Applications 55 (2015), 213–236.
Vlasios Kasapakis and Damianos Gavalas. 2017. User-Generated Content in Pervasive Games. Computers in Entertainment (CIE) 16, 1 (2017), 3.
Peter Kiefer, Sebastian Matyas, and Christoph Schlieder. 2006. Systematically exploring the design space of location-based games. In 4th International Conference on Pervasive Computing. 183–190.
Barbara A Kitchenham, David Budgen, and O Pearl Brereton. 2010. The value of mapping studies-A participant-observer case study.. In EASE, Vol. 10. 25–33.
Jason Kurczak, TC Graham, Claire Joly, and Regan L Mandryk. 2011. Hearing is believing: evaluating ambient audio for location-based games. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology. ACM, 32.
Steinar Kvale. 2008. Doing interviews. Sage.
Michèle Lamont and Ann Swidler. 2014. Methodological pluralism and the possibilities and limits of interviewing. Qualitative Sociology 37, 2 (2014), 153–171.
Michael Lankes and Barbara Stiglbauer. 2016. GazeAR: Mobile gazebased interaction in the context of augmented reality games. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics. Springer, 397–406.
Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann.
Irma Lindt, JAN Ohlenburg, Uta Pankoke-Babatz, and Sabiha Ghellal. 2007. A report on the crossmedia game epidemic menace. Computers in Entertainment (CIE) 5, 1 (2007), 8.
Conor Linehan, Nick Bull, and Ben Kirman. 2013. BOLLOCKS!! Designing pervasive games that play with the social rules of built environments. In International Conference on Advances in Computer Entertainment Technology. Springer, 123–137.
Roderick McCall and Anne-Kathrine Braun. 2008. Experiences of evaluating presence in augmented realities. Psychnology 6, 2 (2008), 157–163.
Rod McCall, Richard Wetzel, Johannes Löschner, and Anne-Kathrin Braun. 2011. Using presence to evaluate an augmented reality location aware game. Personal and Ubiquitous Computing 15, 1 (2011), 25–35.
Timothy Merritt, Christine Linding Nielsen, Frederik Lund Jakobsen, and Jens Emil Grønbæk. 2017. Glowphones: designing for proxemics play with low-resolution displays in location-based games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. ACM, 69–81.
Michael D. Myers and Michael Newman. 2007. The qualitative interview in IS research: Examining the craft. Information and organization 17, 1 (2007), 2–26.
Lennart E Nacke, Christiane Moser, Anders Drachen, Pejman Mirza-Babaei, Andrea Abney, and Zhu Cole Zhenyu. 2016. Lightweight
Games User Research for Indies and Non-Profit Organizations. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 3597–3603.
Tommy Nilsson, Carl Hogsden, Charith Perera, Saeed Aghaee, David J. Scruton, Andreas Lund, and Alan F Blackwell. 2016. Applying seamful design in location-based mobile museum applications. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 12, 4 (2016), 56.
Leif Oppermann, Steffen Schaal, Manuela Eisenhardt, Constantin Brosda, Heike Müller, and Silke Bartsch. 2017. Move, Interact, Learn, Eat–A Toolbox for Educational Location-Based Games. In International Conference on Advances in Computer Entertainment. Springer, 774–794.
A Ant Ozok. 2009. Survey design and implementation in HCI. Human-Computer Interaction: Development Process 253 (2009).
Janne Paavilainen, Hannu Korhonen, Kati Alha, Jaakko Stenros, Elina Koskinen, and Frans Mayra. 2017. The Pokémon GO experience: A location-based augmented reality mobile game goes mainstream. In Proceedings of the 2017 CHI conference on human factors in computing systems. ACM, 2493–2498.
Yen Lina Prasetio, Rendy Wijaya, Michael Pratama Sjah, Michael Ryan Christian, and Andry Chowanda. 2017. Location-based game to enhance player’s experience in survival horror game. Procedia computer science 116 (2017), 206–213.
Aung Pyae, Luimula Mika, and Jouni Smed. 2017. Understanding Players’ Experiences in Location-based Augmented Reality Mobile Games: A Case of Pokémon Go. In Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play. ACM, 535–541.
Albert Quek and John See. 2015. Obscura: A mobile game with camera based mechanics. In 2015 Game Physics and Mechanics International Conference (GAMEPEC). IEEE, 21–25.
Yvonne Rogers, Helen Sharp, and Jennifer Preece. 2013. Design de Interação. Bookman Editora.
Gene Rowe and George Wright. 2001. Expert opinions in forecasting: the role of the Delphi technique. In Principles of forecasting. Springer, 125–144.
Jennifer Rowley. 2012. Conducting research interviews. Management research review 35, 3/4 (2012), 260–271.
José Luis González Sánchez, Francisco Luis Gutiérrez Vela, Francisco Montero Simarro, and Natalia Padilla-Zea. 2012. Playability: Analysing user experience in video games. Behaviour & Information Technology 31, 10 (2012), 1033–1054.
Alex Sandham, Tom Ormerod, Coral Dando, Ray Bull, Mike Jackson, and James Goulding. 2011. Scent trails: Countering terrorism through informed surveillance. In International Conference on Engineering Psychology and Cognitive Ergonomics. Springer, 452–460.
Jesse Schell. 2014. The Art of Game Design: A book of lenses. AK Peters/CRC Press.
Ben Shneiderman, Catherine Plaisant, Maxine Cohen, Steven Jacobs, Niklas Elmqvist, and Nicholas Diakopoulos. 2016. Designing the user interface: strategies for effective human-computer interaction. Pearson.
Misha Sra and Chris Schmandt. 2015. Expanding social mobile games beyond the device screen. Personal and Ubiquitous Computing 19, 3-4 (2015), 495–508.
Daniel W Turner III. 2010. Qualitative interview design: A practical guide for novice investigators. The qualitative report 15, 3 (2010), 754–760.
Adrián Juan Verdejo, Katrien De Moor, Istvan Ketyko, Karen Torben Nielsen, Jeroen Vanattenhoven, Toon De Pessemier, Wout Joseph, Luc Martens, and Lieven De Marez. 2010. QoE estimation of a location-based mobile game using on-body sensors and QoS-related data. In 2010 IFIP Wireless Days. IEEE, 1–5.
Alf Inge Wang, Stian Forberg, and Jon Kjetil Øye. 2016. Knowledge war-a pervasive multiplayer role-playing learning game. In European Conference on Game Based Learning (ECGBL 2016). ACPI, Glasgow, Scotland.
Lynne Baillie, Lee Morton, Stephen Uzor, and David C Moffatt. 2010. An investigation of user responses to specifically designed activities in a multimodal location based game. Journal on Multimodal User Interfaces 3, 3 (2010), 179–188.
Rafael Ballagas, André Kuntze, and Steffen P Walz. 2008. Gaming tourism: Lessons from evaluating rexplorer, a pervasive game for tourists. In International Conference on Pervasive Computing. Springer, 244–261.
Steve Benford, Andy Crabtree, Martin Flintham, Adam Drozd, Rob Anastasi, Mark Paxton, Nick Tandavanitj, Matt Adams, and Ju Row-Farr. 2006. Can you see me now? ACM Transactions on Computer-Human Interaction (TOCHI) 13, 1 (2006), 100–133.
Ann Blandford, Dominic Furniss, and Stephann Makri. 2016. Qualitative HCI Research: Going Behind the Scenes. Morgan & Claypool Publishers.
Lisa Blum, RichardWetzel, Rod McCall, Leif Oppermann, and Wolfgang Broll. 2012. The final TimeWarp: using form and content to support player experience and presence when designing location-aware mobile augmented reality games. In Proceedings of the designing interactive systems conference. ACM, 711–720.
Carolyn Boyce and Palena Neale. 2006. Conducting in-depth interviews: A guide for designing and conducting in-depth interviews for evaluation input. (2006).
Eduardo Calvillo-Gámez, Jodi Crisp, and Pablo Romero. 2011. Empirical validation of the involvement component of the pervasive GameFlow model. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology. ACM, 48.
Nayana Carneiro, Ticianne Darin, and Windson Viana. 2019. What Are We Talking About When We Talk About Location-Based Games Evaluation? A Systematic Mapping Study. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. ACM, 13.
Thomas Chatzidimitris, Damianos Gavalas, and Despina Michael. 2016. SoundPacman: Audio augmented reality in location-based games. In 18th Mediterranean Electrotechnical Conference (MELECON). IEEE, 1–6.
Wilson Chauncey. 2014. Interview Techniques for UX Practitioners. A User-Centered Design Method (2014).
Luca Chittaro and Riccardo Sioni. 2012. Turning the classic snake mobile game into a location–based exergame that encourages walking. In International Conference on Persuasive Technology. Springer, 43–54.
Scott B Crawford, Stormy M Monks, and Radosveta N Wells. 2018. Virtual reality as an interview technique in evaluation of emergency medicine applicants. AEM education and training 2, 4 (2018), 328–333.
John W Creswell and Cheryl N Poth. 2018. Qualitative inquiry and research design: Choosing among five approaches. Sage publications.
Ticianne Darin, Rossana Andrade, and Jaime Sánchez. 2019. Principles for Evaluating Usability in Multimodal Games for People Who Are Blind. In International Conference on Human-Computer Interaction. Springer, 209–223.
Adriana De Souza e Silva and DanielMSutko. 2011. Theorizing locative technologies through philosophies of the virtual. Communication Theory 21, 1 (2011), 23–42.
Katerina Diamantaki, Charalampos Rizopoulos, Dimitris Charitos, and Nikos Tsianos. 2011. Theoretical and methodological implications of designing and implementing multiuser location-based games. Personal and Ubiquitous Computing 15, 1 (2011), 37–49.
Anders Drachen, Pejman Mirza-Babaei, and Lennart E Nacke. 2018. Games user research. Oxford University Press.
Inger Ekman. 2007. Sound-based gaming for sighted audiences–experiences from a mobile multiplayer location aware game. In Proceedings of the 2nd audio mostly conference. 148–153.
Magy Seif El-Nasr, Shree Durga, Mariya Shiyko, and Carmen Sceppa. 2015. Data-driven retrospective interviewing (DDRI): a proposed methodology for formative evaluation of pervasive games. Entertainment Computing 11 (2015), 1–19.
Marsha E Fonteyn, Benjamin Kuipers, and Susan J Grobe. 1993. A description of think aloud method and protocol analysis. Qualitative health research 3, 4 (1993), 430–441.
Sarah Holmes. 2019. Play-based 7 interview techniques with young children. Using Innovative Methods in Early Years Research: Beyond the Conventional (2019), 92.
Katherine Isbister and Noah Schaffer. 2008. Game usability: Advancing the player experience. CRC press.
Vlasios Kasapakis and Damianos Gavalas. 2015. Pervasive gaming: Status, trends and design principles. Journal of Network and Computer Applications 55 (2015), 213–236.
Vlasios Kasapakis and Damianos Gavalas. 2017. User-Generated Content in Pervasive Games. Computers in Entertainment (CIE) 16, 1 (2017), 3.
Peter Kiefer, Sebastian Matyas, and Christoph Schlieder. 2006. Systematically exploring the design space of location-based games. In 4th International Conference on Pervasive Computing. 183–190.
Barbara A Kitchenham, David Budgen, and O Pearl Brereton. 2010. The value of mapping studies-A participant-observer case study.. In EASE, Vol. 10. 25–33.
Jason Kurczak, TC Graham, Claire Joly, and Regan L Mandryk. 2011. Hearing is believing: evaluating ambient audio for location-based games. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology. ACM, 32.
Steinar Kvale. 2008. Doing interviews. Sage.
Michèle Lamont and Ann Swidler. 2014. Methodological pluralism and the possibilities and limits of interviewing. Qualitative Sociology 37, 2 (2014), 153–171.
Michael Lankes and Barbara Stiglbauer. 2016. GazeAR: Mobile gazebased interaction in the context of augmented reality games. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics. Springer, 397–406.
Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann.
Irma Lindt, JAN Ohlenburg, Uta Pankoke-Babatz, and Sabiha Ghellal. 2007. A report on the crossmedia game epidemic menace. Computers in Entertainment (CIE) 5, 1 (2007), 8.
Conor Linehan, Nick Bull, and Ben Kirman. 2013. BOLLOCKS!! Designing pervasive games that play with the social rules of built environments. In International Conference on Advances in Computer Entertainment Technology. Springer, 123–137.
Roderick McCall and Anne-Kathrine Braun. 2008. Experiences of evaluating presence in augmented realities. Psychnology 6, 2 (2008), 157–163.
Rod McCall, Richard Wetzel, Johannes Löschner, and Anne-Kathrin Braun. 2011. Using presence to evaluate an augmented reality location aware game. Personal and Ubiquitous Computing 15, 1 (2011), 25–35.
Timothy Merritt, Christine Linding Nielsen, Frederik Lund Jakobsen, and Jens Emil Grønbæk. 2017. Glowphones: designing for proxemics play with low-resolution displays in location-based games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. ACM, 69–81.
Michael D. Myers and Michael Newman. 2007. The qualitative interview in IS research: Examining the craft. Information and organization 17, 1 (2007), 2–26.
Lennart E Nacke, Christiane Moser, Anders Drachen, Pejman Mirza-Babaei, Andrea Abney, and Zhu Cole Zhenyu. 2016. Lightweight
Games User Research for Indies and Non-Profit Organizations. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 3597–3603.
Tommy Nilsson, Carl Hogsden, Charith Perera, Saeed Aghaee, David J. Scruton, Andreas Lund, and Alan F Blackwell. 2016. Applying seamful design in location-based mobile museum applications. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 12, 4 (2016), 56.
Leif Oppermann, Steffen Schaal, Manuela Eisenhardt, Constantin Brosda, Heike Müller, and Silke Bartsch. 2017. Move, Interact, Learn, Eat–A Toolbox for Educational Location-Based Games. In International Conference on Advances in Computer Entertainment. Springer, 774–794.
A Ant Ozok. 2009. Survey design and implementation in HCI. Human-Computer Interaction: Development Process 253 (2009).
Janne Paavilainen, Hannu Korhonen, Kati Alha, Jaakko Stenros, Elina Koskinen, and Frans Mayra. 2017. The Pokémon GO experience: A location-based augmented reality mobile game goes mainstream. In Proceedings of the 2017 CHI conference on human factors in computing systems. ACM, 2493–2498.
Yen Lina Prasetio, Rendy Wijaya, Michael Pratama Sjah, Michael Ryan Christian, and Andry Chowanda. 2017. Location-based game to enhance player’s experience in survival horror game. Procedia computer science 116 (2017), 206–213.
Aung Pyae, Luimula Mika, and Jouni Smed. 2017. Understanding Players’ Experiences in Location-based Augmented Reality Mobile Games: A Case of Pokémon Go. In Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play. ACM, 535–541.
Albert Quek and John See. 2015. Obscura: A mobile game with camera based mechanics. In 2015 Game Physics and Mechanics International Conference (GAMEPEC). IEEE, 21–25.
Yvonne Rogers, Helen Sharp, and Jennifer Preece. 2013. Design de Interação. Bookman Editora.
Gene Rowe and George Wright. 2001. Expert opinions in forecasting: the role of the Delphi technique. In Principles of forecasting. Springer, 125–144.
Jennifer Rowley. 2012. Conducting research interviews. Management research review 35, 3/4 (2012), 260–271.
José Luis González Sánchez, Francisco Luis Gutiérrez Vela, Francisco Montero Simarro, and Natalia Padilla-Zea. 2012. Playability: Analysing user experience in video games. Behaviour & Information Technology 31, 10 (2012), 1033–1054.
Alex Sandham, Tom Ormerod, Coral Dando, Ray Bull, Mike Jackson, and James Goulding. 2011. Scent trails: Countering terrorism through informed surveillance. In International Conference on Engineering Psychology and Cognitive Ergonomics. Springer, 452–460.
Jesse Schell. 2014. The Art of Game Design: A book of lenses. AK Peters/CRC Press.
Ben Shneiderman, Catherine Plaisant, Maxine Cohen, Steven Jacobs, Niklas Elmqvist, and Nicholas Diakopoulos. 2016. Designing the user interface: strategies for effective human-computer interaction. Pearson.
Misha Sra and Chris Schmandt. 2015. Expanding social mobile games beyond the device screen. Personal and Ubiquitous Computing 19, 3-4 (2015), 495–508.
Daniel W Turner III. 2010. Qualitative interview design: A practical guide for novice investigators. The qualitative report 15, 3 (2010), 754–760.
Adrián Juan Verdejo, Katrien De Moor, Istvan Ketyko, Karen Torben Nielsen, Jeroen Vanattenhoven, Toon De Pessemier, Wout Joseph, Luc Martens, and Lieven De Marez. 2010. QoE estimation of a location-based mobile game using on-body sensors and QoS-related data. In 2010 IFIP Wireless Days. IEEE, 1–5.
Alf Inge Wang, Stian Forberg, and Jon Kjetil Øye. 2016. Knowledge war-a pervasive multiplayer role-playing learning game. In European Conference on Game Based Learning (ECGBL 2016). ACPI, Glasgow, Scotland.
Publicado
30/09/2019
Como Citar
CARNEIRO, Nayana; DARIN, Ticianne; VIANA, Windson.
Uso de Entrevistas na Avaliação de Jogos Baseados em Localização: Lições e Desafios. In: WORKSHOP SOBRE INTERAÇÃO E PESQUISA DE USUÁRIOS NO DESENVOLVIMENTO DE JOGOS (WIPLAY), 1. , 2019, Vitória.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2019
.
p. 59-68.
DOI: https://doi.org/10.5753/wiplay.2019.7840.
