Proposal and Preliminary Evaluation of a Usability and UX Multi-Touch Evaluation Technology
Resumo
Context: For multi-touch Information Systems (ISs) to reach the desired level of quality, it is necessary to have an evaluation of it. Two important quality aspects are usability and User eXperience (UX). A good assessment must take into account the specifics of the evaluated context. Problem: Through a Systematic Mapping Study (SMS), it was realized that no usability and UX evaluation technologies take into account the unique characteristics of the multi-touch context. Solution: To solve this gap, the User eXperience and Usability Multi-touch Evaluation Technology (UXUMEQ) was proposed. IS Theory: To fulfill this gap, UXUMEQ was based on Design Theory, which concerns the development and refinement of an artifact. Method: The usability and UX aspects and the evaluation technologies found in the SMS results were selected and evaluated to compose the UXUMEQ. The questions of evaluation technologies found considered relevant were filtered and adapted for the multi-touch context. Results: Therefore, the purpose of UXUMEQ takes into account the specifics of multi-touch, in the form of a modular questionnaire, covering the aspects of usability and UX. Moreover, a preliminary evaluation with three experts in Human-Computer Interaction provided improvements for the UXUMEQ. Contribution: In this way, the existence of usability and UX evaluation technology of ISs that uses multi-touch interaction can contribute to reaching a better quality of this kind of system.
Palavras-chave:
Multi-touch, Usability, User Experience, Evaluation
Referências
Anonymous. 2022. blank. In nowhere. 1–12.
J. Brooke. 1996. SUS: A “quick and dirty” usability scale. In Usability evaluation in industry, P. W. JORDAN and et al. (Eds.). Taylor&Francis, London, 1–7.
Ashley Colley, Jani Väyrynen, and Jonna Häkkilä. 2015. In-car touch screen interaction: Comparing standard, finger-specific and multi-finger interaction. In Proceedings of the 4th international symposium on pervasive displays. 131–137.
Juliet Corbin and Anselm Strauss. 2014. Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage publications.
Sashikanth Damaraju, Jinsil Hwaryoung Seo, Tracy Hammond, and Andruid Kerne. 2013. Multi-tap sliders: advancing touch interaction for parameter adjustment. In Proceedings of the 2013 international conference on Intelligent user interfaces. 445–452.
Statista Research Department. 2022. Global smartphone sales to end users since 2007.
Market Data Forecast. 2022. Smartphone market size and growth.
Chi-Wing Fu, Wooi-Boon Goh, and Junxiang Allen Ng. 2010. Multi-touch techniques for exploring large-scale 3D astrophysical simulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2213–2222.
Alexander Giesler, Dimitar Valkov, and Klaus Hinrichs. 2014. Void shadows: multi-touch interaction with stereoscopic objects on the tabletop. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 104–112.
Antonio Carlos Gil. 2008. Métodos e técnicas de pesquisa social. 6. ed. Ediitora Atlas SA.
Hejar Gürlük, Malte-Levin Jauer, and Maria Uebbing-Rumke. 2014. Design and evaluation of a multi-touch interaction language for approach controllers. In Proceedings of the International Conference on Human-Computer Interaction in Aerospace. 1–4.
Sandra G Hart. 1986. NASA task load index (TLX). (1986).
Marc Hassenzahl. 2004. The interplay of beauty, goodness, and usability in interactive products. Human–Computer Interaction 19, 4 (2004), 319–349.
ISO 9241-210. 2019. Ergonomics of Human System Interaction - Part 210: Human-Centered Design for Interactive Systems. International Organization for Standardization.
ISO 9241-9. 2000. Ergonomics of Human System Interaction - Part 9: Requirements for non-keyboard input devices. International Organization for Standardization.
ISO/IEC 25010. 2011. Systems and Software Engineering - SquaRE - Software product Quality Requirements and Evaluation: System and Software Quality Models). International Organization for Standardization.
Giulio Jacucci, Ann Morrison, Gabriela T Richard, Jari Kleimola, Peter Peltonen, Lorenza Parisi, and Toni Laitinen. 2010. Worlds of information: designing for engagement at a public multi-touch display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2267–2276.
Seon Joo Kim, Hongwei Ng, Stefan Winkler, Peng Song, and Chi-Wing Fu. 2012. Brush-and-drag: A multi-touch interface for photo triaging. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. 59–68.
Sari Kujala and Kaisa Väänänen-Vainio-Mattila. 2009. Value of information systems and products: Understanding the users’ perspective and values. Journal of Information Technology Theory and Application (JITTA) 9, 4 (2009), 4.
Arnold M Lund. 2001. Measuring usability with the use questionnaire12. Usability interface 8, 2 (2001), 3–6.
Ankita Madan and Sanjay Kumar. 2012. Usability evaluation methods: a literature review. International Journal of Engineering Science and Technology 4 (02 2012).
Niamh McNamara and Jurek Kirakowski. 2006. Functionality, usability, and user experience: three areas of concern. interactions 13, 6 (2006), 26–28.
Silvana M Melo. 2009. Inspeção de software. University of São Paulo: São Carlos, SP (2009).
Walid Merrad, Alexis Héloir, Christophe Kolski, and Antonio Krüger. 2022. RFID-based tangible and touch tabletop for dual reality in crisis management context. Journal on Multimodal User Interfaces 16, 1 (2022), 31–53.
Thomas Muender, Sadaab Ali Gulani, Lauren Westendorf, Clarissa Verish, Rainer Malaka, Orit Shaer, and Seth Cooper. 2019. Comparison of mouse and multi-touch for protein structure manipulation in a citizen science game interface. Journal of Science Communication 18, 1 (2019), A05.
Jakob Nielsen. 2005. Ten usability heuristics.
Max Pfeiffer, Dagmar Kern, Johannes Schöning, Tanja Döring, Antonio Krüger, and Albrecht Schmidt. 2010. A multi-touch enabled steering wheel: exploring the design space. In CHI’10 Extended Abstracts on Human Factors in Computing Systems. 3355–3360.
Richard M Ryan and Edward L Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.American psychologist 55, 1 (2000), 68.
Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344–360.
Tim Schürmann, Christina Binder, Gesche Janzarik, and Joachim Vogt. 2015. Movement transformation on multi-touch devices: Intuition or instructional preparation?Applied Ergonomics 50 (2015), 251–255.
Ben Shneiderman. 1981. Direct manipulation: A step beyond programming languages. In Proceedings of the Joint Conference on Easier and More Productive Use of Computer Systems.(Part-II): Human Interface and the User Interface-Volume 1981. 143.
Maria Uebbing-Rumke, Hejar Gürlük, Malte-Levin Jauer, Konrad Hagemann, and Andreas Udovic. 2014. Usability evaluation of multi-touch displays for TMA controller working positions. Proceedings of the 4th SESAR Innovation Days, Madrid, Spain (2014), 25–27.
Daniel Ullrich and Sarah Diefenbach. 2010. From magical experience to effortlessness: an exploration of the components of intuitive interaction. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries. 801–804.
Peter Vorderer, Werner Wirth, Feliz Ribeiro Gouveia, Frank Biocca, Timo Saari, Lutz Jäncke, Saskia Böcking, Holger Schramm, Andre Gysbers, Tilo Hartmann, et al. 2004. Mec spatial presence questionnaire. Retrieved Sept 18 (2004), 2015.
Jia Wang and Robert Lindeman. 2014. Coordinated 3D interaction in tablet-and HMD-based hybrid virtual environments. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 70–79.
David Watson and Lee Anna Clark. 1994. The PANAS-X: Manual for the positive and negative affect schedule-expanded form. (1994).
Benjamin Wingert, Isabel Schöllhorn, and Matthias Bues. 2017. Prodesk: An interactive ubiquitous desktop surface. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. 366–371.
Panagiotis Zaharias, Despina Michael, and Yiorgos Chrysanthou. 2013. Learning through multi-touch interfaces in museum exhibits: An empirical investigation. Journal of Educational Technology & Society 16, 3 (2013), 374–384.
J. Brooke. 1996. SUS: A “quick and dirty” usability scale. In Usability evaluation in industry, P. W. JORDAN and et al. (Eds.). Taylor&Francis, London, 1–7.
Ashley Colley, Jani Väyrynen, and Jonna Häkkilä. 2015. In-car touch screen interaction: Comparing standard, finger-specific and multi-finger interaction. In Proceedings of the 4th international symposium on pervasive displays. 131–137.
Juliet Corbin and Anselm Strauss. 2014. Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage publications.
Sashikanth Damaraju, Jinsil Hwaryoung Seo, Tracy Hammond, and Andruid Kerne. 2013. Multi-tap sliders: advancing touch interaction for parameter adjustment. In Proceedings of the 2013 international conference on Intelligent user interfaces. 445–452.
Statista Research Department. 2022. Global smartphone sales to end users since 2007.
Market Data Forecast. 2022. Smartphone market size and growth.
Chi-Wing Fu, Wooi-Boon Goh, and Junxiang Allen Ng. 2010. Multi-touch techniques for exploring large-scale 3D astrophysical simulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2213–2222.
Alexander Giesler, Dimitar Valkov, and Klaus Hinrichs. 2014. Void shadows: multi-touch interaction with stereoscopic objects on the tabletop. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 104–112.
Antonio Carlos Gil. 2008. Métodos e técnicas de pesquisa social. 6. ed. Ediitora Atlas SA.
Hejar Gürlük, Malte-Levin Jauer, and Maria Uebbing-Rumke. 2014. Design and evaluation of a multi-touch interaction language for approach controllers. In Proceedings of the International Conference on Human-Computer Interaction in Aerospace. 1–4.
Sandra G Hart. 1986. NASA task load index (TLX). (1986).
Marc Hassenzahl. 2004. The interplay of beauty, goodness, and usability in interactive products. Human–Computer Interaction 19, 4 (2004), 319–349.
ISO 9241-210. 2019. Ergonomics of Human System Interaction - Part 210: Human-Centered Design for Interactive Systems. International Organization for Standardization.
ISO 9241-9. 2000. Ergonomics of Human System Interaction - Part 9: Requirements for non-keyboard input devices. International Organization for Standardization.
ISO/IEC 25010. 2011. Systems and Software Engineering - SquaRE - Software product Quality Requirements and Evaluation: System and Software Quality Models). International Organization for Standardization.
Giulio Jacucci, Ann Morrison, Gabriela T Richard, Jari Kleimola, Peter Peltonen, Lorenza Parisi, and Toni Laitinen. 2010. Worlds of information: designing for engagement at a public multi-touch display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2267–2276.
Seon Joo Kim, Hongwei Ng, Stefan Winkler, Peng Song, and Chi-Wing Fu. 2012. Brush-and-drag: A multi-touch interface for photo triaging. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. 59–68.
Sari Kujala and Kaisa Väänänen-Vainio-Mattila. 2009. Value of information systems and products: Understanding the users’ perspective and values. Journal of Information Technology Theory and Application (JITTA) 9, 4 (2009), 4.
Arnold M Lund. 2001. Measuring usability with the use questionnaire12. Usability interface 8, 2 (2001), 3–6.
Ankita Madan and Sanjay Kumar. 2012. Usability evaluation methods: a literature review. International Journal of Engineering Science and Technology 4 (02 2012).
Niamh McNamara and Jurek Kirakowski. 2006. Functionality, usability, and user experience: three areas of concern. interactions 13, 6 (2006), 26–28.
Silvana M Melo. 2009. Inspeção de software. University of São Paulo: São Carlos, SP (2009).
Walid Merrad, Alexis Héloir, Christophe Kolski, and Antonio Krüger. 2022. RFID-based tangible and touch tabletop for dual reality in crisis management context. Journal on Multimodal User Interfaces 16, 1 (2022), 31–53.
Thomas Muender, Sadaab Ali Gulani, Lauren Westendorf, Clarissa Verish, Rainer Malaka, Orit Shaer, and Seth Cooper. 2019. Comparison of mouse and multi-touch for protein structure manipulation in a citizen science game interface. Journal of Science Communication 18, 1 (2019), A05.
Jakob Nielsen. 2005. Ten usability heuristics.
Max Pfeiffer, Dagmar Kern, Johannes Schöning, Tanja Döring, Antonio Krüger, and Albrecht Schmidt. 2010. A multi-touch enabled steering wheel: exploring the design space. In CHI’10 Extended Abstracts on Human Factors in Computing Systems. 3355–3360.
Richard M Ryan and Edward L Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.American psychologist 55, 1 (2000), 68.
Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344–360.
Tim Schürmann, Christina Binder, Gesche Janzarik, and Joachim Vogt. 2015. Movement transformation on multi-touch devices: Intuition or instructional preparation?Applied Ergonomics 50 (2015), 251–255.
Ben Shneiderman. 1981. Direct manipulation: A step beyond programming languages. In Proceedings of the Joint Conference on Easier and More Productive Use of Computer Systems.(Part-II): Human Interface and the User Interface-Volume 1981. 143.
Maria Uebbing-Rumke, Hejar Gürlük, Malte-Levin Jauer, Konrad Hagemann, and Andreas Udovic. 2014. Usability evaluation of multi-touch displays for TMA controller working positions. Proceedings of the 4th SESAR Innovation Days, Madrid, Spain (2014), 25–27.
Daniel Ullrich and Sarah Diefenbach. 2010. From magical experience to effortlessness: an exploration of the components of intuitive interaction. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries. 801–804.
Peter Vorderer, Werner Wirth, Feliz Ribeiro Gouveia, Frank Biocca, Timo Saari, Lutz Jäncke, Saskia Böcking, Holger Schramm, Andre Gysbers, Tilo Hartmann, et al. 2004. Mec spatial presence questionnaire. Retrieved Sept 18 (2004), 2015.
Jia Wang and Robert Lindeman. 2014. Coordinated 3D interaction in tablet-and HMD-based hybrid virtual environments. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 70–79.
David Watson and Lee Anna Clark. 1994. The PANAS-X: Manual for the positive and negative affect schedule-expanded form. (1994).
Benjamin Wingert, Isabel Schöllhorn, and Matthias Bues. 2017. Prodesk: An interactive ubiquitous desktop surface. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. 366–371.
Panagiotis Zaharias, Despina Michael, and Yiorgos Chrysanthou. 2013. Learning through multi-touch interfaces in museum exhibits: An empirical investigation. Journal of Educational Technology & Society 16, 3 (2013), 374–384.
Publicado
29/05/2023
Como Citar
KONOPATZKI, Guilherme Eduardo; GUERINO, Guilherme; VALENTIM, Natasha.
Proposal and Preliminary Evaluation of a Usability and UX Multi-Touch Evaluation Technology. In: SIMPÓSIO BRASILEIRO DE SISTEMAS DE INFORMAÇÃO (SBSI), 19. , 2023, Maceió/AL.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
