Guilherme Filho
ABSTRACT
The use of multi-touch systems has been increasing in the last few years. These systems also need to pass through an evaluation to check their quality level. For this, usability and User Experience (UX) are two important aspects. Seeking to find out which technologies are being used for this purpose, we performed a Systematic Mapping Study (SMS). We discover that no technologies are being used to evaluate usability and UX on multi-touch interfaces that consider the specificities of this context, such as lack of touch precision and mechanical feedback. We proposed the User Experience and usability Multi-touch Evaluation Questionnaire (UXUMEQ) to fill this gap. This technology was evaluated through a feasibility study performed with 47 participants. Efficiency and effectiveness were compared to a combination of the System usability Scale (SUS) and Intuitive Questionnaire (INTUI). According to quantitative results, UXUMEQ presented a statistically significant difference over SUS+INTUI in terms of efficiency, while in effectiveness the comparison remained similar. In other words, UXUMEQ allows the users to find more problems, though it cannot be said that it saves time in this search compared to SUS+INTUI. UXUMEQ was considered easy to use, proposal-fulfilling, and highly assertive by the study participants. The qualitative data was analyzed and generated in a new version of UXUMEQ.
- Victor R Basili and H Dieter Rombach. 1988. Towards a comprehensive framework for reuse: A reuse-enabling software evolution environment. In NASA, Goddard Space Flight Center, Proceedings of the Thirteenth Annual Software Engineering Workshop.Google Scholar
- Joshua Blake. 2011. Natural user interfaces in. NET: WPF 4, Surface 2, and Kinect. Manning.Google Scholar
- J. Brooke. 1996. SUS: A “quick and dirty” usability scale. In Usability evaluation in industry, P. W. JORDAN and et al. (Eds.). Taylor&Francis, London, 1–7.Google Scholar
- Bill Buxton 2007. Multi-touch systems that I have known and loved. Microsoft Research 56 (2007), 1–11.Google Scholar
- Jeffrey Carver, Letizia Jaccheri, Sandro Morasca, and Forrest Shull. 2004. Issues in using students in empirical studies in software engineering education. In Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No. 03EX717). IEEE, 239–249.Google Scholar
- Tayana Conte, Jobson Massollar, Emilia Mendes, and Guilherme H Travassos. 2007. Usability evaluation based on web design perspectives. In First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007). IEEE, 146–155.Google ScholarDigital Library
- Juliet Corbin and Anselm Strauss. 2014. Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage publications.Google Scholar
- Fred D Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly (1989), 319–340.Google ScholarDigital Library
- Statista Research Department. 2022. Global smartphone sales to end users since 2007.Google Scholar
- Connor Dodd, Rukshan Athauda, and Marc Adam. 2017. Designing user interfaces for the elderly: a systematic literature review. (2017).Google Scholar
- Hadziq Fabroyir. 2019. Multitouch Interface is not Good for Spatial Navigation in Virtual Reality. In 2019 12th International Conference on Information & Communication Technology and System (ICTS). IEEE, 323–326.Google ScholarCross Ref
- Adrian Fernandez, Silvia Abrahão, Emilio Insfran, and Maristella Matera. 2012. Further analysis on the validation of a usability inspection method for model-driven web development. In Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement. 153–156.Google ScholarDigital Library
- Adrian Fernandez, Silvia Abrahão, Emilio Insfran, and Maristella Matera. 2013. Usability inspection in model-driven web development: Empirical validation in webml. In Model-Driven Engineering Languages and Systems: 16th International Conference, MODELS 2013, Miami, FL, USA, September 29–October 4, 2013. Proceedings 16. Springer, 740–756.Google ScholarDigital Library
- Saad Q Fleh, Oğuz Bayat, Saad Al-Azawi, and Osman Nuri Uçan. 2018. A systematic mapping study on touch classification. (2018).Google Scholar
- Market Data Forecast. 2022. Smartphone market size and growth.Google Scholar
- Clifton Forlines, Daniel Wigdor, Chia Shen, and Ravin Balakrishnan. 2007. Direct-touch vs. mouse input for tabletop displays. In Proceedings of the SIGCHI conference on Human factors in computing systems. 647–656.Google ScholarDigital Library
- Guilherme Corredato Guerino and Natasha Malveira Costa Valentim. 2020. Usability and user experience evaluation of natural user interfaces: a systematic mapping study. IET Software 14, 5 (2020), 451–467.Google ScholarDigital Library
- Hejar Gürlük, Malte-Levin Jauer, and Maria Uebbing-Rumke. 2014. Design and evaluation of a multi-touch interaction language for approach controllers. In Proceedings of the International Conference on Human-Computer Interaction in Aerospace. 1–4.Google ScholarDigital Library
- Marc Hassenzahl. 2004. The interplay of beauty, goodness, and usability in interactive products. Human–Computer Interaction 19, 4 (2004), 319–349.Google Scholar
- ISO 9241-9. 2000. Ergonomics of Human System Interaction - Part 9: Requirements for non-keyboard input devices. International Organization for Standardization.Google Scholar
- ISO/IEC 25010. 2011. Systems and Software Engineering - SquaRE - Software product Quality Requirements and Evaluation: System and Software Quality Models). International Organization for Standardization.Google Scholar
- Giulio Jacucci, Ann Morrison, Gabriela T Richard, Jari Kleimola, Peter Peltonen, Lorenza Parisi, and Toni Laitinen. 2010. Worlds of information: designing for engagement at a public multi-touch display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2267–2276.Google ScholarDigital Library
- Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing systematic literature reviews in software engineering. (2007).Google Scholar
- Guilherme Eduardo Konopatzki, Guilherme Guerino, and Natasha Valentim. 2023. Proposal and Preliminary Evaluation of a Usability and UX Multi-Touch Evaluation Technology. In Proceedings of the XIX Brazilian Symposium on Information Systems. 317–324.Google ScholarDigital Library
- Guilherme E Konopatzki Filho, Guilherme Corredato Guerino, and Natasha MC Valentim. 2022. A systematic mapping study on usability and user eXperience evaluation of multi-touch systems. Anais do XXI Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (2022).Google Scholar
- Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and usability engineering group. Springer, 63–76.Google ScholarDigital Library
- Ankita Madan and Sanjay Kumar Dubey. 2012. Usability evaluation methods: a literature review. International Journal of Engineering Science and Technology 4, 2 (2012), 590–599.Google Scholar
- Henry B Mann and Donald R Whitney. 1947. On a test of whether one of two random variables is stochastically larger than the other. The annals of mathematical statistics (1947), 50–60.Google Scholar
- Vicente Nacher and Javier Jaen. 2015. Evaluating the accuracy of pre-kindergarten children multi-touch interaction. In IFIP Conference on Human-Computer Interaction. Springer, 549–556.Google ScholarDigital Library
- Fatih Nayebi, Jean-Marc Desharnais, and Alain Abran. 2012. The state of the art of mobile application usability evaluation. In 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE). IEEE, 1–4.Google ScholarCross Ref
- Richard M Ryan and Edward L Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.American psychologist 55, 1 (2000), 68.Google Scholar
- Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344–360.Google Scholar
- Gleison Santos, Ana Regina Rocha, Tayana Conte, Monalessa Perini Barcellos, and Rafael Prikladnicki. 2012. Strategic alignment between academy and Industry: a Virtuous Cycle to Promote Innovation in Technology. In 2012 26th Brazilian Symposium on Software Engineering. IEEE, 196–200.Google ScholarDigital Library
- Tim Schürmann, Christina Binder, Gesche Janzarik, and Joachim Vogt. 2015. Movement transformation on multi-touch devices: Intuition or instructional preparation?Applied Ergonomics 50 (2015), 251–255.Google Scholar
- Forrest Shull, Jeffrey Carver, and Guilherme H Travassos. 2001. An empirical methodology for introducing software processes. ACM SIGSOFT Software Engineering Notes 26, 5 (2001), 288–296.Google ScholarDigital Library
- Elena Tuveri, Samuel A Iacolina, Fabio Sorrentino, L Davide Spano, and Riccardo Scateni. 2013. Controlling a planetarium software with a Kinect or in a multi-touch table: a comparison. In Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI. 1–4.Google ScholarDigital Library
- Maria Uebbing-Rumke, Hejar Gürlük, Malte-Levin Jauer, Konrad Hagemann, and Andreas Udovic. 2014. Usability evaluation of multi-touch displays for TMA controller working positions. Proceedings of the 4th SESAR Innovation Days, Madrid, Spain (2014), 25–27.Google Scholar
- Daniel Ullrich and Sarah Diefenbach. 2010. From magical experience to effortlessness: an exploration of the components of intuitive interaction. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries. 801–804.Google ScholarDigital Library
- Peter Vorderer, Werner Wirth, Feliz Ribeiro Gouveia, Frank Biocca, Timo Saari, Lutz Jäncke, Saskia Böcking, Holger Schramm, Andre Gysbers, Tilo Hartmann, 2004. Mec spatial presence questionnaire. Retrieved Sept 18 (2004), 2015.Google Scholar
- David Watson and Lee Anna Clark. 1994. The PANAS-X: Manual for the positive and negative affect schedule-expanded form. (1994).Google Scholar
- Diane Watson, Mark Hancock, Regan L Mandryk, and Max Birk. 2013. Deconstructing the touch experience. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 199–208.Google ScholarDigital Library
- Daniel Wigdor and Dennis Wixon. 2011. Brave NUI world: designing natural user interfaces for touch and gesture. Elsevier.Google ScholarDigital Library
- Bob G Witmer and Michael J Singer. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence 7, 3 (1998), 225–240.Google ScholarDigital Library
- Claes Wohlin, Per Runeson, Martin Höst, Magnus C Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in software engineering. Springer Science & Business Media.Google ScholarCross Ref
Index Terms
- A feasibility study of usability and UX evaluation technologies in multi-touch context: A quantitative and qualitative analysis
Recommendations
A Systematic Mapping Study on Research Contributions on UX Evaluation Technologies
IHC '17: Proceedings of the XVI Brazilian Symposium on Human Factors in Computing SystemsUser eXperience (UX) refers to quality attributes related to the feelings and emotions of the users. In order to evaluate UX, several technologies (tools, methods, techniques, others) have been proposed that range from using questionnaires to employing ...
Proposal and Preliminary Evaluation of a Usability and UX Multi-Touch Evaluation Technology
SBSI '23: Proceedings of the XIX Brazilian Symposium on Information SystemsContext: For multi-touch Information Systems (ISs) to reach the desired level of quality, it is necessary to have an evaluation of it. Two important quality aspects are usability and User eXperience (UX). A good assessment must take into account the ...
A systematic mapping study on usability and user eXperience evaluation of multi-touch systems
IHC '22: Proceedings of the 21st Brazilian Symposium on Human Factors in Computing SystemsA significant increase in multi-touch interactions is notable with the expanded use of smartphones, tablets, and tabletops. Multi-touch systems are software that uses the user's fingers to perform some action. These systems need evaluation before being ...
Comments