A systematic mapping study on usability and user eXperience evaluation of multi-touch systems
Resumo
A significant increase in multi-touch interactions is notable with the expanded use of smartphones, tablets, and tabletops. Multi-touch systems are software that uses the user’s fingers to perform some action. These systems need evaluation before being available in the market to improve the interaction and general user experience. In this context, User eXperience (UX) and Usability are relevant criteria related to multi-touch systems quality. Therefore, we performed a Systematic Mapping Study (SMS) seeking to identify evaluation technologies used by professionals and researchers to evaluate the aspects of Usability and UX in multi-touch systems. After the selection process, 65 out of 622 identified papers were selected for data extraction. As a result, 29 different evaluation technologies were identified. Besides, we also obtained characteristics of these technologies, empirical studies, and the multi-touch systems presented in the papers. Our study shows a lack of evaluation technologies focused on the multi-touch context; most do not evaluate Usability and UX concepts jointly; none go under an empirical evaluation since researchers tend to create their technologies to assess their aspects. This SMS presents data about the evaluation technologies extracted and the gaps found over the researched topic, contributing to the scientific and industrial community that evaluates the Usability and UX of multi-touch systems.
Palavras-chave:
Multi-touch, Usability, User Experience, Evaluation Technologies
Referências
Christopher James Ackad, Anthony Collins, and Judy Kay. 2010. Switch: exploring the design of application and configuration switching at tabletops. In ACM International Conference on Interactive Tabletops and Surfaces. 95--104.
Douglas G Altman. 1990. Practical statistics for medical research. CRC press.
A. Ampatzoglou, S. Bibi, P. Avgeriou, M. Verbeek, and A. Chatzigeorgiou. 2019. Identifying, categorizing and mitigating threats to validity in software engineering secondary studies. Information and Software Technology 106 (2019), 201 -- 230.
Adrien Arnaud, Jean-Baptiste Corrégé, Céline Clavel, Michèle Gouiffès, and Mehdi Ammi. 2016. Exploration of virtual environments on tablet: comparison between tactile and tangible interaction techniques. In Proceedings of the 18th ACM International Conference on Multimodal Interaction. 357--361.
Victor R Basili and H Dieter Rombach. 1988. Towards a comprehensive framework for reuse: A reuse-enabling software evolution environment. In NASA, Goddard Space Flight Center, Proceedings of the Thirteenth Annual Software Engineering Workshop.
Mehmet Ilker Berkman and Adem Karahoca. 2012. A direct touch table-top display as a multi-user information kiosk: Comparing the usability of a single display groupware either by a single user or people cooperating as a group. Interacting with Computers 24, 5 (2012), 423--437.
David Bertolo, Robin Vivian, and Jérome Dinet. 2013. A set of interactions to rotate solids in 3D geometry context. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. 625--630.
Bojan Blažica, Daniel Vladušič, and Dunja Mladenić. 2013. MTi: A method for user identification for multitouch displays. International Journal of Human-Computer Studies 71, 6 (2013), 691--702.
J. Brooke. 1996. SUS: A "quick and dirty" usability scale. In Usability evaluation in industry, P. W. JORDAN and et al. (Eds.). Taylor&Francis, London, 1--7.
Bill Buxton et al. 2007. Multi-touch systems that I have known and loved. Microsoft Research 56 (2007), 1--11.
Thiago Campos, Eduardo Damasceno, and Natasha M. C. Valentim. [n.d.]. Proposal and Evaluation of a Collaborative IS to Support Systematic Reviews and Mapping Studies. In Proceedings of the XVIII Brazilian Symposium on Information Systems (SBSI).
Antonia Cascales-Martínez, María-José Martínez-Segura, David Pérez-López, and Manuel Contero. 2016. Using an augmented reality enhanced tabletop system to promote learning of mathematics: A case study with students with special educational needs. Eurasia Journal of Mathematics, Science and Technology Education 13, 2 (2016), 355--380.
Zhiyong Chen, Juncong Lin, Guangyu Zhang, Wei Yang, Guilin Li, and Guohua Huang. 2016. A multi-touch interface for natural and seamless image composition. In 2016 11th International Conference on Computer Science & Education (ICCSE). IEEE, 796--801.
Gianluigi Ciocca, Paolo Olivo, and Raimondo Schettini. 2012. Browsing museum image collections on a multi-touch table. Information systems 37, 2 (2012), 169--182.
Ashley Colley, Jani Väyrynen, and Jonna Häkkilä. 2015. In-car touch screen interaction: Comparing standard, finger-specific and multi-finger interaction. In Proceedings of the 4th international symposium on pervasive displays. 131--137.
Jamie L Coram, Rob Iverson, and Andrew Ackerman. 2013. AstroTouch: a multi-touch digital desktop for astrodynamics. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 11--14.
Sashikanth Damaraju, Jinsil Hwaryoung Seo, Tracy Hammond, and Andruid Kerne. 2013. Multi-tap sliders: advancing touch interaction for parameter adjustment. In Proceedings of the 2013 international conference on Intelligent user interfaces. 445--452.
Tulio de Souza Alcantara, Pierre Bastianelli, Jennifer Ferreira, and Frank Maurer. 2012. A multi-touch approach to control MRI scans: A user-centered study report. In 2012 4th International Workshop on Software Engineering in Health Care (SEHC). IEEE, 65--68.
Jan Derboven, Dries De Roeck, and Mathijs Verstraete. 2012. Semiotic analysis of multi-touch interface design: The MuTable case study. International Journal of Human-Computer Studies 70, 10 (2012), 714--728.
Connor Dodd, Rukshan Athauda, and Marc Adam. 2017. Designing user interfaces for the elderly: a systematic literature review. (2017).
Julie Ducasse, Marc Macé, Bernard Oriola, and Christophe Jouffrais. 2018. Botmap: Non-visual panning and zooming with an actuated tabletop tangible interface. ACM Transactions on Computer-Human Interaction (TOCHI) 25, 4 (2018), 1--42.
Florian Echtler, Simon Nestler, Andreas Dippon, and Gudrun Klinker. 2009. Supporting casual interactions between board games on public tabletop displays and mobile devices. Personal and ubiquitous computing 13, 8 (2009), 609--617.
Hadziq Fabroyir. 2019. Multitouch Interface is not Good for Spatial Navigation in Virtual Reality. In 2019 12th International Conference on Information & Communication Technology and System (ICTS). IEEE, 323--326.
Saad Q Fleh, Oğuz Bayat, Saad Al-Azawi, and Osman Nuri Uçan. 2018. A systematic mapping study on touch classification. (2018).
Clifton Forlines, Daniel Wigdor, Chia Shen, and Ravin Balakrishnan. 2007. Direct-touch vs. mouse input for tabletop displays. In Proceedings of the SIGCHI conference on Human factors in computing systems. 647--656.
Georg Freitag, Michael Tränkner, and Markus Wacker. 2012. Enhanced feed-forward for a user aware multi-touch device. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design. 578--586.
Mathias Frisch, Ricardo Langner, and Raimund Dachselt. 2011. Neat: a set of flexible tools and gestures for layout tasks on interactive displays. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. 1--10.
Chi-Wing Fu, Wooi-Boon Goh, and Junxiang Allen Ng. 2010. Multi-touch techniques for exploring large-scale 3D astrophysical simulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2213--2222.
Emilien Ghomi, Stéphane Huot, Olivier Bau, Michel Beaudouin-Lafon, and Wendy E Mackay. 2013. Arpège: learning multitouch chord gestures vocabularies. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 209--218.
Alexander Giesler, Dimitar Valkov, and Klaus Hinrichs. 2014. Void shadows: multi-touch interaction with stereoscopic objects on the tabletop. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 104--112.
Guilherme Corredato Guerino and Natasha Malveira Costa Valentim. 2020. Usability and user experience evaluation of natural user interfaces: a systematic mapping study. IET Software 14, 5 (2020), 451--467.
Hejar Gürlük, Malte-Levin Jauer, and Maria Uebbing-Rumke. 2014. Design and evaluation of a multi-touch interaction language for approach controllers. In Proceedings of the International Conference on Human-Computer Interaction in Aerospace. 1--4.
Martin Hachet, Benoit Bossavit, Aurélie Cohé, and Jean-Baptiste de la Rivière. 2011. Toucheo: multitouch and stereo combined in a seamless workspace. In Proceedings of the 24th annual ACM symposium on User interface software and technology. 587--592.
Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91--97.
Hsien-Sheng Hsiao, Cheng-Sian Chang, Chien-Yu Lin, Chih-Chun Chang, and Jyun-Chen Chen. 2014. The influence of collaborative learning games within different devices on student's learning performance and behaviours. Australasian Journal of Educational Technology 30, 6 (2014).
Osvaldo Huerta, J Alfredo Sánchez, Salvador Fuentes, and Ofelia Cervantes. 2011. Speak up your mind: Using speech to capture innovative ideas on interactive surfaces. In Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction. 202--211.
ISO 9241-210. 2019. Ergonomics of Human System Interaction - Part 210: Human-Centered Design for Interactive Systems. International Organization for Standardization.
ISO/IEC 25010. 2011. Systems and Software Engineering - SquaRE - Software product Quality Requirements and Evaluation: System and Software Quality Models). International Organization for Standardization.
Giulio Jacucci, Ann Morrison, Gabriela T Richard, Jari Kleimola, Peter Peltonen, Lorenza Parisi, and Toni Laitinen. 2010. Worlds of information: designing for engagement at a public multi-touch display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2267--2276.
Hans-Christian Jetter, Jens Gerken, Michael Zöllner, Harald Reiterer, and Natasa Milic-Frayling. 2011. Materializing the query with facet-streams: a hybrid surface for collaborative search on tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3013--3022.
Johan Kildal, Andrés Lucero, and Marion Boberg. 2013. Twisting touch: combining deformation and touch as input within the same interaction cycle on handheld devices. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services. 237--246.
Seon Joo Kim, Hongwei Ng, Stefan Winkler, Peng Song, and Chi-Wing Fu. 2012. Brush-and-drag: A multi-touch interface for photo triaging. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. 59--68.
Yoon-Hyun Kim and Ji-Hyun Lee. 2015. Game interface enhancement under smartphone platform focused on touchscreen interaction. Computers & Industrial Engineering 80 (2015), 45--61.
Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing systematic literature reviews in software engineering. (2007).
Panagiotis Koutlemanis, Antonios Ntelidakis, Xenophon Zabulis, Dimitris Grammenos, and Ilia Adami. 2013. A steerable multitouch display for surface computing and its evaluation. International Journal on Artificial Intelligence Tools 22, 06 (2013), 1360016.
Alexander Kulik, André Kunert, Magdalena Keil, and Bernd Froehlich. 2018. RST 3D: A comprehensive gesture set for multitouch 3D navigation. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 363--370.
Felipe Eduardo Lammel, Isabel Harb Manssour, and Milene Selbach Silveira. 2016. Multi-touch Interaction with Information Visualization Techniques: An Analysis Using Twitter Data. In International Conference on Human-Computer Interaction. Springer, 211--222.
Ioannis Leftheriotis. 2013. User authentication in a multi-touch surface: a chord password system. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. 1725--1730.
Ioannis Leftheriotis, Michail N Giannakos, Konstantinos Chorianopoulos, and Letizia Jaccheri. 2015. Investigating the Potential of a Two-finger Chord Button in Multi-touch Applications. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces. 337--342.
Shuang Liang, Justin Cameron, and George Baciu. 2011. Generic gesture kernel modeling and its application with virtual garment design. In Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry. 279--286.
Roman Lissermann, Jochen Huber, Martin Schmitz, Jürgen Steimle, and Max Mühlhäuser. 2014. Permulin: mixed-focus collaboration on multi-view tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3191--3200.
Tahir Mustafa Madni, Yunus B Nayan, Suziah Sulaiman, Ahsanullah Abro, and Muhammad Tahir. 2016. Usability evaluation of orientation techniques for medical image analysis using tabletop system. In 2016 3rd International Conference on Computer and Information Sciences (ICCOINS). IEEE, 477--482.
Sômulo Nogueira Mafra, Rafael Ferreira Barcelos, and Guilherme Horta Travassos. 2006. Aplicando uma metodologia baseada em evidência na definição de novas tecnologias de software. In Proceedings of the 20th Brazilian Symposium on Software Engineering (SBES 2006), Vol. 1. 239--254.
Juan-Fernando Martin-SanJose, M-Carmen Juan, Ramón Mollá, and Roberto Vivó. 2017. Advanced displays and natural user interfaces to support learning. Interactive Learning Environments 25, 1 (2017), 17--34.
Walid Merrad, Alexis Héloir, Christophe Kolski, and Antonio Krüger. 2022. RFID-based tangible and touch tabletop for dual reality in crisis management context. Journal on Multimodal User Interfaces 16, 1 (2022), 31--53.
Mark Micire, Munjal Desai, Jill L Drury, Eric McCann, Adam Norton, Katherine M Tsui, and Holly A Yanco. 2011. Design and validation of two-handed multi-touch tabletop controllers for robot teleoperation. In Proceedings of the 16th international conference on Intelligent user interfaces. 145--154.
Annette Mossel, Benjamin Venditti, and Hannes Kaufmann. 2013. 3DTouch and HOMER-S: intuitive manipulation techniques for one-handed handheld augmented reality. In Proceedings of the Virtual Reality International Conference: Laval Virtual. 1--10.
Thomas Muender, Sadaab Ali Gulani, Lauren Westendorf, Clarissa Verish, Rainer Malaka, Orit Shaer, and Seth Cooper. 2019. Comparison of mouse and multi-touch for protein structure manipulation in a citizen science game interface. Journal of Science Communication 18, 1 (2019), A05.
Vicente Nacher and Javier Jaen. 2015. Evaluating the accuracy of pre-kindergarten children multi-touch interaction. In IFIP Conference on Human-Computer Interaction. Springer, 549--556.
Vicente Nacher, Javier Jaen, Elena Navarro, Alejandro Catala, and Pascual González. 2015. Multi-touch gestures for pre-kindergarten children. International journal of human-computer studies 73 (2015), 37--51.
Fatih Nayebi, Jean-Marc Desharnais, and Alain Abran. 2012. The state of the art of mobile application usability evaluation. In 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE). IEEE, 1--4.
Alex Olwal, Steven Feiner, and Susanna Heyman. 2008. Rubbing and tapping for precise and rapid selection on touch-screen displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 295--304.
Max Pfeiffer, Dagmar Kern, Johannes Schöning, Tanja Döring, Antonio Krüger, and Albrecht Schmidt. 2010. A multi-touch enabled steering wheel: exploring the design space. In CHI'10 Extended Abstracts on Human Factors in Computing Systems. 3355--3360.
Srinivasan Radhakrishnan, Yingzi Lin, Ibrahim Zeid, and Sagar Kamarthi. 2013. Finger-based multitouch interface for performing 3D CAD operations. International Journal of Human-Computer Studies 71, 3 (2013), 261--275.
Roman Rädle, Hans-Christian Jetter, Simon Butscher, and Harald Reiterer. 2013. The effect of egocentric body movements on users' navigation performance and spatial memory in zoomable user interfaces. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 23--32.
Adriano Bernardo Renzi and Sydney Freitas. 2014. Affordances and gestural interaction on multi-touch interface systems: building new mental models. In International Conference of Design, User Experience, and Usability. Springer, 615--623.
Ivan Rodriguez-Conde and Celso Campos. 2020. Towards customer-centric additive manufacturing: making human-centered 3D design tools through a handheld-based multi-touch user interface. Sensors 20, 15 (2020), 4255.
Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344--360.
Gleison Santos, Ana Regina Rocha, Tayana Conte, Monalessa Perini Barcellos, and Rafael Prikladnicki. 2012. Strategic alignment between academy and Industry: a Virtuous Cycle to Promote Innovation in Technology. In 2012 26th Brazilian Symposium on Software Engineering. IEEE, 196--200.
Tim Schürmann, Christina Binder, Gesche Janzarik, and Joachim Vogt. 2015. Movement transformation on multi-touch devices: Intuition or instructional preparation? Applied Ergonomics 50 (2015), 251--255.
Ben Shneiderman. 1981. Direct manipulation: A step beyond programming languages. In Proceedings of the Joint Conference on Easier and More Productive Use of Computer Systems.(Part-II): Human Interface and the User Interface-Volume 1981. 143.
Forrest Shull, Jeffrey Carver, and Guilherme H Travassos. 2001. An empirical methodology for introducing software processes. ACM SIGSOFT Software Engineering Notes 26, 5 (2001), 288--296.
Can Telkenaroglu and Tolga Capin. 2013. Dual-finger 3d interaction techniques for mobile devices. Personal and ubiquitous computing 17, 7 (2013), 1551--1572.
Po-Huan Tseng, Shih-Hsuan Hung, Pei-Ying Chiang, Chih-Yuan Yao, and Hung-Kuo Chu. 2018. EZ-Manipulator: Designing a mobile, fast, and ambiguity-free 3D manipulation interface using smartphones. Computational Visual Media 4, 2 (2018), 139--147.
Philip Tuddenham, David Kirk, and Shahram Izadi. 2010. Graspables revisited: multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks. In Proceedings of the SIGCHI conference on human factors in computing systems. 2223--2232.
Elena Tuveri, Samuel A Iacolina, Fabio Sorrentino, L Davide Spano, and Riccardo Scateni. 2013. Controlling a planetarium software with a Kinect or in a multi-touch table: a comparison. In Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI. 1--4.
Maria Uebbing-Rumke, Hejar Gürlük, Malte-Levin Jauer, Konrad Hagemann, and Andreas Udovic. 2014. Usability evaluation of multi-touch displays for TMA controller working positions. Proceedings of the 4th SESAR Innovation Days, Madrid, Spain (2014), 25--27.
Peter Vorderer, Werner Wirth, Feliz Ribeiro Gouveia, Frank Biocca, Timo Saari, Lutz Jäncke, Saskia Böcking, Holger Schramm, Andre Gysbers, Tilo Hartmann, et al. 2004. Mec spatial presence questionnaire. Retrieved Sept 18 (2004), 2015.
Julie Wagner, Stéphane Huot, and Wendy Mackay. 2012. BiTouch and BiPad: designing bimanual interaction for hand-held tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2317--2326.
Jia Wang and Rob Lindeman. 2012. Leaning-based travel interfaces revisited: frontal versus sidewise stances for flying in 3D virtual spaces. In Proceedings of the 18th ACM symposium on Virtual reality software and technology. 121--128.
Jia Wang and Robert Lindeman. 2014. Coordinated 3D interaction in tablet-and HMD-based hybrid virtual environments. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 70--79.
Jia Wang and Robert Lindeman. 2015. Coordinated hybrid virtual environments: Seamless interaction contexts for effective virtual reality. Computers & Graphics 48 (2015), 71--83.
Diane Watson, Mark Hancock, Regan L Mandryk, and Max Birk. 2013. Deconstructing the touch experience. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 199--208.
Benjamin Wingert, Isabel Schöllhorn, and Matthias Bues. 2017. Prodesk: An interactive ubiquitous desktop surface. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. 366--371.
Panagiotis Zaharias, Despina Michael, and Yiorgos Chrysanthou. 2013. Learning through multi-touch interfaces in museum exhibits: An empirical investigation. Journal of Educational Technology & Society 16, 3 (2013), 374--384.
Chi Zhang, Deepak Ranjan Sahoo, Jennifer Pearson, Simon Robinson, Mark D Holton, Philip Hopkins, and Matt Jones. 2020. Active PinScreen: Exploring Spatio-Temporal Tactile Feedbackfor Multi-Finger Interaction. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. 1--11.
Douglas G Altman. 1990. Practical statistics for medical research. CRC press.
A. Ampatzoglou, S. Bibi, P. Avgeriou, M. Verbeek, and A. Chatzigeorgiou. 2019. Identifying, categorizing and mitigating threats to validity in software engineering secondary studies. Information and Software Technology 106 (2019), 201 -- 230.
Adrien Arnaud, Jean-Baptiste Corrégé, Céline Clavel, Michèle Gouiffès, and Mehdi Ammi. 2016. Exploration of virtual environments on tablet: comparison between tactile and tangible interaction techniques. In Proceedings of the 18th ACM International Conference on Multimodal Interaction. 357--361.
Victor R Basili and H Dieter Rombach. 1988. Towards a comprehensive framework for reuse: A reuse-enabling software evolution environment. In NASA, Goddard Space Flight Center, Proceedings of the Thirteenth Annual Software Engineering Workshop.
Mehmet Ilker Berkman and Adem Karahoca. 2012. A direct touch table-top display as a multi-user information kiosk: Comparing the usability of a single display groupware either by a single user or people cooperating as a group. Interacting with Computers 24, 5 (2012), 423--437.
David Bertolo, Robin Vivian, and Jérome Dinet. 2013. A set of interactions to rotate solids in 3D geometry context. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. 625--630.
Bojan Blažica, Daniel Vladušič, and Dunja Mladenić. 2013. MTi: A method for user identification for multitouch displays. International Journal of Human-Computer Studies 71, 6 (2013), 691--702.
J. Brooke. 1996. SUS: A "quick and dirty" usability scale. In Usability evaluation in industry, P. W. JORDAN and et al. (Eds.). Taylor&Francis, London, 1--7.
Bill Buxton et al. 2007. Multi-touch systems that I have known and loved. Microsoft Research 56 (2007), 1--11.
Thiago Campos, Eduardo Damasceno, and Natasha M. C. Valentim. [n.d.]. Proposal and Evaluation of a Collaborative IS to Support Systematic Reviews and Mapping Studies. In Proceedings of the XVIII Brazilian Symposium on Information Systems (SBSI).
Antonia Cascales-Martínez, María-José Martínez-Segura, David Pérez-López, and Manuel Contero. 2016. Using an augmented reality enhanced tabletop system to promote learning of mathematics: A case study with students with special educational needs. Eurasia Journal of Mathematics, Science and Technology Education 13, 2 (2016), 355--380.
Zhiyong Chen, Juncong Lin, Guangyu Zhang, Wei Yang, Guilin Li, and Guohua Huang. 2016. A multi-touch interface for natural and seamless image composition. In 2016 11th International Conference on Computer Science & Education (ICCSE). IEEE, 796--801.
Gianluigi Ciocca, Paolo Olivo, and Raimondo Schettini. 2012. Browsing museum image collections on a multi-touch table. Information systems 37, 2 (2012), 169--182.
Ashley Colley, Jani Väyrynen, and Jonna Häkkilä. 2015. In-car touch screen interaction: Comparing standard, finger-specific and multi-finger interaction. In Proceedings of the 4th international symposium on pervasive displays. 131--137.
Jamie L Coram, Rob Iverson, and Andrew Ackerman. 2013. AstroTouch: a multi-touch digital desktop for astrodynamics. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 11--14.
Sashikanth Damaraju, Jinsil Hwaryoung Seo, Tracy Hammond, and Andruid Kerne. 2013. Multi-tap sliders: advancing touch interaction for parameter adjustment. In Proceedings of the 2013 international conference on Intelligent user interfaces. 445--452.
Tulio de Souza Alcantara, Pierre Bastianelli, Jennifer Ferreira, and Frank Maurer. 2012. A multi-touch approach to control MRI scans: A user-centered study report. In 2012 4th International Workshop on Software Engineering in Health Care (SEHC). IEEE, 65--68.
Jan Derboven, Dries De Roeck, and Mathijs Verstraete. 2012. Semiotic analysis of multi-touch interface design: The MuTable case study. International Journal of Human-Computer Studies 70, 10 (2012), 714--728.
Connor Dodd, Rukshan Athauda, and Marc Adam. 2017. Designing user interfaces for the elderly: a systematic literature review. (2017).
Julie Ducasse, Marc Macé, Bernard Oriola, and Christophe Jouffrais. 2018. Botmap: Non-visual panning and zooming with an actuated tabletop tangible interface. ACM Transactions on Computer-Human Interaction (TOCHI) 25, 4 (2018), 1--42.
Florian Echtler, Simon Nestler, Andreas Dippon, and Gudrun Klinker. 2009. Supporting casual interactions between board games on public tabletop displays and mobile devices. Personal and ubiquitous computing 13, 8 (2009), 609--617.
Hadziq Fabroyir. 2019. Multitouch Interface is not Good for Spatial Navigation in Virtual Reality. In 2019 12th International Conference on Information & Communication Technology and System (ICTS). IEEE, 323--326.
Saad Q Fleh, Oğuz Bayat, Saad Al-Azawi, and Osman Nuri Uçan. 2018. A systematic mapping study on touch classification. (2018).
Clifton Forlines, Daniel Wigdor, Chia Shen, and Ravin Balakrishnan. 2007. Direct-touch vs. mouse input for tabletop displays. In Proceedings of the SIGCHI conference on Human factors in computing systems. 647--656.
Georg Freitag, Michael Tränkner, and Markus Wacker. 2012. Enhanced feed-forward for a user aware multi-touch device. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design. 578--586.
Mathias Frisch, Ricardo Langner, and Raimund Dachselt. 2011. Neat: a set of flexible tools and gestures for layout tasks on interactive displays. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. 1--10.
Chi-Wing Fu, Wooi-Boon Goh, and Junxiang Allen Ng. 2010. Multi-touch techniques for exploring large-scale 3D astrophysical simulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2213--2222.
Emilien Ghomi, Stéphane Huot, Olivier Bau, Michel Beaudouin-Lafon, and Wendy E Mackay. 2013. Arpège: learning multitouch chord gestures vocabularies. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 209--218.
Alexander Giesler, Dimitar Valkov, and Klaus Hinrichs. 2014. Void shadows: multi-touch interaction with stereoscopic objects on the tabletop. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 104--112.
Guilherme Corredato Guerino and Natasha Malveira Costa Valentim. 2020. Usability and user experience evaluation of natural user interfaces: a systematic mapping study. IET Software 14, 5 (2020), 451--467.
Hejar Gürlük, Malte-Levin Jauer, and Maria Uebbing-Rumke. 2014. Design and evaluation of a multi-touch interaction language for approach controllers. In Proceedings of the International Conference on Human-Computer Interaction in Aerospace. 1--4.
Martin Hachet, Benoit Bossavit, Aurélie Cohé, and Jean-Baptiste de la Rivière. 2011. Toucheo: multitouch and stereo combined in a seamless workspace. In Proceedings of the 24th annual ACM symposium on User interface software and technology. 587--592.
Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91--97.
Hsien-Sheng Hsiao, Cheng-Sian Chang, Chien-Yu Lin, Chih-Chun Chang, and Jyun-Chen Chen. 2014. The influence of collaborative learning games within different devices on student's learning performance and behaviours. Australasian Journal of Educational Technology 30, 6 (2014).
Osvaldo Huerta, J Alfredo Sánchez, Salvador Fuentes, and Ofelia Cervantes. 2011. Speak up your mind: Using speech to capture innovative ideas on interactive surfaces. In Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction. 202--211.
ISO 9241-210. 2019. Ergonomics of Human System Interaction - Part 210: Human-Centered Design for Interactive Systems. International Organization for Standardization.
ISO/IEC 25010. 2011. Systems and Software Engineering - SquaRE - Software product Quality Requirements and Evaluation: System and Software Quality Models). International Organization for Standardization.
Giulio Jacucci, Ann Morrison, Gabriela T Richard, Jari Kleimola, Peter Peltonen, Lorenza Parisi, and Toni Laitinen. 2010. Worlds of information: designing for engagement at a public multi-touch display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2267--2276.
Hans-Christian Jetter, Jens Gerken, Michael Zöllner, Harald Reiterer, and Natasa Milic-Frayling. 2011. Materializing the query with facet-streams: a hybrid surface for collaborative search on tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3013--3022.
Johan Kildal, Andrés Lucero, and Marion Boberg. 2013. Twisting touch: combining deformation and touch as input within the same interaction cycle on handheld devices. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services. 237--246.
Seon Joo Kim, Hongwei Ng, Stefan Winkler, Peng Song, and Chi-Wing Fu. 2012. Brush-and-drag: A multi-touch interface for photo triaging. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. 59--68.
Yoon-Hyun Kim and Ji-Hyun Lee. 2015. Game interface enhancement under smartphone platform focused on touchscreen interaction. Computers & Industrial Engineering 80 (2015), 45--61.
Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing systematic literature reviews in software engineering. (2007).
Panagiotis Koutlemanis, Antonios Ntelidakis, Xenophon Zabulis, Dimitris Grammenos, and Ilia Adami. 2013. A steerable multitouch display for surface computing and its evaluation. International Journal on Artificial Intelligence Tools 22, 06 (2013), 1360016.
Alexander Kulik, André Kunert, Magdalena Keil, and Bernd Froehlich. 2018. RST 3D: A comprehensive gesture set for multitouch 3D navigation. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 363--370.
Felipe Eduardo Lammel, Isabel Harb Manssour, and Milene Selbach Silveira. 2016. Multi-touch Interaction with Information Visualization Techniques: An Analysis Using Twitter Data. In International Conference on Human-Computer Interaction. Springer, 211--222.
Ioannis Leftheriotis. 2013. User authentication in a multi-touch surface: a chord password system. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. 1725--1730.
Ioannis Leftheriotis, Michail N Giannakos, Konstantinos Chorianopoulos, and Letizia Jaccheri. 2015. Investigating the Potential of a Two-finger Chord Button in Multi-touch Applications. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces. 337--342.
Shuang Liang, Justin Cameron, and George Baciu. 2011. Generic gesture kernel modeling and its application with virtual garment design. In Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry. 279--286.
Roman Lissermann, Jochen Huber, Martin Schmitz, Jürgen Steimle, and Max Mühlhäuser. 2014. Permulin: mixed-focus collaboration on multi-view tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3191--3200.
Tahir Mustafa Madni, Yunus B Nayan, Suziah Sulaiman, Ahsanullah Abro, and Muhammad Tahir. 2016. Usability evaluation of orientation techniques for medical image analysis using tabletop system. In 2016 3rd International Conference on Computer and Information Sciences (ICCOINS). IEEE, 477--482.
Sômulo Nogueira Mafra, Rafael Ferreira Barcelos, and Guilherme Horta Travassos. 2006. Aplicando uma metodologia baseada em evidência na definição de novas tecnologias de software. In Proceedings of the 20th Brazilian Symposium on Software Engineering (SBES 2006), Vol. 1. 239--254.
Juan-Fernando Martin-SanJose, M-Carmen Juan, Ramón Mollá, and Roberto Vivó. 2017. Advanced displays and natural user interfaces to support learning. Interactive Learning Environments 25, 1 (2017), 17--34.
Walid Merrad, Alexis Héloir, Christophe Kolski, and Antonio Krüger. 2022. RFID-based tangible and touch tabletop for dual reality in crisis management context. Journal on Multimodal User Interfaces 16, 1 (2022), 31--53.
Mark Micire, Munjal Desai, Jill L Drury, Eric McCann, Adam Norton, Katherine M Tsui, and Holly A Yanco. 2011. Design and validation of two-handed multi-touch tabletop controllers for robot teleoperation. In Proceedings of the 16th international conference on Intelligent user interfaces. 145--154.
Annette Mossel, Benjamin Venditti, and Hannes Kaufmann. 2013. 3DTouch and HOMER-S: intuitive manipulation techniques for one-handed handheld augmented reality. In Proceedings of the Virtual Reality International Conference: Laval Virtual. 1--10.
Thomas Muender, Sadaab Ali Gulani, Lauren Westendorf, Clarissa Verish, Rainer Malaka, Orit Shaer, and Seth Cooper. 2019. Comparison of mouse and multi-touch for protein structure manipulation in a citizen science game interface. Journal of Science Communication 18, 1 (2019), A05.
Vicente Nacher and Javier Jaen. 2015. Evaluating the accuracy of pre-kindergarten children multi-touch interaction. In IFIP Conference on Human-Computer Interaction. Springer, 549--556.
Vicente Nacher, Javier Jaen, Elena Navarro, Alejandro Catala, and Pascual González. 2015. Multi-touch gestures for pre-kindergarten children. International journal of human-computer studies 73 (2015), 37--51.
Fatih Nayebi, Jean-Marc Desharnais, and Alain Abran. 2012. The state of the art of mobile application usability evaluation. In 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE). IEEE, 1--4.
Alex Olwal, Steven Feiner, and Susanna Heyman. 2008. Rubbing and tapping for precise and rapid selection on touch-screen displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 295--304.
Max Pfeiffer, Dagmar Kern, Johannes Schöning, Tanja Döring, Antonio Krüger, and Albrecht Schmidt. 2010. A multi-touch enabled steering wheel: exploring the design space. In CHI'10 Extended Abstracts on Human Factors in Computing Systems. 3355--3360.
Srinivasan Radhakrishnan, Yingzi Lin, Ibrahim Zeid, and Sagar Kamarthi. 2013. Finger-based multitouch interface for performing 3D CAD operations. International Journal of Human-Computer Studies 71, 3 (2013), 261--275.
Roman Rädle, Hans-Christian Jetter, Simon Butscher, and Harald Reiterer. 2013. The effect of egocentric body movements on users' navigation performance and spatial memory in zoomable user interfaces. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 23--32.
Adriano Bernardo Renzi and Sydney Freitas. 2014. Affordances and gestural interaction on multi-touch interface systems: building new mental models. In International Conference of Design, User Experience, and Usability. Springer, 615--623.
Ivan Rodriguez-Conde and Celso Campos. 2020. Towards customer-centric additive manufacturing: making human-centered 3D design tools through a handheld-based multi-touch user interface. Sensors 20, 15 (2020), 4255.
Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344--360.
Gleison Santos, Ana Regina Rocha, Tayana Conte, Monalessa Perini Barcellos, and Rafael Prikladnicki. 2012. Strategic alignment between academy and Industry: a Virtuous Cycle to Promote Innovation in Technology. In 2012 26th Brazilian Symposium on Software Engineering. IEEE, 196--200.
Tim Schürmann, Christina Binder, Gesche Janzarik, and Joachim Vogt. 2015. Movement transformation on multi-touch devices: Intuition or instructional preparation? Applied Ergonomics 50 (2015), 251--255.
Ben Shneiderman. 1981. Direct manipulation: A step beyond programming languages. In Proceedings of the Joint Conference on Easier and More Productive Use of Computer Systems.(Part-II): Human Interface and the User Interface-Volume 1981. 143.
Forrest Shull, Jeffrey Carver, and Guilherme H Travassos. 2001. An empirical methodology for introducing software processes. ACM SIGSOFT Software Engineering Notes 26, 5 (2001), 288--296.
Can Telkenaroglu and Tolga Capin. 2013. Dual-finger 3d interaction techniques for mobile devices. Personal and ubiquitous computing 17, 7 (2013), 1551--1572.
Po-Huan Tseng, Shih-Hsuan Hung, Pei-Ying Chiang, Chih-Yuan Yao, and Hung-Kuo Chu. 2018. EZ-Manipulator: Designing a mobile, fast, and ambiguity-free 3D manipulation interface using smartphones. Computational Visual Media 4, 2 (2018), 139--147.
Philip Tuddenham, David Kirk, and Shahram Izadi. 2010. Graspables revisited: multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks. In Proceedings of the SIGCHI conference on human factors in computing systems. 2223--2232.
Elena Tuveri, Samuel A Iacolina, Fabio Sorrentino, L Davide Spano, and Riccardo Scateni. 2013. Controlling a planetarium software with a Kinect or in a multi-touch table: a comparison. In Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI. 1--4.
Maria Uebbing-Rumke, Hejar Gürlük, Malte-Levin Jauer, Konrad Hagemann, and Andreas Udovic. 2014. Usability evaluation of multi-touch displays for TMA controller working positions. Proceedings of the 4th SESAR Innovation Days, Madrid, Spain (2014), 25--27.
Peter Vorderer, Werner Wirth, Feliz Ribeiro Gouveia, Frank Biocca, Timo Saari, Lutz Jäncke, Saskia Böcking, Holger Schramm, Andre Gysbers, Tilo Hartmann, et al. 2004. Mec spatial presence questionnaire. Retrieved Sept 18 (2004), 2015.
Julie Wagner, Stéphane Huot, and Wendy Mackay. 2012. BiTouch and BiPad: designing bimanual interaction for hand-held tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2317--2326.
Jia Wang and Rob Lindeman. 2012. Leaning-based travel interfaces revisited: frontal versus sidewise stances for flying in 3D virtual spaces. In Proceedings of the 18th ACM symposium on Virtual reality software and technology. 121--128.
Jia Wang and Robert Lindeman. 2014. Coordinated 3D interaction in tablet-and HMD-based hybrid virtual environments. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 70--79.
Jia Wang and Robert Lindeman. 2015. Coordinated hybrid virtual environments: Seamless interaction contexts for effective virtual reality. Computers & Graphics 48 (2015), 71--83.
Diane Watson, Mark Hancock, Regan L Mandryk, and Max Birk. 2013. Deconstructing the touch experience. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 199--208.
Benjamin Wingert, Isabel Schöllhorn, and Matthias Bues. 2017. Prodesk: An interactive ubiquitous desktop surface. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. 366--371.
Panagiotis Zaharias, Despina Michael, and Yiorgos Chrysanthou. 2013. Learning through multi-touch interfaces in museum exhibits: An empirical investigation. Journal of Educational Technology & Society 16, 3 (2013), 374--384.
Chi Zhang, Deepak Ranjan Sahoo, Jennifer Pearson, Simon Robinson, Mark D Holton, Philip Hopkins, and Matt Jones. 2020. Active PinScreen: Exploring Spatio-Temporal Tactile Feedbackfor Multi-Finger Interaction. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. 1--11.
Publicado
17/10/2022
Como Citar
KONOPATZKI FILHO, Guilherme E.; GUERINO, Guilherme Corredato; VALENTIM, Natasha M. C..
A systematic mapping study on usability and user eXperience evaluation of multi-touch systems. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 21. , 2022, Diamantina.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
