UX-Tracking: Web and Multimodal Tool for User Experience Evaluation

  • Danilo Teixeira Lima UFPA
  • Flavio Rafael Trindade Moura UFPA
  • André Vinicius Neve Alves UFPA
  • Thiago de Moura Parracho UNIRIO
  • Rodrigo Oliveira Zacarias UNIRIO
  • Rodrigo Pereira dos Santos UNIRIO
  • Marcos César da Rocha Seruffo UFPA


Different markets have increasingly sought to offer personalized experiences in the use of their products and/or services. From that, this work presents UX-Tracking, a web tool for multimodal capture that adds a set of tracking techniques to allow User Experience (UX) evaluation. UX-Tracking allows you to simultaneously track mouse, eye, keyboard, history and, in the future, voice data in a single session with the user. This factor contributes to greater accuracy in UX assessments, since the interaction can be analyzed from different perspectives. As such, UX-Tranking is expected to be an alternative for researchers and professionals from academia and industry to improve quality of interaction with products and services in digital interfaces accessed via a web browser.
Palavras-chave: UX-Tracking, User Experience Evaluation, Multimodal Tool, Mouse Tracking, Eye Tracking


Igor Leonardo Aviz, Kennedy Edson Souza, Elison Ribeiro, Harold de Mello Junior, and Marcos César da R Seruffo. 2019. Comparative study of user experience evaluation techniques based on mouse and gaze tracking. In Proceedings of the 25th Brazillian symposium on multimedia and the Web. 53–56.

Kennedy Edson Silva de Souza, Rodrigo Oliveira Zacarias, Marcos César da Rocha Seruffo, and Rodrigo Pereira dos Santos. 2020. T2-UXT: A Tool to Support Transparency Evaluation in Software Ecosystems Portals. In Proceedings of the 34th Brazilian Symposium on Software Engineering. 415–420.

ISO 9241-11 2018. Ergonomics of human-system interaction – Part 11: Usability: Definitions and concepts. Standard. International Organization for Standardization.

Tzafilkou Katerina and Protogeros Nicolaos. 2018. Mouse behavioral patterns and keystroke dynamics in End-User Development: What can they tell us about users’ behavioral attributes? Computers in Human Behavior 83 (2018), 288–305.

Danilo Teixeira Lima, Flavio Rafael Trindade Moura, Kennedy Edson Silva de Souza, Rita de Cássia Romeiro Paulino, and Marcos César da Rocha Seruffo. 2022. Rastreamento de mouse para avaliação de Experiência do Usuário em Portais de Notícias: Um Estudo de Caso. Atena Editora 2 (2022).

Danilo Teixeira Lima, Rodrigo Oliveira Zacarias, Kennedy Edson Silva de Souza, Rodrigo Pereira dos Santos, and Marcos César da Rocha Seruffo. 2021. Analytical Model for Classifying Areas of Interest in Interactive Systems. In Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems. 1–6.

Peter Morville. 2004. User experience honeycomb. Web Log Post] Retrieved from http://semanticstudios.com/publications/semantics/000029. Php 21 (2004), 09–12.

Kazi Md Munim, Iyolita Islam, Mahmuda Khatun, Md Mahboob Karim, and Muhammad Nazrul Islam. 2017. Towards developing a tool for UX evaluation using facial expression. In 2017 3rd international conference on Electrical Information and Communication Technology (EICT). IEEE, 1–6.

Don Norman, Jim Miller, and Austin Henderson. 1995. What you see, some of what’s in the future, and how we go about doing it: HI at Apple Computer. In Conference companion on Human factors in computing systems. 155.

Chiu-Fang Peng and Wen-Hung Liao. 2016. Evaluation of interactive data visualization tools based on gaze and mouse tracking. In 2016 IEEE International Symposium on Multimedia (ISM). IEEE, 431–434.

S Rajeshkumar, Ridha Omar, and Murni Mahmud. 2013. Taxonomies of user experience (UX) evaluation methods. In 2013 International Conference on Research and Innovation in Information Systems (ICRIIS). IEEE, 533–538.

Juni Nurma Sari, Lukito Edi Nugroho, Ridi Ferdiana, and Paulus Insap Santosa. 2018. Evaluation of fixation duration accuracy in determining selected product on E-commerce. In 2018 10th International Conference on Information Technology and Electrical Engineering (ICITEE). IEEE, 146–151.

Martin Schrepp, Andreas Hinderks, and Jörg Thomaschewski. 2014. Applying the user experience questionnaire (UEQ) in different evaluation scenarios. In International Conference of Design, User Experience, and Usability. Springer, 383–392.

Kennedy ES Souza, Marcos CR Seruffo, Harold D De Mello, Daniel da S Souza, and Marley MBR Vellasco. 2019. User experience evaluation using mouse tracking and artificial intelligence. IEEE Access 7 (2019), 96506–96515.

Kennedy Edson Silva de Souza, Igor Leonardo de Aviz, Harold Dias de Mello, Karla Figueiredo, Marley Maria Bernardes Rebuzzi Vellasco, Fernando Augusto Ribeiro Costa, and Marcos Cesar da Rocha Seruffo. 2022. An Evaluation Framework for User Experience Using Eye Tracking, Mouse Tracking, Keyboard Input, and Artificial Intelligence: A Case Study. International Journal of Human–Computer Interaction 38, 7 (2022), 646–660.

UX-Tracking. 2022. Apresentação da ferramenta UX-Tracking. https://www.youtube.com/watch?v=0F9DTSGTAzM
Como Citar

Selecione um Formato
LIMA, Danilo Teixeira; MOURA, Flavio Rafael Trindade; ALVES, André Vinicius Neve; PARRACHO, Thiago de Moura; ZACARIAS, Rodrigo Oliveira; SANTOS, Rodrigo Pereira dos; SERUFFO, Marcos César da Rocha. UX-Tracking: Web and Multimodal Tool for User Experience Evaluation. In: WORKSHOP DE FERRAMENTAS E APLICAÇÕES - SIMPÓSIO BRASILEIRO DE SISTEMAS MULTIMÍDIA E WEB (WEBMEDIA), 28. , 2022, Curitiba. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2022 . p. 107-110. ISSN 2596-1683. DOI: https://doi.org/10.5753/webmedia_estendido.2022.226527.