Skip to main content
SpringerLink
Log in

An Open Source Eye Gaze Tracker System to Perform Remote User Testing Evaluations

  • Conference paper
  • First Online:
Intelligent Systems (BRACIS 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14197))

Included in the following conference series:

  • 259 Accesses

Abstract

Eye gaze trackers are devices designed to identify an individual’s gaze fixation in relation to a screen or another reference point. These tools are widely applied in usability testing as they provide various metrics for studying how people interact with applications. In the past, these tools were expensive and required a controlled environment, as well as trained personnel for proper operation. Although nowadays, new implementations do not require physical hardware to perform these tests, they often rely on license-based models instead of being open source. The objective of this work is to create a standalone system that enables any user to implement a low-cost eye gaze tracker using web technologies. The goal is to facilitate its use in remote and face-to-face studies in a simple way, requiring only a computer and a webcam. We evaluated the impact of three different calibration techniques on the performance of a regression-based prediction algorithm in eye-tracking. In our experiments, the best result of linear regression was obtained with a circular calibration system that uses 160 points. Furthermore, we integrated the system with a web interface and an API, enabling users to record their usability sessions and analyze fixation points through heatmaps.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Remote User Experience LAB (RUXLAB). Available at: https://github.com/uramakilab/remote-usability-lab.

  2. 2.

    ISO/CD 9241-11: Ergonomics of human-system interaction - Part 11: Guidance on usability (1998). Available at: https://www.iso.org/standard/63500.html. Accessed date: September 15, 2023.

  3. 3.

    Global leader in eye tracking for over 20 years - Tobii. Available at: https://www.tobii.com/. Accessed date: September 15, 2023.

  4. 4.

    Pupil Invisible - Eye tracking glasses for the real world - Pupil Labs. Available at: https://pupil-labs.com/. Accessed date: September 15, 2023.

  5. 5.

    Remote User Experience LAB. Available at: https://retlab.web.app/. Accessed date: September 15, 2023.

  6. 6.

    OpenAPI Specification - Version 3.0.3. Available at: https://swagger.io/specification/. Accessed date: September 15, 2023.

  7. 7.

    TensorFlow.js: Face Landmarks Detection. Available at: https://github.com/tensorflow/tfjs-models/tree/master/face-landmarks-detection. Accessed date: September 15, 2023.

  8. 8.

    Tensorflow Javascript. Available at: https://www.tensorflow.org/js. Accessed date: September 15, 2023.

  9. 9.

    MediaPipe. Available at: https://developers.google.com/mediapipe. Accessed date: September 15, 2023.

  10. 10.

    Vuejs. Available at: https://vuejs.org/ Accessed date: September 15, 2023.

  11. 11.

    Vue Component Framework. Available at: https://vuetifyjs.com/. Accessed date: September 15, 2023.

  12. 12.

    Material Design. Available at: https://m2.material.io/design/guidelines-overview Accessed date: September 15, 2023.

  13. 13.

    MediaDevices - Web APIs | MDN. Available at: https://developer.mozilla.org/es/docs/Web/API/MediaDevices. Accessed date: September 15, 2023.

  14. 14.

    MediaRecorder - Web APIs | MDN. Available at: https://developer.mozilla.org/en-US/docs/Web/API/MediaRecorder. Accessed date: September 15, 2023.

  15. 15.

    Firebase. Available at: https://firebase.google.com/. Accessed date: September 15, 2023.

  16. 16.

    Dynamic heatmap for the web. Available at: https://www.patrick-wied.at/static/heatmapjs/. Accessed date: September 15, 2023.

  17. 17.

    Available at: https://github.com/uramakilab/web-eye-tracker. Accessed date: September 15, 2023.

References

  1. Agustin, J.S., et al.: Evaluation of a low-cost open-source gaze tracker. In: Proceedings of the 2010 Symposium on eye-tracking research & applications, pp. 77–80 (2010)

    Google Scholar 

  2. Ahn, H., Jeon, J., Ko, D., Gwak, J., Jeon, M.: Contactless real-time eye gaze-mapping system based on simple Siamese networks. Appl. Sci. 13(9) (2023). https://doi.org/10.3390/app13095374

  3. Bastien, J.C.: Usability testing: a review of some methodological and technical aspects of the method. Int. J. Med. Inform. 79(4), e18–e23 (2010)

    Article  Google Scholar 

  4. Bevan, N.: What is the difference between the purpose of usability and user experience evaluation methods. In: Proceedings of the Workshop UXEM. vol. 9, pp. 1–4. Citeseer (2009)

    Google Scholar 

  5. Biedert, R., Buscher, G., Dengel, A.: The eye book. Informatik-Spektrum 33(3), 272–281 (2009)

    Article  Google Scholar 

  6. Braunschweig, K., Eberius, J., Thiele, M., Lehner, W.: The state of open data. Limits Curr. Open Data Platforms 1, 72–72 (2012)

    Google Scholar 

  7. Brooke, J., et al.: Sus-a quick and dirty usability scale. Usability Eval. Indust. 189(194), 4–7 (1996)

    Google Scholar 

  8. Capdevila, M.G., Saltiveri, T.G.: Heurísticas de usabilidad utilizando una plataforma abierta y colaborativa. V Congreso Internacional de Ciencias de la Computación y Sistemas de Información 2021 (2022)

    Google Scholar 

  9. Carter, B.T., Luke, S.G.: Best practices in eye tracking research. Int. J. Psychophysiol. 155, 49–62 (2020)

    Article  Google Scholar 

  10. Castillo, J.C., Hartson, H.R., Hix, D.: Remote usability evaluation: can users report their own critical incidents? In: CHI 98 Conference Summary on Human Factors In Computing Systems, pp. 253–254 (1998)

    Google Scholar 

  11. Chennamma, H., Yuan, X.: A survey on eye-gaze tracking techniques. arXiv preprint arXiv:1312.6410 (2013)

  12. Dalmaijer, E.S.: Pygaze: an open-source, cross-platform toolbox for minimal-effort programming of eyetracking experiments. Behav. Res. Methods 46(4), 913–931 (2014)

    Article  Google Scholar 

  13. Ferhat, Onur e Vilariño, F.: Rastreamento ocular de baixo custo: o panorama atual. Inteligência computacional e neurociência 2016 (2016)

    Google Scholar 

  14. Ferhat, O., Vilarino, F., Sánchez, F.J.: A cheap portable eye-tracker solution for common setups. J. Eye Movement Res. 7(3) (2014)

    Google Scholar 

  15. Frøkjær, E., Hertzum, M., Hornbæk, K.: Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In: Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pp. 345–352 (2000)

    Google Scholar 

  16. Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014)

    Google Scholar 

  17. Hart, S.G.: Nasa-task load index (nasa-tlx); 20 years later. In: Proceedings of the human factors and ergonomics society annual meeting. vol. 50, pp. 904–908. Sage publications Sage CA: Los Angeles, CA (2006)

    Google Scholar 

  18. Hassan, H.M., Galal-Edeen, G.H.: From usability to user experience. In: 2017 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp. 216–222. IEEE (2017)

    Google Scholar 

  19. Hertzum, M., Borlund, P., Kristoffersen, K.B.: What do thinking-aloud participants say? a comparison of moderated and unmoderated usability sessions. Int. J. Human-Comput. Interact. 31(9), 557–570 (2015)

    Article  Google Scholar 

  20. Holanda, Corey e Komogortsev, O.: Eye tracking em tablets comuns não modificados: desafios e soluções. In: Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 277–280 (2012)

    Google Scholar 

  21. Holmqvist, K., Nyström, M., Mulvey, F.: Eye tracker data quality: What it is and how to measure it. In: Proceedings of the symposium on eye tracking research and applications, pp. 45–52 (2012)

    Google Scholar 

  22. Hwang, B.J., Chen, H.H., Hsieh, C.H., Huang, D.Y.: Gaze tracking based on concatenating spatial-temporal features. Sensors 22(2), 545 (2022). https://doi.org/10.3390/s22020545

  23. Jain, A.K., Li, S.Z.: Handbook of face recognition, vol. 1. Springer (2011)

    Google Scholar 

  24. Jordan, P.W.: An introduction to usability. CRC Press (1998)

    Google Scholar 

  25. Kanade, P., David, F., Kanade, S.: Convolutional neural networks (CNN) based eye-gaze tracking system using machine learning algorithm. Europ. J. Electr. Eng. Comput. Sci. 5(2), 36–40 (2021)

    Article  Google Scholar 

  26. Karlsson, H., Berglund, E., Larsson, J.: Method and apparatus for eye tracking (2014). https://patents.google.com/patent/US8723875B2/, the Eye Tribe Aps

  27. Kassner, M., Patera, W., Bulling, A.: Pupil: An open source platform for pervasive eye tracking and mobile gaze-based interaction. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunctpublication, pp. 1151–1160 (2014)

    Google Scholar 

  28. Kim, J.H., Jeong, J.W.: Gaze estimation in the dark with generative adversarial networks. In: ACM Symposium on Eye Tracking Research and Applications. ETRA ’20 Adjunct, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3379157.3391654

  29. Krafka, K., et al.: Eye tracking for everyone. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2176–2184 (2016)

    Google Scholar 

  30. Kuling, E., et al.: Myeye: an open-source wearable gaze tracker. In: Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 1–10. ACM (2019)

    Google Scholar 

  31. Lee, S.: Understanding face detection with the viola-jones object detection framework. Towards data science (2020)

    Google Scholar 

  32. Li, D., Babcock, J., Parkhurst, D.J.: Openeyes: a low-cost head-mounted eye-tracking solution. In: Proceedings of the 2006 symposium on Eye tracking research & applications, pp. 95–100 (2006)

    Google Scholar 

  33. Lim, J.Z., Mountstephens, J., Teo, J.: Emotion recognition using eye-tracking: taxonomy, review and current challenges. Sensors 20(8), 2384 (2020)

    Article  Google Scholar 

  34. Madathil, K.C., Greenstein, J.S.: An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing. Appl. Ergon. 65, 501–514 (2017)

    Article  Google Scholar 

  35. Manhartsberger, M., Zellhofer, N.: Eye tracking in usability research: What users really see. In: Usability Symposium. vol. 198, pp. 141–152 (2005)

    Google Scholar 

  36. Martins, A.I., Queirós, A., Silva, A.G., Rocha, N.P.: Usability evaluation methods: a systematic review. Human Factors Softw. Develop. Design 250–273 (2015)

    Google Scholar 

  37. Nielsen, J.: Usability laboratories. Behav. Inform. Technol. 13(1–2), 3–8 (1994)

    Article  Google Scholar 

  38. Nielsen, J., Pernice, K.: Eyetracking web usability. New Riders Publishing (2003)

    Google Scholar 

  39. Ooms, K., Dupont, L., Lapon, L., Popelka, S.: Accuracy and precision of fixation locations recorded with the low-cost eye tribe tracker in different experimental setups. J. Eye Movement Res. 8(1) (2015)

    Google Scholar 

  40. Palmero, C., Selva, J., Bagheri, M.A., Escalera, S.: Recurrent CNN for 3D gaze estimation using appearance and shape cues (2018)

    Google Scholar 

  41. Papoutsaki, A., Laskey, J., Huang, J.: Searchgazer: Webcam eye tracking for remote studies of web search. In: Proceedings of the 2017 Conference On Conference Human Information Interaction and Retrieval, pp. 17–26 (2017)

    Google Scholar 

  42. Pedregosa, F., et al.: Scikit-learn: Machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011)

    Google Scholar 

  43. Pernice, K., Nielsen, J.: How to conduct eyetracking studies. Nielsen Norman Group 945397498 (2009)

    Google Scholar 

  44. Poole, A., Ball, L.J.: Eye tracking in HCI and usability research. In: Encyclopedia of human computer interaction, pp. 211–219. IGI global (2006)

    Google Scholar 

  45. Sauro, J.: things to know about the single ease question (seq). Measuring U 2012 (2012)

    Google Scholar 

  46. Scholtz, J.: Adaptation of traditional usability testing methods for remote testing. In: Proceedings of the 34th Annual Hawaii International Conference on System Sciences, pp. 8-pp. IEEE (2001)

    Google Scholar 

  47. Shehu, I.S., Wang, Y., Athuman, A.M., Fu, X.: Remote eye gaze tracking research: a comparative evaluation on past and recent progress. Electronics 10(24), 3165 (2021)

    Article  Google Scholar 

  48. Sjöberg, A., Rominger, M.: Beyond hand-eye coordination: An exploration of eye-tracking and speech recognition as a navigation tool for interactive systems (2015)

    Google Scholar 

  49. Skodras, E., Kanas, V.G., Fakotakis, N.: On visual gaze tracking based on a single low cost camera. Signal Process. Image Commun. 36, 29–42 (2015)

    Article  Google Scholar 

  50. Sogo, H.: Gazeparser: an open-source and multiplatform library for low-cost eye tracking and analysis. Behav. Res. Methods 45, 684–695 (2013)

    Article  Google Scholar 

  51. Thompson, K.E., Rozanski, E.P., Haake, A.R.: Here, there, anywhere: remote usability testing that works. In: Proceedings of the 5th Conference on Information Technology Education, pp. 132–137 (2004)

    Google Scholar 

  52. Venugopal, D., Amudha, J., Jyotsna, C.: Developing an application using eye tracker. In: 2016 IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT), pp. 1518–1522. IEEE (2016)

    Google Scholar 

  53. Voßkühler, A., Nordmeier, V., Kuchinke, L., Jacobs, A.M.: Ogama (open gaze and mouse analyzer): open-source software designed to analyze eye and mouse movements in slideshow study designs. Behav. Res. Methods 40, 1150–1162 (2008)

    Article  Google Scholar 

  54. Wisiecka, K., et al.: Comparison of webcam and remote eye tracking. In: 2022 Symposium on Eye Tracking Research and Applications, pp. 1–7 (2022)

    Google Scholar 

  55. Wood, E., Bulling, A.: Eyetab: Model-based gaze estimation on unmodified tablet computers. In: Proceedings of ETRA (2014). http://www.cl.cam.ac.uk/research/rainbow/projects/eyetab/

  56. Zhang, M., Bulling, A.: Xlabs: A platform for rapid design, prototyping and evaluation of ubiquitous gaze interfaces. In: Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 69–76. ACM (2018)

    Google Scholar 

  57. Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. (CSUR) 35(4), 399–458 (2003)

    Article  Google Scholar 

  58. Zielinski, P.: Opengazer: open-source gaze tracker for ordinary webcams. Samsung and The Gatsby Charitable Foundation. http://www.inference.phy.cam.ac.uk/opengazer (2007)

Download references

Author information

Authors and Affiliations

  1. Facens University, Sorocaba, São Paulo, Brazil

    Marc G. Capdevila, Karine Aparecida P. Rodrigues, Camila F. Jardim & Renato M. Silva

Authors
  1. Marc G. Capdevila
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karine Aparecida P. Rodrigues
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Camila F. Jardim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Renato M. Silva
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marc G. Capdevila .

Editor information

Editors and Affiliations

  1. Federal University of São Carlos, São Carlos, Brazil

    Murilo C. Naldi

  2. Centro Universitario da FEI, São Bernardo do Campo, Brazil

    Reinaldo A. C. Bianchi

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Capdevila, M.G., Rodrigues, K.A.P., Jardim, C.F., Silva, R.M. (2023). An Open Source Eye Gaze Tracker System to Perform Remote User Testing Evaluations. In: Naldi, M.C., Bianchi, R.A.C. (eds) Intelligent Systems. BRACIS 2023. Lecture Notes in Computer Science(), vol 14197. Springer, Cham. https://doi.org/10.1007/978-3-031-45392-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-45392-2_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-45391-5

  • Online ISBN: 978-3-031-45392-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation