UQE-3D: a usability evaluation method of 3D user interfaces for the elderly
Keywords:3D user interface, elderly, evaluation, UQE-3D, usability
Health professionals could use 3D user interfaces to support elderly rehabilitation, offering fun and engagement during physical and cognitive activities. The evaluation of these immersive applications needs instruments designed for the specific context. This study presents and validates a new usability evaluation method for 3D user interfaces for the elderly. We developed the UQE-3D questionnaire from previous studies keeping in mind the 3D aspects and technological language suitable for the target public. To apply it, we used a protocol considering a demographic questionnaire, the Mini-Mental State Exam, the 15-item Geriatric Depression Scale, the SUS Scale, the UQE-3D, and a structured interview. We also executed an experiment considering a heterogeneous group with 30 subjects (60+ years), where seven participants were institutionalized elderly. UQE-3D presented good results showing a mean score of 82.60 (range 1-100). UQE-3D and SUS scores did not show a statistically significant difference, highlighting the UQE-3D to be sufficient and effective in identifying the usability issues seen in the assessment of 3D user interfaces for the elderly. The method has the potential to evaluate and ensure the quality of 3D context-specific applications, considering appropriate terminology and contributing to the development of technologies fitting for the elderly.
Almeida, O. P. and Almeida, S. A. (1999). Reliability of the brazilian version of the geriatric depression scale (GDS) short form. Arquivos de Neuro-psiquiatria, 57(2B):421–426.
Aminov, A., Rogers, J. M., Middleton, S., Caeyenberghs, K., and Wilson, P. H. (2018). What do randomized controlled trials say about virtual rehabilitation in stroke? a systematic literature review and meta-analysis of upper-limb and cognitive outcomes. Journal of neuroengineering and rehabilitation, 15(1):1–24.
Báez, M., Ibarra, F., Far, I. K., Ferron, M., and Casati, F. (2016). Online group-exercises for older adults of different physical abilities. In 2016 International Conference on Collaboration Technologies and Systems (CTS), pages 524–533. IEEE.
Brace, I. (2018). Questionnaire design: How to plan, structure and write survey material for effective market research. Kogan Page Publishers.
Brooke, J. (1996). SUS-a quick and dirty usability scale. Usability evaluation in industry, 189(194):4–7.
Brucki, S., Nitrini, R., Caramelli, P., Bertolucci, P., and Okamoto, I. H. (2003). Suggestions for utilization of the mini-mental state examination in Brazil. Arquivos de neuro-psiquiatria, 61(3B):777–781.
Burdea, G. C. and Coiffet, P. (2003). Virtual reality technology. John Wiley & Sons.
Cockton, G. (2013). The Encyclopedia of Human-Computer Interaction, chapter Usability Evaluation, pages 817–940. Interaction Design Foundation, 2 edition.
Cota, T. T., Ishitani, L., and Vieira Jr, N. (2015). Mobile game design for the elderly: A study with focus on the motivation to play. Computers in Human Behavior, 51:96–105.
Fua, K. C., Gupta, S., Pautler, D., and Farber, I. (2013). Designing serious games for elders. In FDG, pages 291–297.
Hahs-Vaughn, D. L. and Lomax, R. G. (2013). Statistical Concepts-A Second Course: A Second Course. Routledge.
Hall, A. K. and Marston, H. (2015). Games for health in the home: Gaming and older adults in the digital age of healthcare. Handbook of Smart Homes, Health Care, and Well-being. Charn, Switzerland: Springer International Publishing.
Huang, H.-M., Rauch, U., and Liaw, S.-S. (2010). Investigating learners’ attitudes toward virtual reality learning environments: Based on a constructivist approach. Computers & Education, 55(3):1171–1182.
Huygelier, H., Schraepen, B., van Ee, R., Abeele, V. V., and Gillebert, C. R. (2019). Acceptance of immersive head-mounted virtual reality in older adults. Scientific reports, 9(1):1–12.
Indrayan, A. and Malhotra, R. K. (2017). Medical biostatistics. CRC Press.
Khaled, A. B. H., Khalfallah, A., and Bouhlel, M. S. (2018). Fall prevention exergame using occupational therapy based on kinect. In International conference on the Sciences of Electronics, Technologies of Information and Telecommunications, pages 479–493. Springer.
Kharoub, H., Lataifeh, M., and Ahmed, N. (2019). 3D user interface design and usability for immersive VR. Applied Sciences, 9(22):4861.
Konstantinidis, E. I., Billis, A. S., Mouzakidis, C. A., Zilidou, V. I., Antoniou, P. E., and Bamidis, P. D. (2014). Design, implementation, and wide pilot deployment of FitForAll: an easy to use exergaming platform improving physical fitness and life quality of senior citizens. IEEE journal of biomedical and health informatics, 20(1):189–200.
Krosnick, J. A. (2018). Questionnaire design. In The Palgrave handbook of survey research, pages 439–455. Springer.
LaViola Jr, J. J., Kruijff, E., McMahan, R. P., Bowman, D., and Poupyrev, I. P. (2017). 3D user interfaces: theory and practice. Addison-Wesley Professional.
Lee, C. C., Czaja, S. J., Moxley, J. H., Sharit, J., Boot, W. R., Charness, N., and Rogers, W. A. (2019). Attitudes toward computers across adulthood from 1994 to 2013. The Gerontologist, 59(1):22–33.
Lewis, J. R. (2018). The System Usability Scale: Past, present, and future. International Journal of Human–Computer Interaction, 34(7):577–590.
Lourenço, R. A. and Veras, R. P. (2006). Mini-Mental State Examination: psychometric characteristics in elderly outpatients. Revista de saúde pública, 40:712–719.
Miller, K. K., Porter, R. E., DeBaun-Sprague, E., Van Puymbroeck, M., and Schmid, A. A. (2017). Exercise after stroke: patient adherence and beliefs after discharge from rehabilitation. Topics in stroke rehabilitation, 24(2):142–148.
Nielsen, J. (1994). Enhancing the explanatory power of usability heuristics. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pages 152–158.
Nielsen, J. (1996). Usability metrics: Tracking interface improvements. IEEE software, 13(6):1–2.
Osagie, E., Waqar, M., Adebayo, S., Stasiewicz, A., Porwol, L., and Ojo, A. (2017). Usability evaluation of an open data platform. In Proceedings of the 18th Annual International Conference on Digital Government Research, pages 495–504.
Osmanovic, S. and Pecchioni, L. (2016). Beyond entertainment: Motivations and outcomes of video game playing by older adults and their younger family members. Games and Culture, 11(1-2):130–149.
Postal, M. R. B. and Rieder, R. (2019a). A usability evaluation experiment of 3D user interfaces for elderly. Revista Brasileira de Computação Aplicada, 11(3):28–38.
Postal, M. R. B. and Rieder, R. (2019b). User interface evaluation methods for elderly: A systematic review. In 2019 21st Symposium on Virtual and Augmented Reality (SVR), pages 84–91. IEEE.
Sheikh, J. I. and Yesavage, J. A. (1986). Geriatric Depression Scale (GDS): recent evidence and development of a shorter version. Clinical Gerontologist: The Journal of Aging and Mental Health.
Simor, F. W. (2016). Usability evaluation method for serious games with gestural interaction for seniors. Master's thesis, University of Passo Fundo, Passo Fundo, RS, Brazil.
Solano, A., Collazos, C. A., Rusu, C., and Fardoun, H. M. (2016). Combinations of methods for collaborative evaluation of the usability of interactive software systems. Advances in Human-Computer Interaction, 2016.
Tieri, G., Morone, G., Paolucci, S., and Iosa, M. (2018). Virtual reality in cognitive and motor rehabilitation: facts, fiction and fallacies. Expert review of medical devices, 15(2):107–117.
Trombetta, M., Henrique, P. P. B., Brum, M. R., Colussi, E. L., De Marchi, A. C. B., and Rieder, R. (2017). Motion Rehab AVE 3D: A VR-based exergame for post-stroke rehabilitation. Computer methods and programs in biomedicine, 151:15–20.
How to Cite
Copyright (c) 2023 Manoela Rogofski Brum Postal, Luciane Daroit, Rafael Rieder
This work is licensed under a Creative Commons Attribution 4.0 International License.
JIS is free of charges for both authors and readers, and all papers published by JIS follow the Creative Commons Attribution 4.0 International (CC BY 4.0) license.