Exploring everyday objects as tactile guides for medical simulation in virtual reality

• Deivison da Silva Costa UFPB
• Antonio Carlos Vieira Araújo UFPB
• Liliane S. Machado UFPB

DOI: https://doi.org/10.5753/sbcas.2025.7546

Abstract

Virtual reality environments play an important role in the health education process, providing safe environments for professional practice. The tactile sensation and the forces associated with movements are fundamental factors for training medical procedures that involve psychomotor skills, such as surgeries, sutures and invasive examinations. In virtual reality systems, these sensations are provided by haptic devices, which offer limitations in cost and functionality. Aiming to propose an alternative to these devices, this study investigates the impact of tactile guides on interaction in virtual reality environments for medical training. In this work, was investigated how the weight, texture, shape and grip of conventional objects, used as tactile guides of a scalpel in a virtual reality environment, impacted the user experience. The results indicated that familiar and ergonomically balanced objects result in more comfort and immersion, while inadequate shapes compromise the experience.

References

Bowman, D., Kruijff, E., LaViola, J. J., and Poupyrev, I. (2004). 3D User Interfaces. Addison-Wesley.

Burdea, G. C. (1996). Force and touch feedback for virtual reality. John Wiley & Sons, Inc., USA.

Cheng, L.-P., Chang, L., Marwecki, S., and Baudisch, P. (2018). Iturk: Turning passive haptics into active haptics by making users reconfigure props in virtual reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18), pages 1–10.

Cheng, L.-P., Ofek, E., Holz, C., Benko, H., and Wilson, A. D. (2017). Sparse haptic proxy: Touch feedback in virtual environments using a general passive prop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17), pages 3718–3728.

Gallace, A. and Spence, C. (2014). Gallace, A., & Spence, C. (2014). In touch with the future: The sense of touch from cognitive neuroscience to virtual reality. Oxford: Oxford University Press.

Hanzaki, M. R. and Boulanger, P. (2020). Proxy haptics for surgical training. In 2020 22nd Symposium on Virtual and Augmented Reality (SVR), pages 134–143, Porto de Galinhas, Brazil.

Hettiarachchi, A. and Wigdor, D. (2016). Annexing reality: Enabling opportunistic use of everyday objects as tangible proxies in augmented reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI ’16, pages 1957–1967, New York, NY, USA. Association for Computing Machinery.

Kelner, J. and Teichrieb, V. (2007). Realidade Virtual e Aumentada: Conceitos, Projeto e Aplicações. Sociedade Brasileira de Computação.

Kobeisse, S. and Holmquist, L. (2022). “i can feel it in my hand”: Exploring design opportunities for tangible interfaces to manipulate artefacts in ar. pages 28–36.

Kwon, E., Kim, G. J., and Lee, S. (2009). Effects of sizes and shapes of props in tangible augmented reality. In 2009 8th IEEE International Symposium on Mixed and Augmented Reality, pages 201–202, Orlando, FL, USA.

Pacchierotti, C., Sinclair, S., Solazzi, M., Frisoli, A., Hayward, V., and Prattichizzo, D. (2017). Wearable haptic systems for the fingertip and the hand: Taxonomy, review, and perspectives. IEEE Transactions on Haptics, 10(4):580–600.

Sherman, W. R. and Craig, A. B. (2019). Understanding Virtual Reality: Interface, Application, and Design. Morgan Kaufmann Publishers, Cambridge, USA, 2 edition.

Simeone, A. L., Velloso, E., and Gellersen, H. (2015). Substitutional reality: Using the physical environment to design virtual reality experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15), pages 3307–3316.

Tinguy, X. d. et al. (2019). How different tangible and virtual objects can be while still feeling the same? In 2019 IEEE World Haptics Conference (WHC), pages 580–585, Tokyo, Japan.

Tong, Q., Wei, W., Zhang, Y., Xiao, J., and Wang, D. (2023). Survey on hand-based haptic interaction for virtual reality. IEEE Transactions on Haptics, 16(2):154–170.

Tori, R. and Hounsell, M. d. S. (2020). Introdução a Realidade Virtual e Aumentada. Sociedade Brasileira de Computação.

Weber, S., Weibel, D., and Mast, F. W. (2021). How to get there when you are there already? defining presence in virtual reality and the importance of perceived realism. Frontiers in Psychology, 12.

Yang, C.-H., Liu, S.-F., Lin, C.-Y., et al. (2020). Immersive virtual reality-based cardio-pulmonary resuscitation interactive learning support system. IEEE Access, 8:120870–120880.