Virtual Reality, Augmented Reality and beyond: Laboratory of Computer Applications for Health Care at University of São Paulo
Resumo
The Laboratory of Computer Applications for Health Care at University of São Paulo develop multidisciplinary research involving Computer Science areas and other knowledge fields such as Physiotherapy, Psychiatry, Radiology, and Cardiology. Most studies use concepts besides Computer Science, by aggregating knowledge to solve real problems. In this paper we present the main projects in Virtual Reality and Augmented Reality areas, highlighting serious games, computer-aided diagnosis and therapy, simulation and training. Besides the social and scientific impact inherent to the type of the developed research, some systems are available to health professionals in order to allow technology transfer and consequent technological and economic impact in daily activities of health tasks.
Palavras-chave:
health care, simulation and training, serious game, virtual reality, augmented reality, computer-aided diagnosis
Referências
Aranha, R. V.; Araujo, L. V.; Monteiro, C. B. M.; Da Silva, T. D.; Nunes, F. L. S. (2016) MoVEROffice: Virtual Reality for Upper Limbs Rehabilitation. In: Proc. XVIII Symposium on Virtual and Augmented Reality (SVR). DOI: 10.1109/svr.2016.36
Funabashi, A. M. M.; Aranha, R. V.; Silva, T. D.; Monteiro, C. B. M.; Silva, W. S.; Nunes, F. L. S. (2018) A serious game for virtual rehabilitation: evaluation with patients and physiotherapists. SBC Journal on Interactive Systems 9(2): 14-25.
Massetti, T.; Fávero, F. M.; Menezes, L. D. C.; Alvarez, M. P. B.; Crocetta, T. B.; Guarnieri, R.; Nunes, F. L. S.; Monteiro, C. B. M.; Silva, T. D. (2018) Achievement of Virtual and Real Objects Using a Short-Term Motor Learning Protocol in People with Duchenne Muscular Dystrophy: A Crossover Randomized Controlled Trial. Games for Health Journal 7(2): 107-115. DOI: 10.1089/g4h.2016.0088
Aranha, R. V.; Silva, L. S.; Chaim, M. L.; Nunes, F. L. S. (2017) Using Affective Computing to Automatically Adapt Serious Games for Rehabilitation. In: Proc. 30th International Symposium on Computer-Based Medical Systems (CBMS). DOI:10.1109/cbms.2017.89
Aranha, R. V; Nunes, F. L. S. (2019) Um Framework para Adaptação Automática de Jogos Sérios Considerando as Emoções e os Traços de Personalidade do Jogador. Anais Estendidos Do Simpósio Brasileiro de Fatores Humanos Em Sistemas Computacionais (IHC) DOI: 10.5753/ihc.2019.8422
Aranha, R. V.; Nakamura, R.; Tori, R.; Nunes, F. L. S. (2018) Personality Traits Impacts in Virtual Reality’s User Experience. In: Proc. 20th Symposium on Virtual and Augmented Reality (SVR). DOI: 10.1109/svr.2018.00019
Aranha, R. V.; Correa, C. G.; Nunes, F. L. S. (2019) Adapting software with Affective Computing: a systematic review. IEEE Transactions on Affective Computing 1–1. DOI: 10.1109/taffc.2019.2902379
Machado-Lima, A.; Silva, A. F.; Nunes, F. L. S.; Brentani, H.; Pedrini, H.; Revers, M. C.; Testa, R. L.; Nobayashi, T.; Pinheiro, T.D. (2017) Classificação multiclasse de transtornos psiquiátricos baseada em medidas antropométricas faciais. In: MCTIC. (Org.). Tecnologias para a economia do conhecimento: edição 2017 do Prêmio Mercosul de Ciência e Tecnologia. 1ed.Brasília (DF): MCTIC, 2019, v. 1, p. 208-233.
Cornejo, J. Y. R.; Pedrini, H.; Machado-Lima, A.; Nunes, F. L. S. (2017) Down syndrome detection based on facial features using a geometric descriptor. Journal of Medical Imaging 4(04): 1. DOI:10.1117/1.jmi.4.4.044008
Pereira, M. L. G. de F.; Camargo, M. von Z. de A.; Bellan, A. F. R.; Tahira, A. C.; dos Santos, B.; dos Santos, J.; Machado-Lima, A; Nunes, F. L. S.; Forlenza, O. V. (2020) Visual Search Efficiency in Mild Cognitive Impairment and Alzheimer’s Disease: An Eye Movement Study. Journal of Alzheimer’s Disease 75(1): 261–275. DOI: 10.3233/jad-190690
Testa, R. L.; Machado-Lima, A.; Nunes, F. L. S. (2018) Factors Influencing the Perception of Realism in Synthetic Facial Expressions. In: Proc. 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI). DOI: 10.1109/sibgrapi.2018.00045
Testa, R. L.; Muniz, A. H. N.; Carpio, L. U. S.; Dias, R. da S.; Rocca, C. C. de A.; Machado-Lima, A; Nunes, F. L. S. (2015) Generating Facial Emotions for Diagnosis and Training. In: Proc IEEE 28th International Symposium on Computer-Based Medical Systems. DOI: 10.1109/cbms.2015.59 Comunicações em Informática v.4, n.2, dez/2020 (ISSN: 2595-0622) DOI: 10.22478/ufpb.2595-0622.2020v4n2.54618 41
Dias Pedro, R. W.; Machado-Lima, A.; Nunes, F. L. S. (2020) Towards an approach using grammars for automatic classification of masses in mammograms. Computational Intelligence. DOI: 10.1111/coin.12320
Bergamasco, L. C. C.; Rochitte, C. E.; Nunes, F. L. S. (2018) 3D medical objects processing and retrieval using spherical harmonics. In: Proc. 33rd Annual ACM Symposium on Applied Computing - SAC’18. DOI: 10.1145/3167132.3167168
Silva, L. S.; Nakamura, R.; Nunes, F. L. S. (2020) Machine Learning in Information Visualization: Using Rule-based Learning Algorithms to Personalize Interfaces. In: Proc. 2020 International Conference on Systems, Signals and Image Processing (IWSSIP). DOI: 10.1109/iwssip48289.2020.9145098
Silva, L. S.; Aranha, R. V.; Ribeiro, M. A. O; Nakamura, R.; Nunes, F. L. S. (2020) Exploring Visual Attention and Machine Learning in 3D visualization of medical temporal data. In: Proc. IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS). DOI: 10.1109/CBMS49503.2020.00035
Corrêa, C. G.; Machado, M. A. de A. M.; Ranzini, E.; Tori, R.; Nunes, F. L. S. (2017) Virtual Reality simulator for dental anesthesia training in the inferior alveolar nerve block. Journal of Applied Oral Science 25(4): 357–366. DOI: 10.1590/1678-7757-2016-0386
Ribeiro, M. A. O.; Correa, C. G.; Nunes, F. L. S. (2017) Gamification as a Learning Strategy in a Simulation of Dental Anesthesia. In: Proc. 19th Symposium on Virtual and Augmented Reality (SVR). DOI: 10.1109/svr.2017.42
Ribeiro, M. A. O., Correa, C. G.; Nunes, F. L. S. (2018). Visual and Haptic Trajectories Applied to Dental Anesthesia Training: Conceptualization, Implementation and Preliminary Evaluation. In: Proc. 20th Symposium on Virtual and Augmented Reality (SVR). DOI: 10.1109/svr.2018.00039
Ribeiro, M. L..; Nunes, F. L. S.; Elias, S. (2016) Towards Determining Force Feedback Parameters for Realistic Representation of Nodules in a Breast Palpation Simulator. In: Proc. IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS). DOI: 10.1109/cbms.2016.74
Oliveira, A. C. M. T. G.; Nunes, F. L. S. (2009) Building a Open Source Framework for Virtual Medical Training. Journal of Digital Imaging 23(6): 706-720. DOI: 10.1007/ s10278-009-9243-3
Carvalho Junior, A. S. V.; Biscaro, H. H. (2019) Blood Flow SPH Simulation with Elastic Deformation of Blood Vessels. In: Proc. IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE). DOI: 10.1109/bibe.2019.00102
Menção honrosa no VIII Workshop de Pós-Graduação de Engenharia de Computação - Escola Politécnica USP. Artigo "Adapting software with Affective Computing: a systematic review", Programa de Pós-Graduação em Engenharia Elétrica - Escola Politécnica Universidade de São Paulo.
Prêmio de primeiro lugar no “Undergraduate Student Workshop” no Symposium on Virtual and Augmented Reality 2018 - Artigo: Uso de trajetórias visuais e hápticas para auxílio no treinamento de anestesia odontológica, Sociedade Brasileira de Computação.
Prêmio de primeiro lugar na categoria "Application" no Symposium on Virtual and Augmented Reality 2017 - Artigo "AGaR: a VR serious game to support the recovery of post-stroke patients", Sociedade Brasileira de Computação. Comunicações
Funabashi, A. M. M.; Aranha, R. V.; Silva, T. D.; Monteiro, C. B. M.; Silva, W. S.; Nunes, F. L. S. (2018) A serious game for virtual rehabilitation: evaluation with patients and physiotherapists. SBC Journal on Interactive Systems 9(2): 14-25.
Massetti, T.; Fávero, F. M.; Menezes, L. D. C.; Alvarez, M. P. B.; Crocetta, T. B.; Guarnieri, R.; Nunes, F. L. S.; Monteiro, C. B. M.; Silva, T. D. (2018) Achievement of Virtual and Real Objects Using a Short-Term Motor Learning Protocol in People with Duchenne Muscular Dystrophy: A Crossover Randomized Controlled Trial. Games for Health Journal 7(2): 107-115. DOI: 10.1089/g4h.2016.0088
Aranha, R. V.; Silva, L. S.; Chaim, M. L.; Nunes, F. L. S. (2017) Using Affective Computing to Automatically Adapt Serious Games for Rehabilitation. In: Proc. 30th International Symposium on Computer-Based Medical Systems (CBMS). DOI:10.1109/cbms.2017.89
Aranha, R. V; Nunes, F. L. S. (2019) Um Framework para Adaptação Automática de Jogos Sérios Considerando as Emoções e os Traços de Personalidade do Jogador. Anais Estendidos Do Simpósio Brasileiro de Fatores Humanos Em Sistemas Computacionais (IHC) DOI: 10.5753/ihc.2019.8422
Aranha, R. V.; Nakamura, R.; Tori, R.; Nunes, F. L. S. (2018) Personality Traits Impacts in Virtual Reality’s User Experience. In: Proc. 20th Symposium on Virtual and Augmented Reality (SVR). DOI: 10.1109/svr.2018.00019
Aranha, R. V.; Correa, C. G.; Nunes, F. L. S. (2019) Adapting software with Affective Computing: a systematic review. IEEE Transactions on Affective Computing 1–1. DOI: 10.1109/taffc.2019.2902379
Machado-Lima, A.; Silva, A. F.; Nunes, F. L. S.; Brentani, H.; Pedrini, H.; Revers, M. C.; Testa, R. L.; Nobayashi, T.; Pinheiro, T.D. (2017) Classificação multiclasse de transtornos psiquiátricos baseada em medidas antropométricas faciais. In: MCTIC. (Org.). Tecnologias para a economia do conhecimento: edição 2017 do Prêmio Mercosul de Ciência e Tecnologia. 1ed.Brasília (DF): MCTIC, 2019, v. 1, p. 208-233.
Cornejo, J. Y. R.; Pedrini, H.; Machado-Lima, A.; Nunes, F. L. S. (2017) Down syndrome detection based on facial features using a geometric descriptor. Journal of Medical Imaging 4(04): 1. DOI:10.1117/1.jmi.4.4.044008
Pereira, M. L. G. de F.; Camargo, M. von Z. de A.; Bellan, A. F. R.; Tahira, A. C.; dos Santos, B.; dos Santos, J.; Machado-Lima, A; Nunes, F. L. S.; Forlenza, O. V. (2020) Visual Search Efficiency in Mild Cognitive Impairment and Alzheimer’s Disease: An Eye Movement Study. Journal of Alzheimer’s Disease 75(1): 261–275. DOI: 10.3233/jad-190690
Testa, R. L.; Machado-Lima, A.; Nunes, F. L. S. (2018) Factors Influencing the Perception of Realism in Synthetic Facial Expressions. In: Proc. 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI). DOI: 10.1109/sibgrapi.2018.00045
Testa, R. L.; Muniz, A. H. N.; Carpio, L. U. S.; Dias, R. da S.; Rocca, C. C. de A.; Machado-Lima, A; Nunes, F. L. S. (2015) Generating Facial Emotions for Diagnosis and Training. In: Proc IEEE 28th International Symposium on Computer-Based Medical Systems. DOI: 10.1109/cbms.2015.59 Comunicações em Informática v.4, n.2, dez/2020 (ISSN: 2595-0622) DOI: 10.22478/ufpb.2595-0622.2020v4n2.54618 41
Dias Pedro, R. W.; Machado-Lima, A.; Nunes, F. L. S. (2020) Towards an approach using grammars for automatic classification of masses in mammograms. Computational Intelligence. DOI: 10.1111/coin.12320
Bergamasco, L. C. C.; Rochitte, C. E.; Nunes, F. L. S. (2018) 3D medical objects processing and retrieval using spherical harmonics. In: Proc. 33rd Annual ACM Symposium on Applied Computing - SAC’18. DOI: 10.1145/3167132.3167168
Silva, L. S.; Nakamura, R.; Nunes, F. L. S. (2020) Machine Learning in Information Visualization: Using Rule-based Learning Algorithms to Personalize Interfaces. In: Proc. 2020 International Conference on Systems, Signals and Image Processing (IWSSIP). DOI: 10.1109/iwssip48289.2020.9145098
Silva, L. S.; Aranha, R. V.; Ribeiro, M. A. O; Nakamura, R.; Nunes, F. L. S. (2020) Exploring Visual Attention and Machine Learning in 3D visualization of medical temporal data. In: Proc. IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS). DOI: 10.1109/CBMS49503.2020.00035
Corrêa, C. G.; Machado, M. A. de A. M.; Ranzini, E.; Tori, R.; Nunes, F. L. S. (2017) Virtual Reality simulator for dental anesthesia training in the inferior alveolar nerve block. Journal of Applied Oral Science 25(4): 357–366. DOI: 10.1590/1678-7757-2016-0386
Ribeiro, M. A. O.; Correa, C. G.; Nunes, F. L. S. (2017) Gamification as a Learning Strategy in a Simulation of Dental Anesthesia. In: Proc. 19th Symposium on Virtual and Augmented Reality (SVR). DOI: 10.1109/svr.2017.42
Ribeiro, M. A. O., Correa, C. G.; Nunes, F. L. S. (2018). Visual and Haptic Trajectories Applied to Dental Anesthesia Training: Conceptualization, Implementation and Preliminary Evaluation. In: Proc. 20th Symposium on Virtual and Augmented Reality (SVR). DOI: 10.1109/svr.2018.00039
Ribeiro, M. L..; Nunes, F. L. S.; Elias, S. (2016) Towards Determining Force Feedback Parameters for Realistic Representation of Nodules in a Breast Palpation Simulator. In: Proc. IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS). DOI: 10.1109/cbms.2016.74
Oliveira, A. C. M. T. G.; Nunes, F. L. S. (2009) Building a Open Source Framework for Virtual Medical Training. Journal of Digital Imaging 23(6): 706-720. DOI: 10.1007/ s10278-009-9243-3
Carvalho Junior, A. S. V.; Biscaro, H. H. (2019) Blood Flow SPH Simulation with Elastic Deformation of Blood Vessels. In: Proc. IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE). DOI: 10.1109/bibe.2019.00102
Menção honrosa no VIII Workshop de Pós-Graduação de Engenharia de Computação - Escola Politécnica USP. Artigo "Adapting software with Affective Computing: a systematic review", Programa de Pós-Graduação em Engenharia Elétrica - Escola Politécnica Universidade de São Paulo.
Prêmio de primeiro lugar no “Undergraduate Student Workshop” no Symposium on Virtual and Augmented Reality 2018 - Artigo: Uso de trajetórias visuais e hápticas para auxílio no treinamento de anestesia odontológica, Sociedade Brasileira de Computação.
Prêmio de primeiro lugar na categoria "Application" no Symposium on Virtual and Augmented Reality 2017 - Artigo "AGaR: a VR serious game to support the recovery of post-stroke patients", Sociedade Brasileira de Computação. Comunicações
Publicado
07/11/2020
Como Citar
NUNES, Fátima; ARANHA, Renan; TESTA, Rafael; RIBEIRO, Matheus.
Virtual Reality, Augmented Reality and beyond: Laboratory of Computer Applications for Health Care at University of São Paulo. In: LABS PRESENTATION - SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 22. , 2020, Evento Online.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2020
.
p. 100-103.
DOI: https://doi.org/10.5753/svr_estendido.2020.12971.
