Evaluation of a Serious Game Multimodal Platform to Help Therapy for Autistics

• Andre B. Trindade Instituto Federal de Santa Catarina http://orcid.org/0000-0002-4832-6398
• Joice L. Jeronimo Instituto Federal de Santa Catarina http://orcid.org/0000-0003-3443-7465
• Marcelo da S. Hounsell Universidade do Estado de Santa Catarina http://orcid.org/0000-0002-9700-0909
• Rafael G. Faust Instituto Federal de Santa Catarina http://orcid.org/0000-0002-0362-7605

DOI: https://doi.org/10.5753/sbie.2021.217422

Abstract

This work describes the development of a platform capable of capturing heart rate through a non-invasive optical sensor built into a joystick. The platform focuses on autism spectrum disorder (ASD) whose interaction with digital media is yet to be fully understood. A serious game was developed to test the heart rate signal as a game parameter. A questionnaire was completed by 39 experts evaluating the platform, the design of the joystick and the game. The experts assessed all items above the center of the scale, except project costs. We can conclude that this type of multimodal platform can improve the possibilities of creating specific serious games for ASD.

Keywords: autism, ASD, multimodal system, biosignal

References

Alvarez, J. e Djaouti, D. (2011) "An introduction to Serious Game Definitions and Concepts", em Anais do Serious Games & Simulation for Risks Management Workshop, pp. 11-15.

Ament, K. et al (2015). "Evidence for specificity of motor impairments in catching and balance in children with autism", J Autism Dev Disord., vol. 45, no. 3, pp. 742-51.

Fan, J. et al. (2018), "EEG-Based Affect and Workload Recognition in a Virtual Driving Environment for ASD Intervention", IEEE Transactions on Biomedical Engineering, vol. 65, no. 1, pp. 43-51.

Fleming, S. et al. (2011), "Normal ranges of heart rate and respiratory rate in children from birth to 18 years of age: a systematic review of observational studies", Lancet., vol. 377, no. 9770, pp. 1011-1018.

Galvão, T. (2012) "Tecnologia Assistiva: favorecendo o desenvolvimento e a aprendizagem em contextos educacionais inclusivos", em C.R.M. Giroto R.B. Poker, S. Omote. (Org.). As tecnologias nas práticas pedagógicas inclusivas. Cultura Acadêmica, Marília-SP, pp. 65-92.

Goulart, C. et al. (2014), "EEG analysis and mobile robot as tools for emotion characterization in autism", em Anais do BMC 2014 8(Suppl 4): P85.

Kuriakose, S. e Lahirir, U. (2017), "Design of a Physiology-Sensitive VR-Based Social Communication Platform for Children with Autism", IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 25, no. 8, pp. 1180-1191.

Loures, D. et al. (2002), "Estresse Mental e Sistema Cardiovascular", Arq. Bras. Cardiol., vol. 78, no. 5, pp. 525-530.

Néry, J. T. C. et al. (2019), "Jogos Sérios Multimodais para a Saúde: Um Mapeamento Sistemático da Literatura", em Anais do XVIII SBGames, pp. 198-206.

Oliveira, C. (2016) "Um Retrato do Autismo no Brasil", Revista Espaço Aberto, Edição n. 170, 6 de abril. São Paulo, Brasil.

Posar, A. e Visconti, P. (2018), "Sensory abnormalities in children with autism spectrum disorder", J Pediatr (Rio J), vol. 94, no. 4, pp. 342-50.

Shelley, K. e Shelley, S. (2001), "Pulse Oximeter Waveform: Photoelectric Plethysmography, in Clinical Monitoring", em Carol Lake, R. Hines, and C. Blitt, Eds.: W.B. Saunders Company, pp. 420-428.

Warren, Z. et al. (2011) "A Systematic Review of Early Intensive Intervention for Autism Spectrum Disorders", Pediatrics, vol. 127, no. 5, pp. e1312 - e1322.