Michelzinho: Jogo sério para o ensino de habilidades emocionais em pessoas com autismo ou deficiência intelectual
Resumo
Esse trabalho apresenta um jogo da classe 'sério' para auxiliar no ensino de competências emocionais e sociais em pessoas com Transtorno do Espectro Autista (TEA) e deficiência intelectual. A aplicação permite desenvolver as habilidades de reconhecer e expressar as emoções básicas: alegria, tristeza, raiva, desgosto, surpresa e medo. Por meio da teoria de sistema de codificação de ação facial e técnicas de processamento digital de imagens foi possível detectar expressões faciais e classificá-las em uma das seis emoções básicas. Experimentos iniciais foram realizados para a aquisição de dados iniciais e a realização de melhorias na aplicação antes de sua finalização definitiva. Essa proposta foi avaliada em imagens da base Ck+, obtendo uma taxa de precisão de 88% para a classificação das emoções básicas. Experimentos com portadores do TEA foram realizados para avaliar as contribuições e limitações do trabalho proposto.
Palavras-chave:
Jogos sérios, habilidades emocionais, autismo, deficiência intelectual, reconhecimento de emoções
Referências
Acevedo, D., Negri, P., Buemi, M. E., Fernández, F. G., and Mejail, M. (2017). A simple geometric-based descriptor for facial expression recognition. In Automatic Face & Gesture Recognition (FG2017), 2017 12th IEEE International Conference on, pages 802–808. IEEE.
Annaz, D., Karmiloff-Smith, A., Johnson, M. H., and Thomas, M. S. (2009). Across-syndrome study of the development of holistic face recognition in children with autism, down syndrome, and williams syndrome. Journal of experimental child psychology, 102(4):456–486.
Ayres, K. M. and Langone, J. (2005). Intervention and instruction with video for students with autism: A review of the literature. Education and Training in Developmental Disabilities, 40(2):183–196. Cited By: 93.
Bagnara, S., Tartaglia, R., Albolino, S., Alexander, T., and Fujita, Y. (2018). Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018): Volume II: Safety and Health, Slips, Trips and Falls, volume 819. Springer.
Baron-Cohen, S., Wheelwright, S., Lawson, J., Griffin, R., Ashwin, C., Billington, J., and Chakrabarti, B. (2005). Empathizing and systemizing in autism spectrum conditions. Handbook of autism and pervasive developmental disorders, 1:628–639.
Bondy, A. S. and Frost, L. A. (1994). The picture exchange communication system. Focus on autistic behavior, 9(3):1–19.
Brito, A. (2007). Blender 3D - Guia do Usuário. Novatec Editora.
Charsky, D. (2010). From edutainment to serious games: A change in the use of game characteristics. Games and culture, 5(2):177–198.
Chen, C.-H., Lee, I.-J., and Lin, L.-Y. (2016). Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Computers in Human Behavior, 55:477–485.
Chien, M.-E., Jheng, C.-M., Lin, N.-M., Tang, H.-H., Taele, P., Tseng, W.-S., and Chen, M. Y. (2015). ican: A tablet-based pedagogical system for improving communication skills of children with autism. International Journal of Human-Computer Studies, 73:79–90.
Control, C. D. and Prevention (2018). Autism spectrum disorder (asd) @ONLINE.
Dantas, A. C., de Melo, S., Moura, F., Fernandes, M., Gerais-Brasil, U.-M., and Gerais-Brasil, B.-M. (2015). Reconhecimento dinâmico de emoções através de expressões faciais utilizando árvore de decisão. In Anais do Simpósio Brasileiro de Informática na Educação, volume 26, page 1102.
Dawson, G., Webb, S. J., and McPartland, J. (2005). Understanding the nature of face processing impairment in autism: insights from behavioral and electrophysiological studies. Developmental neuropsychology, 27(3):403–424.
Dickey, M. D. (2005). Engaging by design: How engagement strategies in popular computer and video games can inform instructional design. Educational technology research and development, 53(2):67–83.
Ekman, P. and Friesen, W. (1978). Facial action coding system. Alto: Consulting Psychologist Press.
Elder, L. M., Caterino, L. C., Chao, J., Shacknai, D., and DeSimone, G. (2006). The efficacy of social skills treatment for children with asperger syndrome. Education and Treatment of Children, pages 635–663.
Fleet, D. and Weiss, Y. (2006). Optical flow estimation. In Handbook of mathematical models in computer vision, pages 237–257. Springer.
Google (2019). An end-to-end open source machine learning platform @ONLINE.
Gudi, A. (2015). Recognizing semantic features in faces using deep learning. arXiv preprint arXiv:1512.00743.
Kanade, T. C. and Cohn, J. (2005). Au-coded facial expression database.
Lienhart, R. and Maydt, J. (2002). An extended set of haar-like features for rapid object detection. In Image Processing. 2002. Proceedings. 2002 International Conference on, volume 1, pages I–I. IEEE.
Mell, P., Grance, T., et al. (2011). The nist definition of cloud computing.
Mesibov, G. B., Adams, L. W., and Klinger, L. G. (2013). Autism: Understanding the disorder. Springer Science & Business Media.
MySQL (2018). Why mysql @ONLINE.
OMS (2017). Autism spectrum disorders, key facts @ONLINE.
Silva, M., Soares, A., and Benitez, P. (2017). Ambiente digital para ensino e acompanhamento personalizado de estudantes com autismo: proposta com uso de dispositivos móveis. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação - SBIE), volume 28, page 1047.
Valstar, M. F. and Pantic, M. (2012). Fully automatic recognition of the temporal phases of facial actions. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 42(1):28–43.
Valstar, M. F., Sánchez-Lozano, E., Cohn, J. F., Jeni, L. A., Girard, J. M., Zhang, Z., Yin, L., and Pantic, M. (2017). Fera2017 - addressing head pose in the third facial expression recognition and analysis challenge. In 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG2017), pages 839–847. IEEE.
Viola, P. and Jones, M. J. (2004). Robust real-time face detection. Int. J. Comput. Vision, 57(2):137–154.
Wishart, J., Cebula, K., Willis, D., and Pitcairn, T. (2007). Understanding of facial expressions of emotion by children with intellectual disabilities of differing aetiology. Journal of Intellectual Disability Research, 51(7):551–563.
Zaja, R. H. and Rojahn, J. (2008). Facial emotion recognition in intellectual disabilities. Current Opinion in Psychiatry, 21(5):441–444.
Annaz, D., Karmiloff-Smith, A., Johnson, M. H., and Thomas, M. S. (2009). Across-syndrome study of the development of holistic face recognition in children with autism, down syndrome, and williams syndrome. Journal of experimental child psychology, 102(4):456–486.
Ayres, K. M. and Langone, J. (2005). Intervention and instruction with video for students with autism: A review of the literature. Education and Training in Developmental Disabilities, 40(2):183–196. Cited By: 93.
Bagnara, S., Tartaglia, R., Albolino, S., Alexander, T., and Fujita, Y. (2018). Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018): Volume II: Safety and Health, Slips, Trips and Falls, volume 819. Springer.
Baron-Cohen, S., Wheelwright, S., Lawson, J., Griffin, R., Ashwin, C., Billington, J., and Chakrabarti, B. (2005). Empathizing and systemizing in autism spectrum conditions. Handbook of autism and pervasive developmental disorders, 1:628–639.
Bondy, A. S. and Frost, L. A. (1994). The picture exchange communication system. Focus on autistic behavior, 9(3):1–19.
Brito, A. (2007). Blender 3D - Guia do Usuário. Novatec Editora.
Charsky, D. (2010). From edutainment to serious games: A change in the use of game characteristics. Games and culture, 5(2):177–198.
Chen, C.-H., Lee, I.-J., and Lin, L.-Y. (2016). Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Computers in Human Behavior, 55:477–485.
Chien, M.-E., Jheng, C.-M., Lin, N.-M., Tang, H.-H., Taele, P., Tseng, W.-S., and Chen, M. Y. (2015). ican: A tablet-based pedagogical system for improving communication skills of children with autism. International Journal of Human-Computer Studies, 73:79–90.
Control, C. D. and Prevention (2018). Autism spectrum disorder (asd) @ONLINE.
Dantas, A. C., de Melo, S., Moura, F., Fernandes, M., Gerais-Brasil, U.-M., and Gerais-Brasil, B.-M. (2015). Reconhecimento dinâmico de emoções através de expressões faciais utilizando árvore de decisão. In Anais do Simpósio Brasileiro de Informática na Educação, volume 26, page 1102.
Dawson, G., Webb, S. J., and McPartland, J. (2005). Understanding the nature of face processing impairment in autism: insights from behavioral and electrophysiological studies. Developmental neuropsychology, 27(3):403–424.
Dickey, M. D. (2005). Engaging by design: How engagement strategies in popular computer and video games can inform instructional design. Educational technology research and development, 53(2):67–83.
Ekman, P. and Friesen, W. (1978). Facial action coding system. Alto: Consulting Psychologist Press.
Elder, L. M., Caterino, L. C., Chao, J., Shacknai, D., and DeSimone, G. (2006). The efficacy of social skills treatment for children with asperger syndrome. Education and Treatment of Children, pages 635–663.
Fleet, D. and Weiss, Y. (2006). Optical flow estimation. In Handbook of mathematical models in computer vision, pages 237–257. Springer.
Google (2019). An end-to-end open source machine learning platform @ONLINE.
Gudi, A. (2015). Recognizing semantic features in faces using deep learning. arXiv preprint arXiv:1512.00743.
Kanade, T. C. and Cohn, J. (2005). Au-coded facial expression database.
Lienhart, R. and Maydt, J. (2002). An extended set of haar-like features for rapid object detection. In Image Processing. 2002. Proceedings. 2002 International Conference on, volume 1, pages I–I. IEEE.
Mell, P., Grance, T., et al. (2011). The nist definition of cloud computing.
Mesibov, G. B., Adams, L. W., and Klinger, L. G. (2013). Autism: Understanding the disorder. Springer Science & Business Media.
MySQL (2018). Why mysql @ONLINE.
OMS (2017). Autism spectrum disorders, key facts @ONLINE.
Silva, M., Soares, A., and Benitez, P. (2017). Ambiente digital para ensino e acompanhamento personalizado de estudantes com autismo: proposta com uso de dispositivos móveis. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação - SBIE), volume 28, page 1047.
Valstar, M. F. and Pantic, M. (2012). Fully automatic recognition of the temporal phases of facial actions. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 42(1):28–43.
Valstar, M. F., Sánchez-Lozano, E., Cohn, J. F., Jeni, L. A., Girard, J. M., Zhang, Z., Yin, L., and Pantic, M. (2017). Fera2017 - addressing head pose in the third facial expression recognition and analysis challenge. In 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG2017), pages 839–847. IEEE.
Viola, P. and Jones, M. J. (2004). Robust real-time face detection. Int. J. Comput. Vision, 57(2):137–154.
Wishart, J., Cebula, K., Willis, D., and Pitcairn, T. (2007). Understanding of facial expressions of emotion by children with intellectual disabilities of differing aetiology. Journal of Intellectual Disability Research, 51(7):551–563.
Zaja, R. H. and Rojahn, J. (2008). Facial emotion recognition in intellectual disabilities. Current Opinion in Psychiatry, 21(5):441–444.
Publicado
11/11/2019
Como Citar
DANTAS, Adilmar C.; DE MELO, Sara L.; NEVES, Leandro A.; MILESSI, Taynara P.; DO NASCIMENTO, Marcelo Z..
Michelzinho: Jogo sério para o ensino de habilidades emocionais em pessoas com autismo ou deficiência intelectual. In: SIMPÓSIO BRASILEIRO DE INFORMÁTICA NA EDUCAÇÃO (SBIE), 30. , 2019, Brasília/DF.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2019
.
p. 644-653.
DOI: https://doi.org/10.5753/cbie.sbie.2019.644.
