Ferramentas de computação visual para apoio ao treinamento de expressões faciais por autistas: uma revisão de literatura
Resumo
Os avanços nas pesquisas e aplicações de computação visual em ciências da saúde se tornaram importantes aliados na resolução de problemas enfrentados por indivíduos com Transtorno do Espectro Autista (TEA). Esta população apresenta limitações em reconhecer e expressar emoções através da face, o que torna suas relações sociais menos adaptativas e funcionais. Este artigo apresenta uma análise de trabalhos que utilizam recursos de computação visual para apoiar o incremento da capacidade de reconhecimento de emoções expressas pela face. A partir deste estudo, levanta-se questões e indica-se direções futuras para o desenvolvimento de novas ferramentas para treinar o reconhecimento e a produção de expressões faciais em crianças com autismo.
Referências
Abirached, B., Zhang, Y., Aggarwal, J. K., Tamersoy, B., Fernandes, T., Miranda, J., and Orvalho, V. (2011). Improving communication skills of children with asds through interaction with virtual characters. In Serious Games and Applications for Health (SeGAH), 2011 IEEE 1st International Conference on, pages 1–4. IEEE.
Aman, M. G. (2005). Treatment planning for patients with autism spectrum disorders. Journal of Clinical Psychiatry, 66:38.
American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders: DSM-5. Autor, Washington, DC, 5th ed. edition.
Baron-Cohen, S., Leslie, A. M., and Frith, U. (1985). Does the autistic child have a ”theory of mind?”. Cognition, 21(1):37–46.
Beaumont, R. and Sofronoff, K. (2008). A multi-component social skills intervention for children with asperger syndrome: The junior detective training program. Journal of Child Psychology and Psychiatry, 49(7):743–753.
Bekele, E., Crittendon, J., Zheng, Z., Swanson, A., Weitlauf, A., Warren, Z., and Sarkar, N. (2014). Assessing the utility of a virtual environment for enhancing facial affect recognition in adolescents with autism. Journal of autism and developmental disorders, 44(7):1641–1650.
Bekele, E., Zheng, Z., Swanson, A., Crittendon, J., Warren, Z., and Sarkar, N. (2013). Understanding how adolescents with autism respond to facial expressions in virtual reality environments. Visualization and Computer Graphics, IEEE Transactions on, 19(4):711–720.
Bolte, S., Feineis-Matthews, S., Leber, S., Dierks, T., Hubl, D., and Poustka, F. (2002). The development and evaluation of a computer-based program to test and to teach the recognition of facial affect. International Journal of Circumpolar Health, 61.
Carroll, J. M. and Russell, J. A. (1996). Do facial expressions signal specific emotions? judging emotion from the face in context. Journal of personality and social psychology, 70(2):205.
Chen, C.-H., Lee, I.-J., and Lin, L.-Y. (2015). Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Research in developmental disabilities, 36:396–403.
Christinaki, E., Vidakis, N., and Triantafyllidis, G. (2014). A novel educational game for teaching emotion identification skills to preschoolers with autism diagnosis. Computer science and information systems, 11(2):723–743.
Cockburn, J., Bartlett, M., Tanaka, J., Movellan, J., Pierce, M., and Schultz, R. (2008). Smilemaze: A tutoring system in real-time facial expression perception and production in children with autism spectrum disorder. In ECAG 2008 Workshop Facial and Bodily Expressions for Control and Adaptation of Games, page 3.
Deriso, D. M., Susskind, J., Tanaka, J., Winkielman, P., Herrington, J., Schultz, R., and Bartlett, M. (2012). Exploring the facial expression perception-production link using real-time automated facial expression recognition. In Computer Vision–ECCV 2012. Workshops and Demonstrations, pages 270–279. Springer.
Ekman, P. and Friesen, W. V. (1978). Manual for the facial action coding system. Consulting Psychologists Press.
Falck-Ytter, T., B¨olte, S., and Gredeb¨ack, G. (2013). Eye tracking in early autism research. Journal of neurodevelopmental disorders, 5(1):28.
Finkelstein, S. L., Nickel, A., Harrison, L., Suma, E., Barnes, T., et al. (2009). cmotion: A new game design to teach emotion recognition and programming logic to children using virtual humans. In Virtual Reality Conference, 2009. VR 2009. IEEE, pages 249–250. IEEE.
Gay, V., Leijdekkers, P., Agcanas, J., Wong, F., and Wu, Q. (2013). Capturemyemotion: helping autistic children understand their emotions using facial expression recognition and mobile technologies. BLED 2013 Proceedings.
Gendron, M., Roberson, D., van der Vyver, J. M., and Barrett, L. F. (2014). Perceptions of emotion from facial expressions are not culturally universal: evidence from a remote culture. Emotion, 14(2):251.
Gordon, I., Pierce, M. D., Bartlett, M. S., and Tanaka, J. W. (2014). Training facial expression production in children on the autism spectrum. Journal of autism and developmental disorders, 44(10):2486–2498.
Grynszpan, O., Martin, J.-C., and Nadel, J. (2008). Multimedia interfaces for users with high functioning autism: An empirical investigation. International Journal of Human-Computer Studies, 66(8):628–639.
Grynszpan, O., Nadel, J., Martin, J.-C., Simonin, J., Bailleul, P., Wang, Y., Gepner, D., Le Barillier, F., and Constant, J. (2012). Self-monitoring of gaze in high functioning autism. Journal of autism and developmental disorders, 42(8):1642–1650.
Hansen, D. W. and Ji, Q. (2010). In the eye of the beholder: A survey of models for eyes and gaze. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32(3):478–500.
Harrold, N., Tan, C. T., Rosser, D., and Leong, T.W. (2014). Copyme: a portable real-time feedback expression recognition game for children. In CHI’14 Extended Abstracts on Human Factors in Computing Systems, pages 1195–1200. ACM.
Hopkins, I. M., Gower, M. W., Perez, T. A., Smith, D. S., Amthor, F. R., Wimsatt, F. C., and Biasini, F. J. (2011). Avatar assistant: improving social skills in students with an asd through a computer-based intervention. Journal of autism and developmental disorders, 41(11):1543–1555.
Jasmin, E., Couture, M., McKinley, P., Reid, G., Fombonne, E., and Gisel, E. (2009). Sensori-motor and daily living skills of preschool children with autism spectrum disorders. Journal of autism and developmental disorders, 39(2):231–241.
Kandalaft, M. R., Didehbani, N., Krawczyk, D. C., Allen, T. T., and Chapman, S. B. (2013). Virtual reality social cognition training for young adults with high-functioning autism. Journal of Autism and Developmental Disorders, 43(1):34–44.
Klin, A. (2006). Autismo e síndrome de asperger: uma visão geral. Revista Brasileira de Psiquiatria, 28(1):3–11.
Madsen, M., El Kaliouby, R., Goodwin, M., and Picard, R. (2008). Technology for justin-time in-situ learning of facial affect for persons diagnosed with an autism spectrum disorder. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, pages 19–26. ACM.
Matson, J. L. and Kozlowski, A. M. (2011). The increasing prevalence of autism spectrum disorders. Research in Autism Spectrum Disorders, 5(1):418–425.
Minio-Paluello, I., Baron-Cohen, S., Avenanti, A., Walsh, V., and Aglioti, S. M. (2009). Absence of embodied empathy during pain observation in asperger syndrome. Biological psychiatry, 65(1):55–62.
Moore, D., Cheng, Y., McGrath, P., and Powell, N. J. (2005). Collaborative virtual environment technology for people with autism. Focus on Autism and Other Developmental Disabilities, 20(4):231–243.
Oberman, L. M.,Winkielman, P., and Ramachandran, V. S. (2007). Face to face: Blocking facial mimicry can selectively impair recognition of emotional expressions. Social neuroscience, 2(3-4):167–178.
Picard, R. W., Vyzas, E., and Healey, J. (2001). Toward machine emotional intelligence: Analysis of affective physiological state. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 23(10):1175–1191.
Ryokai, K., Raffle, H., and Kowalski, R. (2012). Storyfaces: pretend-play with ebooks to support social-emotional storytelling. In Proceedings of the 11th International Conference on Interaction Design and Children, pages 125–133. ACM.
San Agustin, J., Skovsgaard, H., Mollenbach, E., Barret, M., Tall, M., Hansen, D.W., and Hansen, J. P. (2010). Evaluation of a low-cost open-source gaze tracker. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, pages 77–80. ACM.
Santos, A., Chaminade, T., Da Fonseca, D., Silva, C., Rosset, D., and Deruelle, C. (2012). Just another social scene: evidence for decreased attention to negative social scenes in high-functioning autism. Journal of autism and developmental disorders, 42(9):1790–1798.
Serret, S., Hun, S., Iakimova, G., Lozada, J., Anastassova, M., Santos, A., Vesperini, S., and Askenazy, F. (2014). Facing the challenge of teaching emotions to individuals with low-and high-functioning autism using a new serious game: a pilot study. Molecular autism, 5(1):37.
Silver, M. and Oakes, P. (2001). Evaluation of a new computer intervention to teach people with autism or asperger syndrome to recognize and predict emotions in others. Autism, 5(3):299–316.
Tanaka, J.W., Lincoln, S., and Hegg, L. (2003). A framework for the study and treatment of face processing deficits in autism. The development of face processing, pages 101–119.
Tanaka, J. W., Wolf, J. M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S., Kaiser, M. D., and Schultz, R. T. (2010). Using computerized games to teach face recognition skills to children with autism spectrum disorder: The let’s face it! program. Journal of Child Psychology and Psychiatry, 51(8):944–952.
Tanaka, J. W., Wolf, J. M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S. S., South, M., McPartland, J. C., et al. (2012). The perception and identification of facial emotions in individuals with autism spectrum disorders using the let’s face it! emotion skills battery. Journal of Child Psychology and Psychiatry, 53(12):1259–1267.
Wang, X., Desalvo, N., Gao, Z., Zhao, X., Lerman, D. C., Gnawali, O., and Shi, W. (2014). Eye contact conditioning in autistic children using virtual reality technology. In Pervasive Computing Paradigms for Mental Health, pages 79–89. Springer.
Xu, B. and Tanaka, J. W. (2014). Teaching children with autism to recognize faces. In Comprehensive Guide to Autism, pages 1043–1059. Springer.
Zablotsky, B., Black, L., Maenner, M., Schieve, L., and Blumberg, S. (2015). Estimated prevalence of autism and other developmental disabilities following questionnaire changes in the 2014 national health interview survey. National health statistics reports, (87):1–21.
Aman, M. G. (2005). Treatment planning for patients with autism spectrum disorders. Journal of Clinical Psychiatry, 66:38.
American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders: DSM-5. Autor, Washington, DC, 5th ed. edition.
Baron-Cohen, S., Leslie, A. M., and Frith, U. (1985). Does the autistic child have a ”theory of mind?”. Cognition, 21(1):37–46.
Beaumont, R. and Sofronoff, K. (2008). A multi-component social skills intervention for children with asperger syndrome: The junior detective training program. Journal of Child Psychology and Psychiatry, 49(7):743–753.
Bekele, E., Crittendon, J., Zheng, Z., Swanson, A., Weitlauf, A., Warren, Z., and Sarkar, N. (2014). Assessing the utility of a virtual environment for enhancing facial affect recognition in adolescents with autism. Journal of autism and developmental disorders, 44(7):1641–1650.
Bekele, E., Zheng, Z., Swanson, A., Crittendon, J., Warren, Z., and Sarkar, N. (2013). Understanding how adolescents with autism respond to facial expressions in virtual reality environments. Visualization and Computer Graphics, IEEE Transactions on, 19(4):711–720.
Bolte, S., Feineis-Matthews, S., Leber, S., Dierks, T., Hubl, D., and Poustka, F. (2002). The development and evaluation of a computer-based program to test and to teach the recognition of facial affect. International Journal of Circumpolar Health, 61.
Carroll, J. M. and Russell, J. A. (1996). Do facial expressions signal specific emotions? judging emotion from the face in context. Journal of personality and social psychology, 70(2):205.
Chen, C.-H., Lee, I.-J., and Lin, L.-Y. (2015). Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Research in developmental disabilities, 36:396–403.
Christinaki, E., Vidakis, N., and Triantafyllidis, G. (2014). A novel educational game for teaching emotion identification skills to preschoolers with autism diagnosis. Computer science and information systems, 11(2):723–743.
Cockburn, J., Bartlett, M., Tanaka, J., Movellan, J., Pierce, M., and Schultz, R. (2008). Smilemaze: A tutoring system in real-time facial expression perception and production in children with autism spectrum disorder. In ECAG 2008 Workshop Facial and Bodily Expressions for Control and Adaptation of Games, page 3.
Deriso, D. M., Susskind, J., Tanaka, J., Winkielman, P., Herrington, J., Schultz, R., and Bartlett, M. (2012). Exploring the facial expression perception-production link using real-time automated facial expression recognition. In Computer Vision–ECCV 2012. Workshops and Demonstrations, pages 270–279. Springer.
Ekman, P. and Friesen, W. V. (1978). Manual for the facial action coding system. Consulting Psychologists Press.
Falck-Ytter, T., B¨olte, S., and Gredeb¨ack, G. (2013). Eye tracking in early autism research. Journal of neurodevelopmental disorders, 5(1):28.
Finkelstein, S. L., Nickel, A., Harrison, L., Suma, E., Barnes, T., et al. (2009). cmotion: A new game design to teach emotion recognition and programming logic to children using virtual humans. In Virtual Reality Conference, 2009. VR 2009. IEEE, pages 249–250. IEEE.
Gay, V., Leijdekkers, P., Agcanas, J., Wong, F., and Wu, Q. (2013). Capturemyemotion: helping autistic children understand their emotions using facial expression recognition and mobile technologies. BLED 2013 Proceedings.
Gendron, M., Roberson, D., van der Vyver, J. M., and Barrett, L. F. (2014). Perceptions of emotion from facial expressions are not culturally universal: evidence from a remote culture. Emotion, 14(2):251.
Gordon, I., Pierce, M. D., Bartlett, M. S., and Tanaka, J. W. (2014). Training facial expression production in children on the autism spectrum. Journal of autism and developmental disorders, 44(10):2486–2498.
Grynszpan, O., Martin, J.-C., and Nadel, J. (2008). Multimedia interfaces for users with high functioning autism: An empirical investigation. International Journal of Human-Computer Studies, 66(8):628–639.
Grynszpan, O., Nadel, J., Martin, J.-C., Simonin, J., Bailleul, P., Wang, Y., Gepner, D., Le Barillier, F., and Constant, J. (2012). Self-monitoring of gaze in high functioning autism. Journal of autism and developmental disorders, 42(8):1642–1650.
Hansen, D. W. and Ji, Q. (2010). In the eye of the beholder: A survey of models for eyes and gaze. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32(3):478–500.
Harrold, N., Tan, C. T., Rosser, D., and Leong, T.W. (2014). Copyme: a portable real-time feedback expression recognition game for children. In CHI’14 Extended Abstracts on Human Factors in Computing Systems, pages 1195–1200. ACM.
Hopkins, I. M., Gower, M. W., Perez, T. A., Smith, D. S., Amthor, F. R., Wimsatt, F. C., and Biasini, F. J. (2011). Avatar assistant: improving social skills in students with an asd through a computer-based intervention. Journal of autism and developmental disorders, 41(11):1543–1555.
Jasmin, E., Couture, M., McKinley, P., Reid, G., Fombonne, E., and Gisel, E. (2009). Sensori-motor and daily living skills of preschool children with autism spectrum disorders. Journal of autism and developmental disorders, 39(2):231–241.
Kandalaft, M. R., Didehbani, N., Krawczyk, D. C., Allen, T. T., and Chapman, S. B. (2013). Virtual reality social cognition training for young adults with high-functioning autism. Journal of Autism and Developmental Disorders, 43(1):34–44.
Klin, A. (2006). Autismo e síndrome de asperger: uma visão geral. Revista Brasileira de Psiquiatria, 28(1):3–11.
Madsen, M., El Kaliouby, R., Goodwin, M., and Picard, R. (2008). Technology for justin-time in-situ learning of facial affect for persons diagnosed with an autism spectrum disorder. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, pages 19–26. ACM.
Matson, J. L. and Kozlowski, A. M. (2011). The increasing prevalence of autism spectrum disorders. Research in Autism Spectrum Disorders, 5(1):418–425.
Minio-Paluello, I., Baron-Cohen, S., Avenanti, A., Walsh, V., and Aglioti, S. M. (2009). Absence of embodied empathy during pain observation in asperger syndrome. Biological psychiatry, 65(1):55–62.
Moore, D., Cheng, Y., McGrath, P., and Powell, N. J. (2005). Collaborative virtual environment technology for people with autism. Focus on Autism and Other Developmental Disabilities, 20(4):231–243.
Oberman, L. M.,Winkielman, P., and Ramachandran, V. S. (2007). Face to face: Blocking facial mimicry can selectively impair recognition of emotional expressions. Social neuroscience, 2(3-4):167–178.
Picard, R. W., Vyzas, E., and Healey, J. (2001). Toward machine emotional intelligence: Analysis of affective physiological state. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 23(10):1175–1191.
Ryokai, K., Raffle, H., and Kowalski, R. (2012). Storyfaces: pretend-play with ebooks to support social-emotional storytelling. In Proceedings of the 11th International Conference on Interaction Design and Children, pages 125–133. ACM.
San Agustin, J., Skovsgaard, H., Mollenbach, E., Barret, M., Tall, M., Hansen, D.W., and Hansen, J. P. (2010). Evaluation of a low-cost open-source gaze tracker. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, pages 77–80. ACM.
Santos, A., Chaminade, T., Da Fonseca, D., Silva, C., Rosset, D., and Deruelle, C. (2012). Just another social scene: evidence for decreased attention to negative social scenes in high-functioning autism. Journal of autism and developmental disorders, 42(9):1790–1798.
Serret, S., Hun, S., Iakimova, G., Lozada, J., Anastassova, M., Santos, A., Vesperini, S., and Askenazy, F. (2014). Facing the challenge of teaching emotions to individuals with low-and high-functioning autism using a new serious game: a pilot study. Molecular autism, 5(1):37.
Silver, M. and Oakes, P. (2001). Evaluation of a new computer intervention to teach people with autism or asperger syndrome to recognize and predict emotions in others. Autism, 5(3):299–316.
Tanaka, J.W., Lincoln, S., and Hegg, L. (2003). A framework for the study and treatment of face processing deficits in autism. The development of face processing, pages 101–119.
Tanaka, J. W., Wolf, J. M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S., Kaiser, M. D., and Schultz, R. T. (2010). Using computerized games to teach face recognition skills to children with autism spectrum disorder: The let’s face it! program. Journal of Child Psychology and Psychiatry, 51(8):944–952.
Tanaka, J. W., Wolf, J. M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S. S., South, M., McPartland, J. C., et al. (2012). The perception and identification of facial emotions in individuals with autism spectrum disorders using the let’s face it! emotion skills battery. Journal of Child Psychology and Psychiatry, 53(12):1259–1267.
Wang, X., Desalvo, N., Gao, Z., Zhao, X., Lerman, D. C., Gnawali, O., and Shi, W. (2014). Eye contact conditioning in autistic children using virtual reality technology. In Pervasive Computing Paradigms for Mental Health, pages 79–89. Springer.
Xu, B. and Tanaka, J. W. (2014). Teaching children with autism to recognize faces. In Comprehensive Guide to Autism, pages 1043–1059. Springer.
Zablotsky, B., Black, L., Maenner, M., Schieve, L., and Blumberg, S. (2015). Estimated prevalence of autism and other developmental disabilities following questionnaire changes in the 2014 national health interview survey. National health statistics reports, (87):1–21.
Publicado
04/07/2016
Como Citar
PRADI, Thiago; SILVA, Luciano; BELLON, Olga R. P.; DÓRIA, Gustavo M. S..
Ferramentas de computação visual para apoio ao treinamento de expressões faciais por autistas: uma revisão de literatura. In: SEMINÁRIO INTEGRADO DE SOFTWARE E HARDWARE (SEMISH), 43. , 2016, Porto Alegre.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2016
.
p. 1760-1771.
ISSN 2595-6205.
DOI: https://doi.org/10.5753/semish.2016.9525.
