Requirements Gathering for the Development of a Game for Therapy Sessions with Autistic Children to Encourage Social Communication
Abstract
Children with Autism Spectrum Disorder (ASD) are very sensitive to social situations and have difficulties interacting with their peers. In order to mitigate this difficulty, therapeutic treatment is often used. Games, which can be used for many different purposes, can also be used as an Assistive Technology (AT) in the therapy process, in order to encourage social communication and collaboration, which are very important skills in daily life. A Systematic Review (SR) was conducted using two research questions to gather more information about the theme. In parallel, a survey was applied to support the results of the SR. We found that genres of games that are likely to enhance collaboration are collaborative brain games (such as puzzle or memory games). We also found that games should be very minimalist (with a low number of players) and contain clear language, avoiding figures of speech. The results of this paper will be used as a basis to develop a game as an AT for the therapy of children with ASD in the future.
Keywords:
serious game, collaboration virtual environment, social interaction, Children with Autism Spectrum Disorder
References
Maha Abdelmohsen and Yasmine Arafa. 2021. Jammo virtual robot enhances the social skills of children with HFA: Development and deployment. GoodIT 2021 - Proceedings of the 2021 Conference on Information Technology for Social Good, 180–185. https://doi.org/10.1145/3462203.3475928
Ashwaq Z. Amat, Huan Zhao, Amy Swanson, Amy S. Weitlauf, Zachary Warren, and Nilanjan Sarkar. 2021. Design of an Interactive Virtual Reality System, InViRS, for Joint Attention Practice in Autistic Children. IEEE Transactions on Neural Systems and Rehabilitation Engineering 29 (2021), 1866–1876. https://doi.org/10.1109/TNSRE.2021.3108351
Pradeep Raj Krishnappa Babu and Uttama Lahiri. 2020. Multiplayer interaction platform with gaze tracking for individuals with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering 28 (2020), 2443–2450. Issue 11. https://doi.org/10.1109/TNSRE.2020.3026655
Pradeep Raj Krishnappa Babu, Sujata Sinha, A. Arvind Roshaan, and Uttama Lahiri. 2019. Virtual Reality Based Collaborative Multiplayer Task Platform for Children with Autism. 2019 10th International Conference on Computing, Communication and Networking Technologies, ICCCNT 2019 (2019), 6–12. https://doi.org/10.1109/ICCCNT45670.2019.8944889
Gökçe Elif Baykal, Maarten Van Mechelen, and Eva Eriksson. 2020. Collaborative Technologies for Children with Special Needs: A Systematic Literature Review. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3313831.3376291
Ciera Crowell. 2018. Interaction design of full-body interactive play experiences for children with autism. CHI PLAY 2018 - Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts, 11–15. https://doi.org/10.1145/3270316.3270606
Ciera Crowell and Narcis Pares. 2018. Variations between perceptions of interpersonal distance in virtual environments for autism. CHI PLAY 2018 - Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (2018), 415–421. https://doi.org/10.1145/3270316.3271537
Arnaud Dapogny, Charline Grossard, Stephanie Hun, Sylvie Serret, Jeremy Bourgeois, Hedy Jean-Marie, Pierre Foulon, Huaxiong Ding, Liming Chen, Severine Dubuisson, Ouriel Grynszpan, David Cohen, and Kevin Bailly. 2018. JEMImE: A serious game to teach children with ASD how to adequately produce facial expressions. Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, 723–730. https://doi.org/10.1109/FG.2018.00114
Tom Giraud, Brian Ravenet, Chi Tai Dang, Jacqueline Nadel, Elise Prigent, Gael Poli, Elisabeth Andre, and Jean Claude Martin. 2021. "Can you help me move this over there?": Training children with ASD to joint action through tangible interaction and virtual agent. TEI 2021 - Proceedings of the 15th International Conference on Tangible, Embedded, and Embodied Interaction. https://doi.org/10.1145/3430524.3440646
Javier Gomez, Letizia Jaccheri, Juan Carlos Torrado, and Germán Montoro. 2018. Leo con Lula, introducing global reading methods to children with ASD. IDC 2018 - Proceedings of the 2018 ACM Conference on Interaction Design and Children, 420–426. https://doi.org/10.1145/3202185.3202765
Shing ling Wu, Meng Hsiang Hsu, Ching Tien Shih, and Shu Chen Hsu. 2019. Multi-mouse single display groupware game & animation developed based on the construction of effective exploration digital game based learning activities to enhance the autism disorder social interactive behaviors. PervasiveHealth: Pervasive Computing Technologies for Healthcare, 78–82. https://doi.org/10.1145/3337682.3337692
Andrew Lu, Sandra Chan, Yiyu Cai, Lihui Huang, Zin Tun Nay, and Sui Lin Goei. 2018. Learning through VR gaming with virtual pink dolphins for children with ASD. Interactive Learning Environments 26 (8 2018), 718–729. Issue 6. https://doi.org/10.1080/10494820.2017.1399149
Jhemeson Silva Mota, Edna Dias Canedo, Kennedy Santos Torres, and Heloise Acco Tives Leao. 2020. AssociAR: Gamified Process for the Teaching of Children with Autism through the Association of Images and Words. Proceedings - Frontiers in Education Conference, FIE 2020-October. https://doi.org/10.1109/FIE44824.2020.9274271
Milla Rahmadiva, Achmad Arifin, Muhammad Hilman Fatoni, Siti Halimah Baki, and Takashi Watanabe. 2019. A Design of Multipurpose Virtual Reality Game for Children with Autism Spectrum Disorder. In 2019 International Biomedical Instrumentation and Technology Conference (IBITeC), Vol. 1. 1–6. https://doi.org/10.1109/IBITeC46597.2019.9091713
Kathryn E. Ringland. 2019. "do you work for aperture science?": Researching and finding the gamer identity in a minecraft community for autistic children. ACM International Conference Proceeding Series. https://doi.org/10.1145/3337722.3337766
Stephen Brian Sulkes. 2022. Autism Spectrum Disorders. Retrieved March 13, 2022 from [link].
Gijs Terlouw, Derek Kuipers, Job Van’t Veer, Jelle T. Prins, and Jean Pierre E.N. Pierie. 2021. The development of an escape room–based serious game to trigger social interaction and communication between high-functioning children with autism and their peers: Iterative design approach. JMIR Serious Games 9 (1 2021). Issue 1. https://doi.org/10.2196/19765
Juliana Vinuto. 2014. A amostragem em bola de neve na pesquisa qualitativa: um debate em aberto. Tematicas 22, 44 (dez. 2014), 203–220. https://doi.org/10.20396/tematicas.v22i44.10977
Xianhui Wang, Wanli Xing, and James M. Laffey. 2018. Autistic youth in 3D game-based collaborative virtual learning: Associating avatar interaction patterns with embodied social presence. British Journal of Educational Technology 49 (7 2018), 742–760. Issue 4. https://doi.org/10.1111/bjet.12646
Qin Wu, Chenmei Yu, Yanjun Chen, Jiayu Yao, Xi Wu, Xiaolan Peng, and Teng Han. 2020. Squeeze the Ball: Designing an Interactive Playground towards Aiding Social Activities of Children with Low-Function Autism. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3313831.3376888
Lian Zhang, Ashwaq Z. Amat, Huan Zhao, Amy Swanson, Amy Weitlauf, Zachary Warren, and Nilanjan Sarkar. 2021. Design of an Intelligent Agent to Measure Collaboration and Verbal-Communication Skills of Children with Autism Spectrum Disorder in Collaborative Puzzle Games. IEEE Transactions on Learning Technologies 14 (6 2021), 338–352. Issue 3. https://doi.org/10.1109/TLT.2020.3029223
Lian Zhang, Qiang Fu, Amy Swanson, Amy Weitlauf, Zachary Warren, and Nilanjan Sarkar. 2018. Design and Evaluation of a Collaborative Virtual Environment (CoMove) for Autism Spectrum Disorder Intervention. ACM Transactions on Accessible Computing 11 (6 2018), 1–22. Issue 2. https://doi.org/10.1145/3209687
Huan Zhao, Ashwaq Zaini Amat, Miroslava Migovich, Amy Swanson, Amy S.Weitlauf, ZacharyWarren, and Nilanjan Sarkar. 2021. C-Hg: A Collaborative Haptic-Gripper Fine Motor Skill Training System for Children with Autism Spectrum Disorder. ACM Transactions on Accessible Computing 14 (7 2021). Issue 2. https://doi.org/10.1145/3459608
Huan Zhao, Amy R. Swanson, Amy S. Weitlauf, Zachary E. Warren, and Nilanjan Sarkar. 2018. Hand-in-Hand: A Communication-Enhancement Collaborative Virtual Reality System for Promoting Social Interaction in Children with Autism Spectrum Disorders. IEEE Transactions on Human-Machine Systems 48 (4 2018), 136–148. Issue 2. https://doi.org/10.1109/THMS.2018.2791562
Ashwaq Z. Amat, Huan Zhao, Amy Swanson, Amy S. Weitlauf, Zachary Warren, and Nilanjan Sarkar. 2021. Design of an Interactive Virtual Reality System, InViRS, for Joint Attention Practice in Autistic Children. IEEE Transactions on Neural Systems and Rehabilitation Engineering 29 (2021), 1866–1876. https://doi.org/10.1109/TNSRE.2021.3108351
Pradeep Raj Krishnappa Babu and Uttama Lahiri. 2020. Multiplayer interaction platform with gaze tracking for individuals with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering 28 (2020), 2443–2450. Issue 11. https://doi.org/10.1109/TNSRE.2020.3026655
Pradeep Raj Krishnappa Babu, Sujata Sinha, A. Arvind Roshaan, and Uttama Lahiri. 2019. Virtual Reality Based Collaborative Multiplayer Task Platform for Children with Autism. 2019 10th International Conference on Computing, Communication and Networking Technologies, ICCCNT 2019 (2019), 6–12. https://doi.org/10.1109/ICCCNT45670.2019.8944889
Gökçe Elif Baykal, Maarten Van Mechelen, and Eva Eriksson. 2020. Collaborative Technologies for Children with Special Needs: A Systematic Literature Review. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3313831.3376291
Ciera Crowell. 2018. Interaction design of full-body interactive play experiences for children with autism. CHI PLAY 2018 - Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts, 11–15. https://doi.org/10.1145/3270316.3270606
Ciera Crowell and Narcis Pares. 2018. Variations between perceptions of interpersonal distance in virtual environments for autism. CHI PLAY 2018 - Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (2018), 415–421. https://doi.org/10.1145/3270316.3271537
Arnaud Dapogny, Charline Grossard, Stephanie Hun, Sylvie Serret, Jeremy Bourgeois, Hedy Jean-Marie, Pierre Foulon, Huaxiong Ding, Liming Chen, Severine Dubuisson, Ouriel Grynszpan, David Cohen, and Kevin Bailly. 2018. JEMImE: A serious game to teach children with ASD how to adequately produce facial expressions. Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, 723–730. https://doi.org/10.1109/FG.2018.00114
Tom Giraud, Brian Ravenet, Chi Tai Dang, Jacqueline Nadel, Elise Prigent, Gael Poli, Elisabeth Andre, and Jean Claude Martin. 2021. "Can you help me move this over there?": Training children with ASD to joint action through tangible interaction and virtual agent. TEI 2021 - Proceedings of the 15th International Conference on Tangible, Embedded, and Embodied Interaction. https://doi.org/10.1145/3430524.3440646
Javier Gomez, Letizia Jaccheri, Juan Carlos Torrado, and Germán Montoro. 2018. Leo con Lula, introducing global reading methods to children with ASD. IDC 2018 - Proceedings of the 2018 ACM Conference on Interaction Design and Children, 420–426. https://doi.org/10.1145/3202185.3202765
Shing ling Wu, Meng Hsiang Hsu, Ching Tien Shih, and Shu Chen Hsu. 2019. Multi-mouse single display groupware game & animation developed based on the construction of effective exploration digital game based learning activities to enhance the autism disorder social interactive behaviors. PervasiveHealth: Pervasive Computing Technologies for Healthcare, 78–82. https://doi.org/10.1145/3337682.3337692
Andrew Lu, Sandra Chan, Yiyu Cai, Lihui Huang, Zin Tun Nay, and Sui Lin Goei. 2018. Learning through VR gaming with virtual pink dolphins for children with ASD. Interactive Learning Environments 26 (8 2018), 718–729. Issue 6. https://doi.org/10.1080/10494820.2017.1399149
Jhemeson Silva Mota, Edna Dias Canedo, Kennedy Santos Torres, and Heloise Acco Tives Leao. 2020. AssociAR: Gamified Process for the Teaching of Children with Autism through the Association of Images and Words. Proceedings - Frontiers in Education Conference, FIE 2020-October. https://doi.org/10.1109/FIE44824.2020.9274271
Milla Rahmadiva, Achmad Arifin, Muhammad Hilman Fatoni, Siti Halimah Baki, and Takashi Watanabe. 2019. A Design of Multipurpose Virtual Reality Game for Children with Autism Spectrum Disorder. In 2019 International Biomedical Instrumentation and Technology Conference (IBITeC), Vol. 1. 1–6. https://doi.org/10.1109/IBITeC46597.2019.9091713
Kathryn E. Ringland. 2019. "do you work for aperture science?": Researching and finding the gamer identity in a minecraft community for autistic children. ACM International Conference Proceeding Series. https://doi.org/10.1145/3337722.3337766
Stephen Brian Sulkes. 2022. Autism Spectrum Disorders. Retrieved March 13, 2022 from [link].
Gijs Terlouw, Derek Kuipers, Job Van’t Veer, Jelle T. Prins, and Jean Pierre E.N. Pierie. 2021. The development of an escape room–based serious game to trigger social interaction and communication between high-functioning children with autism and their peers: Iterative design approach. JMIR Serious Games 9 (1 2021). Issue 1. https://doi.org/10.2196/19765
Juliana Vinuto. 2014. A amostragem em bola de neve na pesquisa qualitativa: um debate em aberto. Tematicas 22, 44 (dez. 2014), 203–220. https://doi.org/10.20396/tematicas.v22i44.10977
Xianhui Wang, Wanli Xing, and James M. Laffey. 2018. Autistic youth in 3D game-based collaborative virtual learning: Associating avatar interaction patterns with embodied social presence. British Journal of Educational Technology 49 (7 2018), 742–760. Issue 4. https://doi.org/10.1111/bjet.12646
Qin Wu, Chenmei Yu, Yanjun Chen, Jiayu Yao, Xi Wu, Xiaolan Peng, and Teng Han. 2020. Squeeze the Ball: Designing an Interactive Playground towards Aiding Social Activities of Children with Low-Function Autism. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3313831.3376888
Lian Zhang, Ashwaq Z. Amat, Huan Zhao, Amy Swanson, Amy Weitlauf, Zachary Warren, and Nilanjan Sarkar. 2021. Design of an Intelligent Agent to Measure Collaboration and Verbal-Communication Skills of Children with Autism Spectrum Disorder in Collaborative Puzzle Games. IEEE Transactions on Learning Technologies 14 (6 2021), 338–352. Issue 3. https://doi.org/10.1109/TLT.2020.3029223
Lian Zhang, Qiang Fu, Amy Swanson, Amy Weitlauf, Zachary Warren, and Nilanjan Sarkar. 2018. Design and Evaluation of a Collaborative Virtual Environment (CoMove) for Autism Spectrum Disorder Intervention. ACM Transactions on Accessible Computing 11 (6 2018), 1–22. Issue 2. https://doi.org/10.1145/3209687
Huan Zhao, Ashwaq Zaini Amat, Miroslava Migovich, Amy Swanson, Amy S.Weitlauf, ZacharyWarren, and Nilanjan Sarkar. 2021. C-Hg: A Collaborative Haptic-Gripper Fine Motor Skill Training System for Children with Autism Spectrum Disorder. ACM Transactions on Accessible Computing 14 (7 2021). Issue 2. https://doi.org/10.1145/3459608
Huan Zhao, Amy R. Swanson, Amy S. Weitlauf, Zachary E. Warren, and Nilanjan Sarkar. 2018. Hand-in-Hand: A Communication-Enhancement Collaborative Virtual Reality System for Promoting Social Interaction in Children with Autism Spectrum Disorders. IEEE Transactions on Human-Machine Systems 48 (4 2018), 136–148. Issue 2. https://doi.org/10.1109/THMS.2018.2791562
Published
2022-06-22
How to Cite
PEIXOTO, Henrique de Oliveira; MORAES, Guilherme Brun; NUNES, Eunice P. dos Santos; BORGES, Luciana Correia L. F.; RODRIGUES, Kamila Rios da Hora.
Requirements Gathering for the Development of a Game for Therapy Sessions with Autistic Children to Encourage Social Communication. In: LIFE IMPROVEMENT IN QUALITY BY UBIQUITOUS EXPERIENCES WORKSHOP (LIQUE), 2. , 2022, Aveiro.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
p. 9-16.
DOI: https://doi.org/10.5753/lique.2022.19996.
