A Socioenactive Perspective on Emotion Contagion and Senses: Analyzing the Phenomenon via EEG Signals

Resumo


Emotion contagion is a phenomenon in which emotions are transmitted from one to another in social interactions. In this process, our senses are involved because our body perceives the environment through them. Many activities are triggered between our mind, body, and the space around us involving sensory-motor, perception, and cognition aspects. All the aforementioned aspects are studied by the Socioenactive perspective in the frame of relationships connecting the social, physical, and digital worlds. This research explores the Socioenactive perspective into the emotion contagion phenomenon in the interaction with computational systems. Our study used an EEG device to collect brain wave data from 21 participants in a scenario of potential emotional contagion. Our analysis adopted the Transform Fourier technique to get features in brain wavelets of happiness, fear, anger, and sadness emotional states. The brain waves analysis considering the amplitude and frequency allows for finding features associated with each kind of emotional state. A post-experiment questionnaire was used to gather self-reported emotional states from participants. We investigated the relations between emotional states data gathered by the self-report and by brain waves directly. The results shown through the self-report and brain waves indicate that 71% of participants felt the happiness emotion; 38% of participants felt the sadness emotion; the fear and anger emotion resulted in 24% and 19% of the cases, respectively.
Palavras-chave: emotional contagion, brain-waves, EEG, senses, perception, socioenactive

Referências

M Cecília C Baranauskas. 2014. Social awareness in HCI. interactions 21, 4 (2014), 66–69.

Maria Cecília C Baranauskas. 2015. Sistemas sócio-enativos: investigando novas dimensões no design da interação mediada por tecnologias de informação e comunicação. FAPESP Thematic Project (2015/165280) (2015).

M Cecília C Baranauskas, Yusseli Lizeth Méndez Mendoza, and Emanuel Felipe Duarte. 2021. Designing for a socioenactive experience: A case study in an educational workshop on deep time. International Journal of Child-Computer Interaction 29 (2021), 100287.

Hayfa Blaiech, Mohamed Neji, Ali Wali, and Adel M Alimi. 2013. Emotion recognition by analysis of EEG signals. In 13th International Conference on Hybrid Intelligent Systems (HIS 2013). IEEE, 312–318.

Ricardo Caceffo, Diego Addan Gonçalves, Rodrigo Bonacin, Julio Cesar dos Reis, José A Valente, and Maria Cecília Calani Baranauskas. 2022. Children’s social interactions within a socioenactive scenario. Computers & Education 176 (2022), 104324.

Henry Candra, Mitchell Yuwono, Ardi Handojoseno, Rifai Chai, Steven Su, and Hung T Nguyen. 2015. Recognizing emotions from EEG subbands using wavelet analysis. In 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, 6030–6033.

Tom Clarke and Alan Costall. 2008. The emotional connotations of color: A qualitative investigation. Color Research & Application: Endorsed by Inter-Society Color Council, The Colour Group (Great Britain), Canadian Society for Color, Color Science Association of Japan, Dutch Society for the Study of Color, The Swedish Colour Centre Foundation, Colour Society of Australia, Centre Français de la Couleur 33, 5 (2008), 406–410.

Giovanna Colombetti. 2017. Enactive affectivity, extended. Topoi 36, 3 (2017), 445–455.

José Valderlei da Silva, Vanessa RML Maike, Luã M Muriana, Camilla VLT Brennand, Roberto Pereira, Tânia Lima, and Maria Cecília C Baranauskas. 2019. Explorando afeto e sócioenaçao no cenário de um hospital. Technical Report. Technical Report IC-19-02. Institute of Computing, University of Campinas.

Emanuel Felipe Duarte and M Cecília C Baranauskas. 2018. Interart: Learning human-computer interaction through the making of interactive art. In Human-Computer Interaction. Theories, Methods, and Human Issues: 20th International Conference, HCI International 2018, Las Vegas, NV, USA, July 15–20, 2018, Proceedings, Part I 20. Springer, 35–54.

Emanuel Felipe Duarte, Vanessa Maike, Yusseli Lizeth Méndez Mendoza, Camilla Brennand, and M Cecília Baranauskas. 2019. " The Magic of Science:" Beyond Action, a Case Study on Learning Through Socioenaction. In Anais do XXV Workshop de Informática na Escola. SBC, 501–510.

Emanuel Felipe Duarte, VRML Maike, Yusseli Lizeth Méndez Mendoza, Camilla Valéria de Lima Tenório, and M Cecília C Baranauskas. 2019. A hands-on experience with interactive art within a museum scenario. Technical Report. Technical Report IC-19-03, Institute of Computing (IC), University of ….

Geovanna Evelyn Taype Espinoza and Maria Cecilia Calani Baranauskas. 2020. Designing Socially-Aware Persuasive Systems: a Proposed Framework. In Anais do XLVII Seminário Integrado de Software e Hardware. SBC, 234–245.

Geovanna Evelyn Taype Espinoza and Maria Cecília Calani Baranauskas. 2020. Motivation, persuasion and healthy eating: a case study on a socially-aware persuasive system design. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems. 1–10.

Thomas Fuchs. 2017. Ecology of the brain: The phenomenology and biology of the embodied mind. Oxford University Press.

Jennifer Marie Binzak Fugate and Courtny L Franco. 2019. What color is your anger? Assessing color-emotion pairings in English speakers. Frontiers in Psychology (2019), 206.

Diego Addan Gonçalves, Ricardo Edgard Caceffo, and Maria Cecilia Calani Baranauskas. 2021. Analysis of Emotion in Socioenactive Systems. In Human-Computer Interaction. Theory, Methods and Tools: Thematic Area, HCI 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings, Part I 23. Springer, 535–544.

Elaine Hatfield, John T Cacioppo, and Richard L Rapson. 1993. Emotional contagion. Current directions in psychological science 2, 3 (1993), 96–100.

Carolina Herrando and Efthymios Constantinides. 2021. Emotional contagion: a brief overview and future directions. Frontiers in psychology 12 (2021), 712606.

Tim Ingold. 2011. Being alive: Essays on movement, knowledge and description. Routledge.

Yuuna ISHIKAMI and Hisaya TANAKA. 2022. Emotional Contagion and Mirror System Activity in the Highly Sensitive Person. In International Symposium on Affective Science and Engineering ISASE2022. Japan Society of Kansei Engineering, 1–4.

Noppadon Jatupaiboon, Setha Pan-Ngum, and Pasin Israsena. 2013. Real-time EEG-based happiness detection system. The Scientific World Journal 2013 (2013).

Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive systems and enactive media: embodied human-machine coupling beyond interfaces. Leonardo 44, 5 (2011), 433–438.

Elizabeth A Kensinger. 2004. Remembering emotional experiences: The contribution of valence and arousal. Reviews in the Neurosciences 15, 4 (2004), 241–252.

Christian G Kohler, Travis Turner, Neal M Stolar, Warren B Bilker, Colleen M Brensinger, Raquel E Gur, and Ruben C Gur. 2004. Differences in facial expressions of four universal emotions. Psychiatry research 128, 3 (2004), 235–244.

Tian-Hao Li, Wei Liu, Wei-Long Zheng, and Bao-Liang Lu. 2019. Classification of five emotions from EEG and eye movement signals: Discrimination ability and stability over time. In 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE, 607–610.

Vanessa Regina Margareth Lima Maike and M Cecília C Baranauskas. 2019. An Enactive Perspective on Emotion: A Case Study on Monitoring Brainwaves. In Augmented Cognition: 13th International Conference, AC 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26–31, 2019, Proceedings 21. Springer, 418–435.

Yusseli Lizeth Méndez Mendoza and M Cecília C Baranauskas. 2021. Designing a tangible tabletop installation and enacting a socioenactive experience with TangiTime. Journal of the Brazilian Computer Society 27, 1 (2021), 1–22.

Luã Marcelo Muriana, José Valderlei d Silva, Andressa Cristina dos Santos, and Maria Cecília C Baranauskas. 2019. Affective state, self-esteem and technology: an exploratory study with children in hospital context. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. 1–11.

M Murugappan and Subbulakshmi Murugappan. 2013. Human emotion recognition through short time Electroencephalogram (EEG) signals using Fast Fourier Transform (FFT). In 2013 IEEE 9th International Colloquium on Signal Processing and its Applications. IEEE, 289–294.

Leonor Neves, Carolina Cordeiro, Sophie K Scott, São Luís Castro, and César F Lima. 2018. High emotional contagion and empathy are associated with enhanced detection of emotional authenticity in laughter. Quarterly Journal of Experimental Psychology 71, 11 (2018), 2355–2363.

Dan Nie, Xiao-Wei Wang, Li-Chen Shi, and Bao-Liang Lu. 2011. EEG-based emotion recognition during watching movies. In 2011 5th International IEEE/EMBS Conference on Neural Engineering. IEEE, 667–670.

Becky L Omdahl and Carol O’Donnell. 1999. Emotional contagion, empathic concern and communicative responsiveness as variables affecting nurses’ stress and occupational commitment. Journal of Advanced Nursing 29, 6 (1999), 1351–1359.

Jaak Panksepp. 2004. Affective neuroscience: The foundations of human and animal emotions. Oxford university press.

Lara Schibelsky G Piccolo, Elaine CS Hayashi, and Maria Cecília C Baranauskas. 2010. The evaluation of affective quality in social software: preliminary thoughts. II WAIHCWS, IHC2010 (2010), 29–38.

Jessica Sharmin Rahman, Tom Gedeon, Sabrina Caldwell, and Richard Jones. 2020. Brain melody informatics: analysing effects of music on brainwave patterns. In 2020 international joint conference on neural networks (ijcnn). IEEE, 1–8.

Andressa C dos Santos, Luã M Muriana, Josiane ROG Pimenta, José V da Silva, Eliana A Moreira, and Julio C dos Reis. 2019. Investigating aspects of affectibility for universal access in socioenactive system scenarios. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. 1–11.

Laura Sels, Anh Tran, Katharine H Greenaway, Lesley Verhofstadt, and Elise K Kalokerinos. 2021. The social functions of positive emotions. Current Opinion in Behavioral Sciences 39 (2021), 41–45.

José Valderlei da Silva and M Cecília C Baranauskas. 2020. Interaction spaces and socioenactive dimensions: exploring perturbations of IoHT. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems. 1–10.

Geovanna Evelyn Espinoza Taype and Maria Cecilia Baranauskas Calani. 2020. Extending persuasive system design frameworks: an exploratory study. In Information Technology and Systems: Proceedings of ICITS 2020. Springer, 35–45.

Amrisha Vaish, Tobias Grossmann, and Amanda Woodward. 2008. Not all emotions are created equal: the negativity bias in social-emotional development.Psychological bulletin 134, 3 (2008), 383.

José Armando Valente, Ricardo Caceffo, Rodrigo Bonacin, Julio Cesar dos Reis, Diego Addan Gonçalves, and Maria Cecília Calani Baranauskas. 2021. Embodied-based environment for kindergarten children: Revisiting constructionist ideas. British Journal of Educational Technology 52, 3 (2021), 986–1003.

Francisco J Varela, Evan Thompson, and Eleanor Rosch. 2016. The embodied mind: Cognitive science and human experience. MIT press.

Minchang Yu, Shasha Xiao, Minlei Hua, Hui Wang, Xi Chen, Feng Tian, and Yingjie Li. 2022. EEG-based emotion recognition in an immersive virtual reality environment: From local activity to brain network features. Biomedical Signal Processing and Control 72 (2022), 103349.

Yingying Zhao, Yuhu Chang, Yutian Lu, Yujiang Wang, Mingzhi Dong, Qin Lv, Robert P Dick, Fan Yang, Tun Lu, Ning Gu, 2022. Do Smart Glasses Dream of Sentimental Visions? Deep Emotionship Analysis for Eyewear Devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1–29.

Jia-Yi Zhu, Wei-Long Zheng, Yong Peng, Ruo-Nan Duan, and Bao-Liang Lu. 2014. EEG-based emotion recognition using discriminative graph regularized extreme learning machine. In 2014 International Joint Conference on Neural Networks (IJCNN). IEEE, 525–532.
Publicado
16/10/2023
ESPINOZA TAYPE, Geovanna Evelyn; DOS REIS, Julio Cesar; CALANI BARANAUSKAS, Maria Cecília. A Socioenactive Perspective on Emotion Contagion and Senses: Analyzing the Phenomenon via EEG Signals. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 22. , 2023, Maceió/AL. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2023 .