Developing a System for Graphical Analysis of Brainwaves During Media Consumption
Resumo
This paper describes a data visualization artifact, designed to capture, analyze and generate an imprint of the user’s brainwaves from electroencephalographic readings in realtime during the consumption of media content. Such waves, naturally emitted by the human brain, will be mapped, categorized, stored and graphically printed within the scope of the Design Science Research methodology. The generated Brain Computer Interface can be used as an input in various systems, such as neuromarketing and media recommendation. Given that experience and perception of media consumption is variable and, therefore, subjective among individuals, this research aims to obtain relevant data in the context of studying multimedia interaction and development.
Palavras-chave:
BCI, data visualization, DSR, EEG, Eye-Tracking
Referências
Valdecir Becker, Matheus Cavalcanti, Thiago Silva, Jordan Elias, and Daniel Gambarro. 2020. Potencial das interfaces cérebro máquina no aprimoramento da recomendação de conteúdos em sistemas de áudio e vídeo sob demanda. In Proceedings of the 9th Iberoamerican Conference on Applications and Usability of Interactive TV - jAUTI 2020, Masaaki Kurosu (Ed.). UA editora Universidade de Aveiro Serviços de Biblioteca, Informação documental e Museologia, 21–27.
Valdecir Becker, Matheus Cavalcanti, Thiago Silva, Edvaldo Vasconcelos, Alessandro Pinon, and Felipe Melo. 2022. A System for Graphical Visualization of Brainwaves to Analyse Media Content Consumption. In Human-Computer Interaction. Technological Innovation, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 318–328.
Emotiv. 2022. Cortex API Getting Started. Retrieved August 8, 2022 from https://emotiv.gitbook.io/cortex-api/
Emotiv. 2022. cortex-v2-example. Retrieved August 07, 2022 from https://github.com/Emotiv/cortex-v2-example
Yifei Lu, Wei-Long Zheng, Binbin Li, and Bao-Liang Lu. 2015. Combining Eye Movements and EEG to Enhance Emotion Recognition. In Proceedings of the 24th International Conference on Artificial Intelligence (Buenos Aires, Argentina) (IJCAI’15). AAAI Press, 1170–1176.
Juan-Miguel López-Gil, Jordi Virgili-Gomá, Rosa Gil, Teresa Guilera, Iolanda Batalla, Jorge Soler-González, and Roberto García. 2016. Method for Improving EEG Based Emotion Recognition by Combining It with Synchronized Biometric and Eye Tracking Technologies in a Non-invasive and Low Cost Way. Frontiers in Computational Neuroscience 10 (2016). https://doi.org/10.3389/fncom.2016.00085
Thiago Henrique Coelho Tavares da SILVA, Matheus Dantas CAVALCANTI, and Valdecir BECKER. 2022. DESENVOLVIMENTO DE UM SISTEMA PARA VISUALIZAÇÃO GRÁFICA DE ONDAS NEURAIS DURANTE CONSUMO DE CONTEÚDOS MIDIÁTICOS. IV Jornada Internacional GEMInIS (JIG 2021) - https://doity.com.br/anais/jig2021/ (03 2022). [link]
the pandas development team. 2022. DataFrame. Retrieved August 8, 2022 from https://pandas.pydata.org/pandas-docs/stable/reference/frame.html
Songhua Xu, Hao Jiang, and Francis C.M. Lau. 2008. Personalized Online Document, Image and Video Recommendation via Commodity Eye-Tracking (RecSys ’08). Association for Computing Machinery, New York, NY, USA, 83–90. https://doi.org/10.1145/1454008.1454023
Valdecir Becker, Matheus Cavalcanti, Thiago Silva, Edvaldo Vasconcelos, Alessandro Pinon, and Felipe Melo. 2022. A System for Graphical Visualization of Brainwaves to Analyse Media Content Consumption. In Human-Computer Interaction. Technological Innovation, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 318–328.
Emotiv. 2022. Cortex API Getting Started. Retrieved August 8, 2022 from https://emotiv.gitbook.io/cortex-api/
Emotiv. 2022. cortex-v2-example. Retrieved August 07, 2022 from https://github.com/Emotiv/cortex-v2-example
Yifei Lu, Wei-Long Zheng, Binbin Li, and Bao-Liang Lu. 2015. Combining Eye Movements and EEG to Enhance Emotion Recognition. In Proceedings of the 24th International Conference on Artificial Intelligence (Buenos Aires, Argentina) (IJCAI’15). AAAI Press, 1170–1176.
Juan-Miguel López-Gil, Jordi Virgili-Gomá, Rosa Gil, Teresa Guilera, Iolanda Batalla, Jorge Soler-González, and Roberto García. 2016. Method for Improving EEG Based Emotion Recognition by Combining It with Synchronized Biometric and Eye Tracking Technologies in a Non-invasive and Low Cost Way. Frontiers in Computational Neuroscience 10 (2016). https://doi.org/10.3389/fncom.2016.00085
Thiago Henrique Coelho Tavares da SILVA, Matheus Dantas CAVALCANTI, and Valdecir BECKER. 2022. DESENVOLVIMENTO DE UM SISTEMA PARA VISUALIZAÇÃO GRÁFICA DE ONDAS NEURAIS DURANTE CONSUMO DE CONTEÚDOS MIDIÁTICOS. IV Jornada Internacional GEMInIS (JIG 2021) - https://doity.com.br/anais/jig2021/ (03 2022). [link]
the pandas development team. 2022. DataFrame. Retrieved August 8, 2022 from https://pandas.pydata.org/pandas-docs/stable/reference/frame.html
Songhua Xu, Hao Jiang, and Francis C.M. Lau. 2008. Personalized Online Document, Image and Video Recommendation via Commodity Eye-Tracking (RecSys ’08). Association for Computing Machinery, New York, NY, USA, 83–90. https://doi.org/10.1145/1454008.1454023
Publicado
07/11/2022
Como Citar
SILVA, Thiago Henrique Coelho Tavares da; CAVALCANTI, Matheus Dantas; MARINHO, Isaac Nóbrega; BECKER, Valdecir.
Developing a System for Graphical Analysis of Brainwaves During Media Consumption. In: CONCURSO DE TRABALHOS DE INICIAÇÃO CIENTÍFICA - SIMPÓSIO BRASILEIRO DE SISTEMAS MULTIMÍDIA E WEB (WEBMEDIA), 28. , 2022, Curitiba.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
p. 49-52.
ISSN 2596-1683.
DOI: https://doi.org/10.5753/webmedia_estendido.2022.227061.
