ANALYSIS OF HUMAN GAZE: experimental studies of eye tracking to explain visual patterns in cognitive tasks

• Rafael Nobre Orsi FEI
• Carlos Eduardo Thomaz FEI

DOI: https://doi.org/10.5753/sbcas_estendido.2024.2186

Abstract

This thesis presents three experimental studies guided by a standard protocol for visual signal acquisition corresponding to human perception. The studies cover: analysis of visual patterns in reading tasks with stimuli that simulate conditions of visual stress; analysis of visual attention during the evaluation of facial expressions of pain in neonates; and analysis of pupil dilation during the perception of categorized emotional stimuli. The results show that it is possible to automatically classify visual reading patterns; that pain recognition in neonates occurs in less than 2 seconds; and that negative emotional stimuli can mobilize more brain processing resources than positive and neutral stimuli.

References

Balda, R. d. C. X., Guinsburg, R., de Almeida, M. F. B., de Araújo Peres, C., Miyoshi, M. H., and Kopelman, B. I. (2000). The recognition of facial expression of pain in full-term newborns by parents and health professionals. Archives of pediatrics & adolescent medicine, 154(10):1009–1016.

Campbell, B. A., Wood, G., and McBride, T. (1997). Origins of orienting and defensive responses: An evolutionary perspective. Attention and orienting: Sensory and motivational processes, pages 41–67.

Cornsweet, T. (2012). Visual perception. Academic press.

Duchowski, A. T. (2017). Eye tracking methodology. Springer.

Kahneman, D. (2011). Thinking, fast and slow. Farrar, Straus and Giroux, New York.

Lane, R. D., Chua, P. M., and Dolan, R. J. (1999). Common effects of emotional valence, arousal and attention on neural activation during visual processing of pictures. Neuropsychologia, 37(9):989–997.

Marieb, E. N., Wilhelm, P. B., and Mallat, J. (2014). Anatomia humana. Pearson Education do Brasil, São Paulo, 7 edition.

Marx, E., Deutschländer, A., Stephan, T., Dieterich, M., Wiesmann, M., and Brandt, T. (2004). Eyes open and eyes closed as rest conditions: impact on brain activation patterns. Neuroimage, 21(4):1818–1824.

Miyasaka, J. D. S., Vieira, R. V. G., Novalo-Goto, E. S., Montagna, E., and Wajnsztejn, R. (2019). Irlen syndrome: systematic review and level of evidence analysis. Arquivos de neuro-psiquiatria, 77(3):194–207.

Orsi, R. (2023). Análise do olhar humano: estudos experimentais de rastreamento o ocular para explicar padrões visual em tarefas cognitivas.

Orsi, R. N., Carlini, L. P., Heiderich, T. M., da Silva, G. V. T., Soares, J. d. C. A., Balda, R. d. C. X., Barros, M. C. d. M., Guinsburg, R., and Thomaz, C. E. (2023). Visual attention during neonatal pain assessment: A 2-s exposure to a facial expression is sufficient. Electronics Letters, 59(6):e12756.

Romei, V., Rihs, T., Brodbeck, V., and Thut, G. (2008). Resting electroencephalogram alpha-power over posterior sites indexes baseline visual cortex excitability. Neuroreport, 19(2):203–208.

Schupp, H. T., Markus, J., Weike, A. I., and Hamm, A. O. (2003). Emotional facilitation of sensory processing in the visual cortex. Psychological science, 14(1):7–13.

Solé, I. (2015). Estratégias de Leitura-6. Penso Editora.

Volchan, E., Pereira, M. G., Oliveira, L. d., Vargas, C., Mourão-Miranda, J., Azevedo, T. M. d., Machado-Pinheiro, W., and Pessoa, L. (2003). Estímulos emocionais: processamento sensorial e respostas motoras. Brazilian Journal of Psychiatry, 25:29–32.