Evaluating the Perception of Others in a Remote Experience of Interaction: a Pilot Study


The social and physical distancing and the rapid transition to remote learning during pandemics had an impact on children's well-being. In this context, the Human-Computer Interaction (HCI) field envisaged challenges to design and evaluate computational systems. In this paper, we propose an evaluation instrument considering socio-affective aspects of the experience, and present results from a pilot study to evaluate the Aquarela Virtual system. The Aquarela Virtual system allows remotely situated children to interact in a playful way with others by using physical objects related to a children's song, and emoticons to express their emotions. Based on findings of these evaluations, we provide insights on other aspects to be covered by our proposed evaluation instrument, and improvements in the system.

Palavras-chave: evaluation, remote experience, pandemic, ubiquitous systems


Baranauskas, M. C. C. (2015). Socio-enactive systems: Investigating new dimensions in the design of interaction mediated by information and communication technologies. FAPESP Thematic Project (2015/165280) (2015).

Baranauskas, M. C. C., Mendoza, Y. L. M., and Duarte, E. F. (2021). Designing for a socioenactive experience: A case study in an educational workshop on deep time. International Journal of Child-Computer Interaction, 29:100287.

Bradley, M. M. and Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1):49–59.

Cianfarani, S. and Pampanini, V. (2021). The impact of stress on health in childhood and adolescence in the era of the covid-19 pandemic. Hormone Research in Paediatrics.

Duarte, E. F., Mendoza, Y. L. M., de Queiroz, M. J. N., de Oliveira Gaia Pimenta, J. R., da Silva, J. V., and Baranauskas, M. C. C. (2022). Aquarela virtual: Design e desenvolvimento de um sistema socioenativo em contexto de isolamento social. Technical Report IC-22-01, Institute of Computing, University of Campinas.

Díaz-Oreiro, I., López, G., Quesada, L., and Guerrero, L. A. (2019). Standardized questionnaires for user experience evaluation: A systematic literature review. Proceedings, 31(1).

Gallagher, S. and Lindgren, R. (2016). Enactive metaphors: Learning through full-body engagement. Educational Psychology Review, 27:391–404.

Harms, C. and Biocca, F. (2004). Internal consistency and reliability of the networked minds measure of social presence. In Alcaniz, M. and Rey, B., editors, Seventh Annual International Workshop: Presence.

Harrison, S., Tatar, D., and Sengers, P. (2007). The three paradigms of hci. Session at the SIGCHI Conference on human factors in computing systems.

Hassenzahl, M., Burmester, M., and Koller, F. (2003). Attrakdiff: Ein fragebogen zur messung wahrgenommener hedonischer und pragmatischer qualität. In Szwillus, G. and Ziegler, J., editors, Mensch & Computer 2003: Interaktion in Bewegung, pages 187–196. Vieweg+Teubner Verlag, Wiesbaden.

Hayashi, E. C. S., Posada, J. E. G., Maike, V. R. M. L., and Baranauskas, M. C. C. (2016). Exploring new formats of the self-assessment manikin in the design with children. In Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems, IHC ’16, New York, NY, USA. Association for Computing Machinery.

Hoffman, J. A. and Miller, E. A. (2020). Addressing the consequences of school closure due to covid-19 on children’s physical and mental well-being. World medical & health policy.

Jiao, W. Y., Wang, L. N., Liu, J., Fang, S. F., Jiao, F. Y., Pettoello-Mantovani, M., and Somekh, E. (2020). Behavioral and emotional disorders in children during the covid-19 epidemic. The Journal of Pediatrics, 221:264–266.e1.

Mendoza, Y. L. M. and Baranauskas, M. C. C. (2020). Evaluating the socioenactive experience with a tangible tabletop installation: A case study. In Agredo-Delgado, V., Ruiz, P. H., and Villalba-Condori, K. O., editors, Human-Computer Interaction, pages 126–135, Cham. Springer International Publishing.

Moraes, V. d., Toquinho, Morra, G., and Fabrizio, M. (1983). Aquarela.

Varela, F., Thompson, E., and Rosch, E. (1993). The Embodied Mind: Cognitive Science and Human Experience. Cognitive science: Philosophy, psychology. MIT Press.

Varela, F. J., Thompson, E., and Rosch, E. (2016). The Embodied Mind: Cognitive Science and Human Experience (Revised Edition). MIT Press.

Watson, D., Clark, L. A., and Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The panas scales. Journal of Personality and Social Psychology, 54(6):1063–1070.
MENDOZA, Yusseli Lizeth Méndez; DUARTE, Emanuel Felipe; BARANAUSKAS, M. Cecília C.. Evaluating the Perception of Others in a Remote Experience of Interaction: a Pilot Study. In: SIMPÓSIO BRASILEIRO DE INFORMÁTICA NA EDUCAÇÃO (SBIE), 33. , 2022, Manaus. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2022 . p. 752-763. DOI: https://doi.org/10.5753/sbie.2022.225675.