Embodiment in interactive installations: results from a systematic literature review
Resumo
Ubiquitous and pervasive technologies, alongside the expanding role of the computer in our lives, present new dimensions to the concept of embodiment within the Human-Computer Interaction (HCI) field. Interactive installations, in particular, afford the technological and conceptual exploration of embodiment due to a high degree of creative freedom and more open objectives, making it a promising context to be investigated. In this paper, we present a systematic literature review on approaches to embodiment in the context of interactive installations. We searched four major digital libraries and screened a total of 3245 studies following a protocol described in the paper. The final selection consists of 67 entries. Our analysis shows a multitude of theoretical and practical approaches to embodiment in interactive installations, but also significant compatibility and combined use. We present detailed summaries of and discussion on how embodiment is conceptualized, put into practice, and what technologies are involved, revealing new perspectives and possibilities for investigating embodiment in HCI.
Palavras-chave:
Embodiment, Embodied Cognition, Embodied Interaction, Interactive Installations, Systematic Literature Review
Referências
Ruth A. Baer. 2003. Mindfulness Training as a Clinical Intervention: A Conceptual and Empirical Review. Clinical Psychology: Science and Practice 10, 2 (2003), 125--143.
Susanne Bødker and Clemens Nylandsted Klokmose. 2011. The Human-Artifact Model: An Activity Theoretical Approach to Artifact Ecologies. Human-Computer Interaction 26, 4 (2011), 315--371.
Kirk Warren Brown and Richard M. Ryan. 2003. The Benefits of Being Present: Mindfulness and Its Role in Psychological Well-Being. Journal of Personality and Social Psychology 84, 4 (2003), 822--848.
Jerome S. Bruner. 1966. Toward a Theory of Instruction. Harvard University Press, Cambridge, MA, USA.
Eric Deng, Bilge Mutlu, and Maja J Mataric. 2019. Embodiment in Socially Interactive Robots. Foundations and Trends® in Robotics 7, 4 (2019), 251--356.
Paul Dourish. 2001. Where the Action is: The Foundations of Embodied Interaction. MIT Press, Cambridge, MA, USA.
Greg Downey. 2010. 'Practice without theory': a neuroanthropological perspective on embodied learning. Journal of the Royal Anthropological Institute 16, s1 (2010), S22--S40.
Shaun Gallagher. 2005. How the Body Shapes the Mind. Oxford University Press, Oxford. 294 pages.
James J. Gibson. 1979. The Ecological Approach to Visual Perception. Houghton Mifflin, Boston, MA, USA.
David Gough, Sandy Oliver, and James Thomas. 2012. An Introduction to Systematic Reviews. SAGE Publications, Thousand Oaks, CA, USA.
Yolande Harris and Bert Bongers. 2002. Approaches to creating interactivated spaces, from intimate to inhabited interfaces. Organised Sound 7, 3 (2002), 239--246.
N. Katherine Hayles. 1996. Embodied Virtuality: Or How to Put Bodies Back into the Picture. In Immersed in Technology: Art and Virtual Environments. MIT Press, Cambridge, MA, USA, 1--28.
Kristina Höök, Martin P. Jonsson, Anna Ståhl, and Johanna Mercurio. 2016. Somaesthetic Appreciation Design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 3131--3142.
David Howes. 2013. The Expanding Field of Sensory Studies. [link]. Accessed May 28, 2022.
Katherine Isbister, Elena Márquez Segura, and Edward F. Melcer. 2018. Social Affordances at Play: Game Design Toward Socio-Technical Innovation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--10.
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '97). ACM, New York, NY, USA, 234--241.
Mark Johnson. 1987. The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason. University of Chicago Press, Chicago, IL, USA.
Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive Systems and Enactive Media: Embodied Human-Machine Coupling beyond Interfaces. Leonardo 44, 5 (13 Sep 2011), 433--438.
Jonghwa Kim and Elisabeth André. 2008. Emotion recognition based on physiological changes in music listening. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 12 (2008), 2067--2083.
Scott R. Klemmer, Björn Hartmann, and Leila Takayama. 2006. How Bodies Matter: Five Themes for Interaction Design. In Proceedings of the 6th Conference on Designing Interactive Systems (University Park, PA, USA) (DIS '06). Association for Computing Machinery, New York, NY, USA, 140--149.
Ksenia Kolykhalova, Paolo Alborno, Antonio Camurri, and Gualtiero Volpe. 2016. A Serious Games Platform for Validating Sonification of Human Full-Body Movement Qualities. In Proceedings of the 3rd International Symposium on Movement and Computing (Thessaloniki, GA, Greece) (MOCO '16). Association for Computing Machinery, New York, NY, USA, Article 39, 5 pages.
Carly Kontra, Susan Goldin-Meadow, and Sian L. Beilock. 2012. Embodied Learning Across the Life Span. Topics in Cognitive Science 4, 4 (2012), 731--739.
George Lakoff. 2008. Women, Fire, and Dangerous Things: What Categories Reveal about the Mind. University of Chicago Press, Chicago, IL, USA.
Michael R. Levenson, Patricia A. Jennings, Carolyn M. Aldwin, and Ray W. Shiraishi. 2005. Self-Transcendence: Conceptualization and Measurement. The International Journal of Aging and Human Development 60, 2 (2005), 127--143.
Robb Lindgren and David DeLiema. 2022. Viewpoint, embodiment, and roles in STEM learning technologies. Educational technology research and development 70, 3 (01 Jun 2022), 1009--1034.
Robb Lindgren and Mina Johnson-Glenberg. 2013. Emboldened by Embodiment: Six Precepts for Research on Embodied Learning and Mixed Reality. Educational Researcher 42, 8 (2013), 445--452.
V. Magagnin, M. Mauri, P. Cipresso, L. Mainardi, En Brown, S. Cerutti, M. Villamira, and R. Barbieri. 2010. Heart Rate Variability and Respiratory Sinus Arrhythmia Assessment of Affective States by Bivariate Autoregressive Spectral Analysis. Computing in cardiology 37, 5737930 (2010), 145--148. https://pubmed.ncbi.nlm.nih.gov/22158520
Maurice Merleau-Ponty. 1962. Phenomenology of Perception. Routledge, Abingdon, UK.
David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G. Altman, and The PRISMA Group. 2009. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLOS Medicine 6, 7 (07 2009), 1--6.
Lizzie Muller, Greg Turner, George Khut, and Ernest Edmonds. 2006. Creating Affective Visualisations for a Physiologically Interactive Artwork. In Tenth International Conference on Information Visualisation (IV'06). IEEE, New York, NY, USA, 651--657.
Karen Nakamura. 2013. Making Sense of Sensory Ethnography: The Sensual and the Multisensory. American Anthropologist 115, 1 (2013), 132--135.
Alva Noë. 2004. Action in Perception. MIT Press, Cambridge, MA, USA.
Alva Noë. 2009. Out of Our Heads: Why You Are Not Your Brain, and Other Lessons from the Biology of Consciousness. Farrar, Straus and Giroux, New York, NY, USA.
Donald A. Norman. 1988. The Design of Everyday Things. Doubleday, New York, NY, USA.
Rosalind W. Picard. 2000. Affective Computing. MIT Press, Cambridge, MA, USA.
Matthew Reason and Dee Reynolds. 2010. Kinesthesia, Empathy, and Related Pleasures: An Inquiry into Audience Experiences of Watching Dance. Dance Research Journal 42, 2 (2010), 49--75.
Pedro Sanches, Kristina Höök, Elsa Vaara, Claus Weymann, Markus Bylund, Pedro Ferreira, Nathalie Peira, and Marie Sjölinder. 2010. Mind the Body! Designing a Mobile Stress Management Application Encouraging Personal Reflection. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (Aarhus, Denmark) (DIS '10). Association for Computing Machinery, New York, NY, USA, 47--56.
Maria V. Sanchez-Vives and Mel Slater. 2005. From presence to consciousness through virtual reality. Nature Reviews Neuroscience 6, 4 (01 Apr 2005), 332--339.
Thecla Schiphorst. 2009. Soft(n): Toward a Somaesthetics of Touch. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA) (CHI EA '09). Association for Computing Machinery, New York, NY, USA, 2427--2438.
Mark S. Schwartz and Frank Andrasik. 2017. Biofeedback, Fourth Edition: A Practitioner's Guide. Guilford Publications, New York, NY, USA.
Richard Shusterman. 2012. Thinking Through the Body: Essays in Somaesthetics. Cambridge University Press, Cambridge, UK.
Jonathan Steuer. 2006. Defining Virtual Reality: Dimensions Determining Telepresence. Journal of Communication 42, 4 (02 2006), 73--93.
Dag Svanæs. 2013. Interaction Design for and with the Lived Body: Some Implications of Merleau-Ponty's Phenomenology. ACM Trans. Comput.-Hum. Interact. 20, 1, Article 8 (apr 2013), 30 pages.
Jelle Van Dijk. 2018. Designing for Embodied Being-in-the-World: A Critical Analysis of the Concept of Embodiment in the Design of Hybrids. Multimodal Technologies and Interaction 2, 1 (2018), 1--21.
Francisco J. Varela, Evan Thompson, and Eleanor Rosch. 1993. The Embodied Mind: Cognitive Science and Human Experience. MIT Press, Cambridge, MA, USA.
Mark Weiser. 1991. The Computer for the 21st Century. Scientific American 265, 3 (1991), 94--104.
Margaret Wilson. 2002. Six views of embodied cognition. Psychonomic Bulletin & Review 9, 4 (01 Dec 2002), 625--636.
Susanne Bødker and Clemens Nylandsted Klokmose. 2011. The Human-Artifact Model: An Activity Theoretical Approach to Artifact Ecologies. Human-Computer Interaction 26, 4 (2011), 315--371.
Kirk Warren Brown and Richard M. Ryan. 2003. The Benefits of Being Present: Mindfulness and Its Role in Psychological Well-Being. Journal of Personality and Social Psychology 84, 4 (2003), 822--848.
Jerome S. Bruner. 1966. Toward a Theory of Instruction. Harvard University Press, Cambridge, MA, USA.
Eric Deng, Bilge Mutlu, and Maja J Mataric. 2019. Embodiment in Socially Interactive Robots. Foundations and Trends® in Robotics 7, 4 (2019), 251--356.
Paul Dourish. 2001. Where the Action is: The Foundations of Embodied Interaction. MIT Press, Cambridge, MA, USA.
Greg Downey. 2010. 'Practice without theory': a neuroanthropological perspective on embodied learning. Journal of the Royal Anthropological Institute 16, s1 (2010), S22--S40.
Shaun Gallagher. 2005. How the Body Shapes the Mind. Oxford University Press, Oxford. 294 pages.
James J. Gibson. 1979. The Ecological Approach to Visual Perception. Houghton Mifflin, Boston, MA, USA.
David Gough, Sandy Oliver, and James Thomas. 2012. An Introduction to Systematic Reviews. SAGE Publications, Thousand Oaks, CA, USA.
Yolande Harris and Bert Bongers. 2002. Approaches to creating interactivated spaces, from intimate to inhabited interfaces. Organised Sound 7, 3 (2002), 239--246.
N. Katherine Hayles. 1996. Embodied Virtuality: Or How to Put Bodies Back into the Picture. In Immersed in Technology: Art and Virtual Environments. MIT Press, Cambridge, MA, USA, 1--28.
Kristina Höök, Martin P. Jonsson, Anna Ståhl, and Johanna Mercurio. 2016. Somaesthetic Appreciation Design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 3131--3142.
David Howes. 2013. The Expanding Field of Sensory Studies. [link]. Accessed May 28, 2022.
Katherine Isbister, Elena Márquez Segura, and Edward F. Melcer. 2018. Social Affordances at Play: Game Design Toward Socio-Technical Innovation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--10.
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '97). ACM, New York, NY, USA, 234--241.
Mark Johnson. 1987. The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason. University of Chicago Press, Chicago, IL, USA.
Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive Systems and Enactive Media: Embodied Human-Machine Coupling beyond Interfaces. Leonardo 44, 5 (13 Sep 2011), 433--438.
Jonghwa Kim and Elisabeth André. 2008. Emotion recognition based on physiological changes in music listening. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 12 (2008), 2067--2083.
Scott R. Klemmer, Björn Hartmann, and Leila Takayama. 2006. How Bodies Matter: Five Themes for Interaction Design. In Proceedings of the 6th Conference on Designing Interactive Systems (University Park, PA, USA) (DIS '06). Association for Computing Machinery, New York, NY, USA, 140--149.
Ksenia Kolykhalova, Paolo Alborno, Antonio Camurri, and Gualtiero Volpe. 2016. A Serious Games Platform for Validating Sonification of Human Full-Body Movement Qualities. In Proceedings of the 3rd International Symposium on Movement and Computing (Thessaloniki, GA, Greece) (MOCO '16). Association for Computing Machinery, New York, NY, USA, Article 39, 5 pages.
Carly Kontra, Susan Goldin-Meadow, and Sian L. Beilock. 2012. Embodied Learning Across the Life Span. Topics in Cognitive Science 4, 4 (2012), 731--739.
George Lakoff. 2008. Women, Fire, and Dangerous Things: What Categories Reveal about the Mind. University of Chicago Press, Chicago, IL, USA.
Michael R. Levenson, Patricia A. Jennings, Carolyn M. Aldwin, and Ray W. Shiraishi. 2005. Self-Transcendence: Conceptualization and Measurement. The International Journal of Aging and Human Development 60, 2 (2005), 127--143.
Robb Lindgren and David DeLiema. 2022. Viewpoint, embodiment, and roles in STEM learning technologies. Educational technology research and development 70, 3 (01 Jun 2022), 1009--1034.
Robb Lindgren and Mina Johnson-Glenberg. 2013. Emboldened by Embodiment: Six Precepts for Research on Embodied Learning and Mixed Reality. Educational Researcher 42, 8 (2013), 445--452.
V. Magagnin, M. Mauri, P. Cipresso, L. Mainardi, En Brown, S. Cerutti, M. Villamira, and R. Barbieri. 2010. Heart Rate Variability and Respiratory Sinus Arrhythmia Assessment of Affective States by Bivariate Autoregressive Spectral Analysis. Computing in cardiology 37, 5737930 (2010), 145--148. https://pubmed.ncbi.nlm.nih.gov/22158520
Maurice Merleau-Ponty. 1962. Phenomenology of Perception. Routledge, Abingdon, UK.
David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G. Altman, and The PRISMA Group. 2009. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLOS Medicine 6, 7 (07 2009), 1--6.
Lizzie Muller, Greg Turner, George Khut, and Ernest Edmonds. 2006. Creating Affective Visualisations for a Physiologically Interactive Artwork. In Tenth International Conference on Information Visualisation (IV'06). IEEE, New York, NY, USA, 651--657.
Karen Nakamura. 2013. Making Sense of Sensory Ethnography: The Sensual and the Multisensory. American Anthropologist 115, 1 (2013), 132--135.
Alva Noë. 2004. Action in Perception. MIT Press, Cambridge, MA, USA.
Alva Noë. 2009. Out of Our Heads: Why You Are Not Your Brain, and Other Lessons from the Biology of Consciousness. Farrar, Straus and Giroux, New York, NY, USA.
Donald A. Norman. 1988. The Design of Everyday Things. Doubleday, New York, NY, USA.
Rosalind W. Picard. 2000. Affective Computing. MIT Press, Cambridge, MA, USA.
Matthew Reason and Dee Reynolds. 2010. Kinesthesia, Empathy, and Related Pleasures: An Inquiry into Audience Experiences of Watching Dance. Dance Research Journal 42, 2 (2010), 49--75.
Pedro Sanches, Kristina Höök, Elsa Vaara, Claus Weymann, Markus Bylund, Pedro Ferreira, Nathalie Peira, and Marie Sjölinder. 2010. Mind the Body! Designing a Mobile Stress Management Application Encouraging Personal Reflection. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (Aarhus, Denmark) (DIS '10). Association for Computing Machinery, New York, NY, USA, 47--56.
Maria V. Sanchez-Vives and Mel Slater. 2005. From presence to consciousness through virtual reality. Nature Reviews Neuroscience 6, 4 (01 Apr 2005), 332--339.
Thecla Schiphorst. 2009. Soft(n): Toward a Somaesthetics of Touch. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA) (CHI EA '09). Association for Computing Machinery, New York, NY, USA, 2427--2438.
Mark S. Schwartz and Frank Andrasik. 2017. Biofeedback, Fourth Edition: A Practitioner's Guide. Guilford Publications, New York, NY, USA.
Richard Shusterman. 2012. Thinking Through the Body: Essays in Somaesthetics. Cambridge University Press, Cambridge, UK.
Jonathan Steuer. 2006. Defining Virtual Reality: Dimensions Determining Telepresence. Journal of Communication 42, 4 (02 2006), 73--93.
Dag Svanæs. 2013. Interaction Design for and with the Lived Body: Some Implications of Merleau-Ponty's Phenomenology. ACM Trans. Comput.-Hum. Interact. 20, 1, Article 8 (apr 2013), 30 pages.
Jelle Van Dijk. 2018. Designing for Embodied Being-in-the-World: A Critical Analysis of the Concept of Embodiment in the Design of Hybrids. Multimodal Technologies and Interaction 2, 1 (2018), 1--21.
Francisco J. Varela, Evan Thompson, and Eleanor Rosch. 1993. The Embodied Mind: Cognitive Science and Human Experience. MIT Press, Cambridge, MA, USA.
Mark Weiser. 1991. The Computer for the 21st Century. Scientific American 265, 3 (1991), 94--104.
Margaret Wilson. 2002. Six views of embodied cognition. Psychonomic Bulletin & Review 9, 4 (01 Dec 2002), 625--636.
Publicado
17/10/2022
Como Citar
DUARTE, Emanuel Felipe; MÉNDEZ MENDOZA, Yusseli Lizeth; NOBRE DE QUEIROZ, Maria Jêsca; BARANAUSKAS, M. Cecília C..
Embodiment in interactive installations: results from a systematic literature review. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 21. , 2022, Diamantina.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
