Reflections on the Applicability of the Semiotic Engineering Ontology Extended to the HInt Paradigm

Resumo


Human-Computer Integration (HInt) is a new paradigm that expands the focus of the HCI field to encompass the new relationship of partnership between humans and autonomous technologies. As HInt is an emerging paradigm, the concepts and ontology of Semiotic Engineering Theory have been extended to cover HInt as a special case of HCI. This paper aims to present the results of an evaluation of the applicability and utility of the Semiotic Engineering extension to HInt. In order to conduct the evaluation, an elective undergraduate course on HInt was offered at Federal University of Minas Gerais. The researchers analyzed the material generated by the students' as part of their activities understanding and applying the concepts of the extended Semiotic Engineering theory. The analysis focused on understanding students use and perception of the theory in defining, exploring, and explaining HInt. As contributions, we present insights and reflections on the benefits and limits of the extension of the Semiotic Engineering theoretical framework to support the study, design and evaluation of HInt.

Palavras-chave: Human-Computer Integration, HInt, Semiotic Engineering, Ontolog

Referências

Josh Andres, Julian de Hoog, e Florian ’Floyd’ Mueller. 2018. "I Had Super-Powers When EBike Riding"Towards Understanding the Design of Integrated Exertion. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA, 19–31. DOI: 10.1145/3242671.3242688

Josh Andres, Tuomas Kari, Juerg von Kaenel, e Florian ’Floyd’ Mueller. 2019. "Co-Riding With My EBike to Get Green Lights". In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 1251–1263. DOI: 10.1145/3322276.3322307

Josh Andres, m.c. schraefel, Nathan Semertzidis, Brahmi Dwivedi, Yutika C. Kulwe, Juerg von Kaenel, e Florian Floyd Mueller. 2020. Introducing Peripheral Awareness as a Neurological State for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13. DOI: //doi.org/10.1145/3313831.3376128

Josh Andres, Nathan Semertzidis, Zhuying Li, YanWang, e Florian Floyd Mueller. 2023. Integrated Exertion—Understanding the Design of Human–Computer Integration in an Exertion Context. ACM Trans. Comput.-Hum. Interact. 29, 6, Article 55 (jan 2023), 28 pages. DOI: 10.1145/3528352

Glívia A. R. Barbosa, Ulisses da S. Fernandes, Natália S. Santos, e Raquel O. Prates. 2023. Human-Computer Integration as an Extension of Interaction: Understanding Its State-of-the-Art and the Next Challenges. International Journal of Human–Computer Interaction 40, 11 (2023), 2761–2780. DOI: 10.1080/10447318.2023.2177797 arXiv: [link]

Glívia A. R. Barbosa e Raquel O. Prates. 2022. Estendendo a IHC para HInt à Luz da Engenharia Semiótica. In Anais Estendidos do XXI Simpósio Brasileiro de Fatores Humanos em Sistemas Computacionais Workshop de Teses e Dissertações em IHC (WTD-IHC) (Diamantina). SBC, Porto Alegre, RS, Brasil, 166–174. DOI: 10.5753/ihc_estendido.2022.226191

Glívia A. R. Barbosa e Raquel O. Prates. 2022. Extending the Ontology, Metacommunication and Communicability of Semiotic Engineering to the Emerging Paradigm of Human-Computer Integration (HInt). In Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC’22). Association for Computing Machinery, New York, NY, USA, Article 17, 11 pages. DOI: 10.1145/3554364.3559109

Glívia A. R. Barbosa e Raquel O. Prates. 2023. Evoluir é preciso: Movendo da Interação para a Integração Humano-Computador. In Anais Estendidos do XXII Simpósio Brasileiro de Fatores Humanos em Sistemas Computacionais Minicurso (Maceió/AL). SBC, Porto Alegre, RS, Brasil, 1–8. DOI: 10.5753/ihc_estendido.2023.232984

Glívia A. R. Barbosa, Raquel O. Prates, Ulisses da S. Fernandes, e Natália S. Santos. 2021. Extending Interaction to Human-Computer Integration: What Do We Already Know and What Do We Need to Explore?. In Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems (Virtual Event, Brazil) (IHC’21). Association for Computing Machinery, New York, NY, USA, Article 23, 7 pages. DOI: 10.1145/3472301.3484351

Gabriel Diniz Junqueira Barbosa, José Luiz Nunes, Clarisse Sieckenius De Souza, e Simone Diniz Junqueira Barbosa. 2024. Investigating the Extended Metacommunication Template: How a semiotic tool may encourage reflective ethical practice in the development of machine learning systems. In Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems (Maceió, Brazil) (IHC ’23). Association for Computing Machinery, New York, NY, USA, Article 58, 12 pages. DOI: 10.1145/3638067.3638070

Simone Diniz Junqueira Barbosa, Gabriel Diniz Junqueira Barbosa, Clarisse Sieckenius de Souza, e Carla Faria Leitão. 2021. A Semiotics-based epistemic tool to reason about ethical issues in digital technology design and development. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT ’21). Association for Computing Machinery, New York, NY, USA, 363–374. DOI: 10.1145/3442188.3445900

Simone Diniz Junqueira Barbosa, Bruno Santana da Silva, Milene Selbach Silveira, Isabela Gasparini, Ticianne Darin, e Gabriel Diniz Junqueira Barbosa. 2021. Interação humano-computador e experiência do usuario. Auto publicação.

Virginia Braun e Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.

John M Carroll. 2003. HCI models, theories, and frameworks: Toward a multidisciplinary science. Elsevier.

Bruno Azevedo Chagas. 2020. Metacommunication and Appropriation in the Design of the Interactive Internet of Things. Ph.D. Dissertation. PUC-Rio.

Bruno A. Chagas, David F. Redmiles, e Clarisse S. de Souza. 2018. Observed Appropriation of IoT Technology: A Semiotic Account. In Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems (Belém, Brazil) (IHC 2018). Association for Computing Machinery, New York, NY, USA, Article 33, 10 pages. DOI: 10.1145/3274192.3274225

Bruno A Chagas, David F Redmiles, e Clarisse S de Souza. 2019. Signs of Appropriation: A Semiotic Account of Breakdowns with IoT Technology. Journal on Interactive Systems 10, 2 (2019), 3–19.

Bruno Santana da Silva e Simone Diniz Junqueira Barbosa. 2007. Designing human-computer interaction with MoLIC diagrams–a practical guide. Technical Report 12/07. PUC-Rio, Rio de Janeiro. 12 pages. ISSN: 0103-9741.

Valdemar Danry, Pat Pataranutaporn, Florian Mueller, Pattie Maes, e Sang-won Leigh. 2022. On Eliciting a Sense of Self When Integrating with Computers. In Augmented Humans 2022 (Kashiwa, Chiba, Japan) (AHs 2022). Association for Computing Machinery, New York, NY, USA, 68–81. DOI: 10.1145/3519391.3519414

Clarisse Sieckenius de Souza. 2005. The semiotic engineering of human-computer interaction. MIT press.

Clarisse Sieckenius de Souza e Carla Faria Leitão. 2009. Semiotic Engineering Methods for Scientific Research in HCI. Synthesis Lectures on Human-Centered Informatics 2, 1 (2009), 1–122. DOI: 10.1007/978-3-031-02185-5

Clarisse Sieckenius de Souza, Carla Faria Leitão, Raquel Oliveira Prates, Sílvia Amélia Bim, e Elton José da Silva. 2010. Can inspection methods generate valid new knowledge in HCI? The case of semiotic inspection. International Journal of Human-Computer Studies 68, 1-2 (2010), 22–40.

Umer Farooq e Jonathan Grudin. 2016. Human-Computer Integration. Interactions 23, 6 (Oct. 2016), 26–32. DOI: 10.1145/3001896

Miriam Gil, Manoli Albert, Joan Fons, e Vicente Pelechano. 2019. Designing human-in-the-loop autonomous Cyber-Physical Systems. International Journal of Human-Computer Studies 130 (2019), 21–39. DOI: 10.1016/j.ijhcs.2019.04.006

Miriam Gil, Manoli Albert, Joan Fons, e Vicente Pelechano. 2020. Engineering human-in-the-loop interactions in cyber-physical systems. Information and Software Technology 126 (2020), 106349. DOI: 10.1016/j.infsof.2020.106349.

Carla Faria Leitão e Raquel O Prates. 2017. A Aplicação de Métodos Qualitativos em Computação. In Jornadas de Atualização em Informática 2017. 43–90.

Rodrigo de A. Maués e Simone Diniz Junqueira Barbosa. 2013. CrossCommunicability: Evaluating the Meta-communication of Cross-Platform Applications. In Human-Computer Interaction – INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, JanetWesson, e Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 241–258.

Rodrigo de A. Maués e Simone Diniz Junqueira Barbosa. 2014. Reflections on the Cross-Platform Semiotic Inspection Method. In Human-Computer Interaction. Theories, Methods, and Tools, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 533–544.

Florian Floyd Mueller, Pedro Lopes, Josh Andres, Richard Byrne, Nathan Semertzidis, Zhuying Li, Jarrod Knibbe, e Stefan Greuter. 2021. Towards understanding the design of bodily integration. International Journal of Human-Computer Studies 152 (2021), 102643. DOI: 10.1016/j.ijhcs.2021.102643

Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, MartinWeigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, e Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15. DOI: 10.1145/3313831.3376242

Florian Floyd Mueller, Nathan Semertzidis, Josh Andres, Martin Weigel, Suranga Nanayakkara, Rakesh Patibanda, Zhuying Li, Paul Strohmeier, Jarrod Knibbe, Stefan Greuter, Marianna Obrist, Pattie Maes, Dakuo Wang, Katrin Wolf, Liz Gerber, Joe Marshall, Kai Kunze, Jonathan Grudin, Harald Reiterer, e Richard Byrne. 2022. Human–Computer Integration: Towards Integrating the Human Body with the Computational Machine. Foundations and Trends® in HumanComputer Interaction 16, 1 (2022), 1–64. DOI: 10.1561/1100000086

Ana Maria Nicolaci-da Costa, Carla Faria Leitão, e Daniela Romão-Dias. 2004. Como conhecer usuários através do Método de Explicitação do Discurso Subjacente (MEDS). VI Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais, IHC (2004), 47–56.

Estruturada Do MéTodo de Inspeção SemióTica: Estudo de Caso Para o DomíNio Educacional. In Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems (Porto Alegre, RS, Brazil) (IHC ’08). Sociedade Brasileira de Computação, BRA, 50–59.

Charles Sanders Peirce Peirce e Charles Sanders Peirce. 1992. The essential Peirce, volume 1: Selected philosophical writings?(1867–1893). Vol. 1. Indiana University Press.

Raquel Oliveira Prates. 2017. An Overview of Semiotic Engineering Epistemic Tools for the Design of Collaborative Systems. Conversations Around Semiotic Engineering (2017), 81–99.

Raquel Oliveira Prates e Simone Diniz Junqueira Barbosa. 2007. Introdução à teoria e prática da interação humano computador fundamentada na engenharia semiótica. Jornadas de Atualizações em informática (2007), 263–326.

Raquel Oliveira Prates e Clarisse Sieckenius de Souza. 1998. Towards a semiotic environment for supporting the development of multi-user interfaces.. In CRIWG, Vol. 98. 15pp.

Chairs Constantine Stephanidis, Gavriel Salvendy, Members of the Group Margherita Antona, Jessie Y. C. Chen, Jianming Dong, Vincent G. Duffy, Xiaowen Fang, Cali Fidopiastis, Gino Fragomeni, Limin Paul Fu, Yinni Guo, Don Harris, Andri Ioannou, Kyeong ah (Kate) Jeong, Shin’ichi Konomi, Heidi Krömker, Masaaki Kurosu, James R. Lewis, Aaron Marcus, Gabriele Meiselwitz, Abbas Moallem, Hirohiko Mori, Fiona Fui-Hoon Nah, Stavroula Ntoa, Pei-Luen Patrick Rau, Dylan Schmorrow, Keng Siau, Norbert Streitz,WentaoWang, Sakae Yamamoto, Panayiotis Zaphiris, e Jia Zhou. 2019. Seven HCI Grand Challenges. International Journal of Human–Computer Interaction 35, 14 (2019), 1229–1269. DOI: 10.1080/10447318.2019.1619259 arXiv: [link]
Publicado
07/11/2024
RODRIGUES BARBOSA, Glívia Angélica; PRATES, Raquel Oliveira. Reflections on the Applicability of the Semiotic Engineering Ontology Extended to the HInt Paradigm. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 23. , 2024, Brasília/DF. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2024 . p. 774-788.