Extending the ontology, metacommunication and communicability of semiotic engineering to the emerging paradigm of human-computer integration (HInt)
Resumo
Human-Computer Integration (HInt) is an emerging paradigm in the Human-Computer Interaction (HCI) area, which characterizes the relationship between humans and technologies as a partnership. This paradigm offers new challenges for the HCI area, including demands for reviewing and proposing theories and methods to consolidate and evolve HInt within HCI. Thus, this paper presents an analysis of the applicability and a proposal for extending the Semiotic Engineering ontology and concepts to characterize HInt. As contributions, our results are useful to: (1) advance in the consolidation and evolution of HInt as a new HCI paradigm; and (2) stimulate other initiatives and contributions grounded in Semiotic Engineering for HCI with a lens on HInt.
Palavras-chave:
Human-Computer Integration, Semiotic Engineering, Partner Technologies
Referências
Mohammed Alharbi and Shihong Huang. 2020. A Survey of Incorporating Affective Computing for Human-System Co-Adaptation. In Proceedings of the 2020 The 2nd World Symposium on Software Engineering (Chengdu, China) (WSSE 2020). Association for Computing Machinery, New York, NY, USA, 72--79.
Josh Andres, m.c. schraefel, Nathan Semertzidis, Brahmi Dwivedi, Yutika C. Kulwe, Juerg von Kaenel, and Florian Floyd Mueller. 2020. Introducing Peripheral Awareness as a Neurological State for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--13.
Glívia A. R. Barbosa, Raquel O. Prates, Ulisses da S. Fernandes, and Natália S. Santos. 2021. Extending Interaction to Human-Computer Integration: What Do We Already Know and What Do We Need to Explore?. In Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems (Virtual Event, Brazil) (IHC '21). Association for Computing Machinery, New York, NY, USA, Article 23, 7 pages.
Glívia A. R. Barbosa, Raquel O. Prates, Ulisses da S. Fernandes, and Natália S. Santos. 2022. O presente e o futuro da Integração Humano-Computador como extensão da Interação: Uma Revisão Sistemática da Literatura. Technical Report RT.DCC.002/2022. Departamento de Ciência da Computação, Universidade Federal de Minas Gerais, Belo Horizonte, MG. 42 pages.
Lauren M. Britton and Bryan Semaan. 2017. Manifesting the Cyborg through Techno-Body Modification: From Human-Computer Interaction to Integration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2499--2510.
Bruno Azevedo Chagas. 2020. Metacommunication and Appropriation in the Design of the Interactive Internet of Things. Ph.D. Dissertation. PUC-Rio.
Bruno A. Chagas, David F. Redmiles, and Clarisse S. de Souza. 2018. Observed Appropriation of IoT Technology: A Semiotic Account. In Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems (Belém, Brazil) (IHC 2018). Association for Computing Machinery, New York, NY, USA, Article 33, 10 pages.
Bruno A Chagas, David F Redmiles, and Clarisse S de Souza. 2019. Signs of Appropriation: A Semiotic Account of Breakdowns with IoT Technology. Journal on Interactive Systems 10, 2 (2019), 3--19.
Bruno Santana da Silva and Simone Diniz Junqueira Barbosa. 2007. Designing human-computer interaction with MoLIC diagrams-a practical guide. Technical Report 12/07. PUC-Rio, Rio de Janeiro. 12 pages. ISSN: 0103-9741.
Clarisse Sieckenius de Souza. 2005. The semiotic engineering of human-computer interaction. MIT press.
Clarisse Sieckenius de Souza and Carla Faria Leitão. 2009. Semiotic engineering methods for scientific research in HCI. Synthesis Lectures on Human-Centered Informatics 2, 1 (2009), 1--122.
Andreas Dengel, Laurence Devillers, and Laura Maria Schaal. 2021. Augmented Human and Human-Machine Co-evolution: Efficiency and Ethics. Reflections on Artificial Intelligence for Humanity (2021), 203--227.
Umer Farooq and Jonathan Grudin. 2016. Human-Computer Integration. Interactions 23, 6 (Oct. 2016), 26--32.
Verena Fuchsberger. 2019. The Future's Hybrid Nature. Interactions 26, 4 (June 2019), 26--31.
Miriam Gil, Manoli Albert, Joan Fons, and Vicente Pelechano. 2020. Engineering human-in-the-loop interactions in cyber-physical systems. Information and Software Technology 126 (2020), 106349.
Jeffrey C. F. Ho. 2018. Computer as Partner: A Critique Perspective of Interaction Design for Social Sustainability. In Proceedings of the Sixth International Symposium of Chinese CHI (Montreal, QC, Canada) (ChineseCHI '18). Association for Computing Machinery, New York, NY, USA, 95--99.
Sang-won Leigh, Harpreet Sareen, Hsin-Liu (Cindy) Kao, Xin Liu, and Pattie Maes. 2017. Body-Borne Computers as Extensions of Self. Computers 6, 1 (2017).
Zhuying Li, Rakesh Patibanda, Felix Brandmueller, Wei Wang, Kyle Berean, Stefan Greuter, and Florian 'Floyd' Mueller. 2018. The Guts Game: Towards Designing Ingestible Games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY '18). Association for Computing Machinery, New York, NY, USA, 271--283.
Rodrigo de A. Maués and Simone Diniz Junqueira Barbosa. 2013. Cross-Communicability: Evaluating the Meta-communication of Cross-Platform Applications. In Human-Computer Interaction - INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, Janet Wesson, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 241--258.
Rodrigo de A. Maués and Simone Diniz Junqueira Barbosa. 2014. Reflections on the Cross-Platform Semiotic Inspection Method. In Human-Computer Interaction. Theories, Methods, and Tools, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 533--544.
Florian Mueller, Pattie Maes, and Jonathan Grudin. 2019. Human-Computer Integration (Dagstuhl Seminar 18322). Dagstuhl Reports 8, 8 (2019), 18--47.
Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--15.
Jasmin Niess and Paweł W. Woźniak. 2020. Embracing Companion Technologies. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (Tallinn, Estonia) (NordiCHI '20). Association for Computing Machinery, New York, NY, USA, Article 31, 11 pages.
Erica R. Oliveira, Luiz C. S. Luz, and Raquel O. Prates. 2008. Aplicação Semi-Estruturada Do MéTodo de Inspeção SemióTica: Estudo de Caso Para o DomíNio Educacional. In Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems (Porto Alegre, RS, Brazil) (IHC '08). Sociedade Brasileira de Computação, BRA, 50--59.
Charles Sanders Peirce Peirce and Charles Sanders Peirce. 1992. The essential Peirce, volume 1: Selected philosophical writings?(1867--1893). Vol. 1. Indiana University Press.
Raquel Oliveira Prates and Clarisse Sieckenius de Souza. 1998. Towards a semiotic environment for supporting the development of multi-user interfaces.. In CRIWG, Vol. 98. 15pp.
Raquel O Prates, Clarisse S de Souza, and Simone DJ Barbosa. 2000. Methods and tools: a method for evaluating the communicability of user interfaces. interactions 7, 1 (2000), 31--38.
Soraia Reis and Raquel O. Prates. 2011. Applicability of the Semiotic Inspection Method: A Systematic Literature Review. In Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction (Porto de Galinhas, Pernambuco, Brazil) (IHC+CLIHC '11). Brazilian Computer Society, Porto Alegre, BRA, 177--186.
Samsung. 2022. Solução Samsung Galaxy Fit2. Retrieved May 27, 2022 from https://www.samsung.com/br/watches/galaxy-fit/galaxy-fit2-black-sm-r220nzkazto/
Chairs Constantine Stephanidis, Gavriel Salvendy, Members of the Group Margherita Antona, Jessie Y. C. Chen, Jianming Dong, Vincent G. Duffy, Xiaowen Fang, Cali Fidopiastis, Gino Fragomeni, Limin Paul Fu, Yinni Guo, Don Harris, Andri Ioannou, Kyeong ah (Kate) Jeong, Shin'ichi Konomi, Heidi Krömker, Masaaki Kurosu, James R. Lewis, Aaron Marcus, Gabriele Meiselwitz, Abbas Moallem, Hirohiko Mori, Fiona Fui-Hoon Nah, Stavroula Ntoa, Pei-Luen Patrick Rau, Dylan Schmorrow, Keng Siau, Norbert Streitz, Wentao Wang, Sakae Yamamoto, Panayiotis Zaphiris, and Jia Zhou. 2019. Seven HCI Grand Challenges. International Journal of Human-Computer Interaction 35, 14 (2019), 1229--1269. arXiv: https://doi.org/10.1080/10447318.2019.1619259
Josh Andres, m.c. schraefel, Nathan Semertzidis, Brahmi Dwivedi, Yutika C. Kulwe, Juerg von Kaenel, and Florian Floyd Mueller. 2020. Introducing Peripheral Awareness as a Neurological State for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--13.
Glívia A. R. Barbosa, Raquel O. Prates, Ulisses da S. Fernandes, and Natália S. Santos. 2021. Extending Interaction to Human-Computer Integration: What Do We Already Know and What Do We Need to Explore?. In Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems (Virtual Event, Brazil) (IHC '21). Association for Computing Machinery, New York, NY, USA, Article 23, 7 pages.
Glívia A. R. Barbosa, Raquel O. Prates, Ulisses da S. Fernandes, and Natália S. Santos. 2022. O presente e o futuro da Integração Humano-Computador como extensão da Interação: Uma Revisão Sistemática da Literatura. Technical Report RT.DCC.002/2022. Departamento de Ciência da Computação, Universidade Federal de Minas Gerais, Belo Horizonte, MG. 42 pages.
Lauren M. Britton and Bryan Semaan. 2017. Manifesting the Cyborg through Techno-Body Modification: From Human-Computer Interaction to Integration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2499--2510.
Bruno Azevedo Chagas. 2020. Metacommunication and Appropriation in the Design of the Interactive Internet of Things. Ph.D. Dissertation. PUC-Rio.
Bruno A. Chagas, David F. Redmiles, and Clarisse S. de Souza. 2018. Observed Appropriation of IoT Technology: A Semiotic Account. In Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems (Belém, Brazil) (IHC 2018). Association for Computing Machinery, New York, NY, USA, Article 33, 10 pages.
Bruno A Chagas, David F Redmiles, and Clarisse S de Souza. 2019. Signs of Appropriation: A Semiotic Account of Breakdowns with IoT Technology. Journal on Interactive Systems 10, 2 (2019), 3--19.
Bruno Santana da Silva and Simone Diniz Junqueira Barbosa. 2007. Designing human-computer interaction with MoLIC diagrams-a practical guide. Technical Report 12/07. PUC-Rio, Rio de Janeiro. 12 pages. ISSN: 0103-9741.
Clarisse Sieckenius de Souza. 2005. The semiotic engineering of human-computer interaction. MIT press.
Clarisse Sieckenius de Souza and Carla Faria Leitão. 2009. Semiotic engineering methods for scientific research in HCI. Synthesis Lectures on Human-Centered Informatics 2, 1 (2009), 1--122.
Andreas Dengel, Laurence Devillers, and Laura Maria Schaal. 2021. Augmented Human and Human-Machine Co-evolution: Efficiency and Ethics. Reflections on Artificial Intelligence for Humanity (2021), 203--227.
Umer Farooq and Jonathan Grudin. 2016. Human-Computer Integration. Interactions 23, 6 (Oct. 2016), 26--32.
Verena Fuchsberger. 2019. The Future's Hybrid Nature. Interactions 26, 4 (June 2019), 26--31.
Miriam Gil, Manoli Albert, Joan Fons, and Vicente Pelechano. 2020. Engineering human-in-the-loop interactions in cyber-physical systems. Information and Software Technology 126 (2020), 106349.
Jeffrey C. F. Ho. 2018. Computer as Partner: A Critique Perspective of Interaction Design for Social Sustainability. In Proceedings of the Sixth International Symposium of Chinese CHI (Montreal, QC, Canada) (ChineseCHI '18). Association for Computing Machinery, New York, NY, USA, 95--99.
Sang-won Leigh, Harpreet Sareen, Hsin-Liu (Cindy) Kao, Xin Liu, and Pattie Maes. 2017. Body-Borne Computers as Extensions of Self. Computers 6, 1 (2017).
Zhuying Li, Rakesh Patibanda, Felix Brandmueller, Wei Wang, Kyle Berean, Stefan Greuter, and Florian 'Floyd' Mueller. 2018. The Guts Game: Towards Designing Ingestible Games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY '18). Association for Computing Machinery, New York, NY, USA, 271--283.
Rodrigo de A. Maués and Simone Diniz Junqueira Barbosa. 2013. Cross-Communicability: Evaluating the Meta-communication of Cross-Platform Applications. In Human-Computer Interaction - INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, Janet Wesson, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 241--258.
Rodrigo de A. Maués and Simone Diniz Junqueira Barbosa. 2014. Reflections on the Cross-Platform Semiotic Inspection Method. In Human-Computer Interaction. Theories, Methods, and Tools, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 533--544.
Florian Mueller, Pattie Maes, and Jonathan Grudin. 2019. Human-Computer Integration (Dagstuhl Seminar 18322). Dagstuhl Reports 8, 8 (2019), 18--47.
Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--15.
Jasmin Niess and Paweł W. Woźniak. 2020. Embracing Companion Technologies. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (Tallinn, Estonia) (NordiCHI '20). Association for Computing Machinery, New York, NY, USA, Article 31, 11 pages.
Erica R. Oliveira, Luiz C. S. Luz, and Raquel O. Prates. 2008. Aplicação Semi-Estruturada Do MéTodo de Inspeção SemióTica: Estudo de Caso Para o DomíNio Educacional. In Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems (Porto Alegre, RS, Brazil) (IHC '08). Sociedade Brasileira de Computação, BRA, 50--59.
Charles Sanders Peirce Peirce and Charles Sanders Peirce. 1992. The essential Peirce, volume 1: Selected philosophical writings?(1867--1893). Vol. 1. Indiana University Press.
Raquel Oliveira Prates and Clarisse Sieckenius de Souza. 1998. Towards a semiotic environment for supporting the development of multi-user interfaces.. In CRIWG, Vol. 98. 15pp.
Raquel O Prates, Clarisse S de Souza, and Simone DJ Barbosa. 2000. Methods and tools: a method for evaluating the communicability of user interfaces. interactions 7, 1 (2000), 31--38.
Soraia Reis and Raquel O. Prates. 2011. Applicability of the Semiotic Inspection Method: A Systematic Literature Review. In Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction (Porto de Galinhas, Pernambuco, Brazil) (IHC+CLIHC '11). Brazilian Computer Society, Porto Alegre, BRA, 177--186.
Samsung. 2022. Solução Samsung Galaxy Fit2. Retrieved May 27, 2022 from https://www.samsung.com/br/watches/galaxy-fit/galaxy-fit2-black-sm-r220nzkazto/
Chairs Constantine Stephanidis, Gavriel Salvendy, Members of the Group Margherita Antona, Jessie Y. C. Chen, Jianming Dong, Vincent G. Duffy, Xiaowen Fang, Cali Fidopiastis, Gino Fragomeni, Limin Paul Fu, Yinni Guo, Don Harris, Andri Ioannou, Kyeong ah (Kate) Jeong, Shin'ichi Konomi, Heidi Krömker, Masaaki Kurosu, James R. Lewis, Aaron Marcus, Gabriele Meiselwitz, Abbas Moallem, Hirohiko Mori, Fiona Fui-Hoon Nah, Stavroula Ntoa, Pei-Luen Patrick Rau, Dylan Schmorrow, Keng Siau, Norbert Streitz, Wentao Wang, Sakae Yamamoto, Panayiotis Zaphiris, and Jia Zhou. 2019. Seven HCI Grand Challenges. International Journal of Human-Computer Interaction 35, 14 (2019), 1229--1269. arXiv: https://doi.org/10.1080/10447318.2019.1619259
Publicado
17/10/2022
Como Citar
RODRIGUES BARBOSA, Glívia Angélica; PRATES, Raquel O..
Extending the ontology, metacommunication and communicability of semiotic engineering to the emerging paradigm of human-computer integration (HInt). In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 21. , 2022, Diamantina.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
