Extending HCI to HInt in the Light of Semiotic Engineering

• Glívia Angélica Rodrigues Barbosa Federal Center for Technological Education of Minas Gerais (CEFET-MG) / Federal University of Minas Gerais (UFMG) http://orcid.org/0000-0002-1872-5291
• Raquel Oliveira Prates Federal University of Minas Gerais (UFMG) https://orcid.org/0000-0002-7128-4974

DOI: https://doi.org/10.5753/ihc_estendido.2022.226191

Abstract

Human-Computer Integration (HInt) is an emerging paradigm in the HCI area, which characterizes the relationship between humans and technologies as a partnership, in addition to interaction. This paradigm offers new challenges for the HCI field, including demands for reviewing and proposing theories and methods to consolidate and evolve HInt within HCI. Thus, this research aims to explore the HInt challenges in the light of Semiotic Engineering so that this theory can also cover HInt as an HCI paradigm. As contributions, we aim to provide a theoretical framework to explore and explain the phenomena involved in HCI with a lens on HInt.

Keywords: Human-Computer Integration, Semiotic Engineering, Partner Technologies

References

Barbosa, G. A. R., Prates, R. O., da S. Fernandes, U., and Santos, N. S. (2021). Extending interaction to human-computer integration: What do we already know and what do we need to explore? In Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems, IHC’21, New York, NY, USA. Association for Computing Machinery.

Barbosa, G. A. R., Prates, R. O., da S. Fernandes, U., and Santos, N. S. (2022). O presente e o futuro da integração humano-computador como extensão da interação: Uma revisao sistemática da literatura. Technical Report RT.DCC.002/2022, Departamento de Ciencia da Computação, Universidade Federal de Minas Gerais, Belo Horizonte, MG.

Carvalho, L. P., Prates, R. O., and Freire, A. P. (2019). A proposal to adapt the semiotic inspection method to analyze screen reader mediated interaction. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, IHC’19, New York, NY, USA. Association for Computing Machinery.

Chagas, B. A., Redmiles, D. F., and de Souza, C. S. (2019). Signs of appropriation: A semiotic account of breakdowns with iot technology. Journal on Interactive Systems, 10(2):3–19.

de Souza, C. S. (2005). The semiotic engineering of human-computer interaction. MIT press.

de Souza, C. S. and Leitão, C. F. (2009). Semiotic engineering methods for scientific research in hci. Synthesis Lectures on Human-Centered Informatics (1):1–122.

de Souza, C. S., Leitão, C. F., Prates, R. O., Bim, S. A., and da Silva, E. J. (2010). Can inspection methods generate valid new knowledge in hci? the case of semiotic inspection. International Journal of Human-Computer Studies, 68(1-2):22–40.

Farooq, U. and Grudin, J. (2016). Human-computer integration. Interactions, 23(6):26–32.

Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele, UK, Keele Univ., 33.

Leitão, C. F. and Prates, R. O. (2017). A aplicação de métodos qualitativos em computação. In Jornadas de Atualização em Informática 2017, pages 43–90.

Mattos, B. A. and Prates, R. O. (2011). An overview of the communicability evaluation method for collaborative systems. In IADIS International Conference WWW/Internet, volume 2011, pages 129–136.

Maués, R. d. A. and Barbosa, S. D. J. (2013). Cross-communicability: Evaluating the meta-communication of cross-platform applications. In Kotze, P., Marsden, G., Lind-gaard, G., Wesson, J., and Winckler, M., editors, Human-Computer Interaction – INTERACT 2013, pages 241–258, Berlin, Heidelberg. Springer Berlin Heidelberg.

Maués, R. d. A. and Barbosa, S. D. J. (2014). Reflections on the cross-platform semiotic inspection method. In Kurosu, M., editor, Human-Computer Interaction. Theories, Methods, and Tools, pages 533–544, Cham. Springer International Publishing.

Mueller, F., Maes, P., and Grudin, J. (2019). Human-Computer Integration (Dagstuhl Seminar 18322). Dagstuhl Reports, 8(8):18–47.

Mueller, F. F., Lopes, P., Strohmeier, P., Ju, W., Seim, C., Weigel, M., Nanayakkara, S., Obrist, M., Li, Z., Delfa, J., Nishida, J., Gerber, E. M., Svanaes, D., Grudin, J., Greuter, S., Kunze, K., Erickson, T., Greenspan, S., Inami, M., Marshall, J., Reiterer, H., Wolf, K., Meyer, J., Schiphorst, T., Wang, D., and Maes, P. (2020). Next steps for humancomputer integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, page 1–15, New York, NY, USA. Association for Computing Machinery.

Oliveira, E. R., Luz, L. C. S., and Prates, R. O. (2008). Aplicação semi-estruturada do método de inspeção semiótica: Estudo de caso para o domínio educacional. In Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems, IHC’08, page 50–59, BRA. Sociedade Brasileira de Computação.

Reis, S. and Prates, R. O. (2011). Applicability of the semiotic inspection method: A systematic literature review. In Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on HumanComputer Interaction, IHC+CLIHC ’11, page 177–186, Porto Alegre, BRA. Brazilian Computer Society.