Signs of Appropriation: A Semiotic Account of Breakdowns with IoT Technology


  • Bruno  A. Chagas PUC-Rio
  • David F. Redmiles University of California, Irvine
  • Clarisse  S. de Souza PUC-Rio



Internet of things, IoT, appropriation, semiotic engineering, end-user development, in situ study


The Internet of Things (IoT) is an emerging technology powered by smart devices that increasingly populate our environment and transform our practices. Understanding how technologies are appropriated is a key asset for designing them successfully. In this paper, we present findings from an in situ study where we observed how people use and adapt commercially available smart home technology, in real practice, and over time. By using semiotic theory and thematic analysis to investigate data from diaries, questionnaires and interviews collected from a group of eleven participants, we characterized IoT appropriation as interpretive states that can evolve overtime. We also identified eight classes of appropriation breakdowns and derived two semiotic qualities for IoT technologies. We propose that, together, they have the potential to support productive decision making by IoT designers, as well as to raise new research questions on the topic.


Download data is not yet available.


B. A. Chagas, D. F. Redmiles, and C. S. de Souza, "Observed Appropriation of IoT Technology: A Semiotic Account", in Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems, New York, NY, USA, 2018, pp. 33:1-33:10.
J. Gaskin and K. Lyytinen, "Psychological Ownership and the Individual Appropriation of Technology", in Information Systems Theory, Springer, New York, NY, 2012, pp. 25-39.
E. M. Rogers, Diffusion of Innovations, 5th Edition, 5th edition. New York: Free Press, 2003.
C. Humphreys-Jones, "An investigation of the types and structure of misunderstandings", Thesis, Newcastle University, 1986.
C. Bazzanella and R. Damiano, "The interactional handling of misunderstanding in everyday conversations", J. Pragmat., vol. 31, no. 6, pp. 817-836, Jun. 1999.
B. Hansen, D. Novick, and S. Sutton, "Prevention and repair of breakdowns in a simple task domain", in Proceedings of the AAAI-96 Workshop on Detecting, Repairing, and Preventing Human-Machine Miscommunication, 1996, pp. 5-12.
T. Winograd and F. Flores, Understanding Computers and Cognition: A New Foundation for Design. Intellect Books, 1986.
K. Ashton, "That ‘internet of things’ thing", RFiD J., vol. 22, no. 7, pp. 97-114, 2009.
S. K. Anithaa et al., "The Internet of Things-A survey", World Sci. News, vol. 41, p. 150, 2016.
L. Atzori, A. Iera, and G. Morabito, "The internet of things: A survey", Comput. Netw., vol. 54, no. 15, pp. 2787-2805, 2010.
J. Gubbi, R. Buyya, S. Marusic, and M. Palaniswami, "Internet of Things (IoT): A vision, architectural elements, and future directions", Future Gener. Comput. Syst., vol. 29, no. 7, pp. 1645-1660, Sep. 2013.
H. Kopetz, "Internet of Things", in Real-Time Systems, Springer, Boston, MA, 2011, pp. 307-323.
I. Lee and K. Lee, "The Internet of Things (IoT): Applications, investments, and challenges for enterprises", Bus. Horiz., vol. 58, no. 4, pp. 431-440, Jul. 2015.
S. Li, L. D. Xu, and S. Zhao, "The internet of things: a survey", Inf. Syst. Front., vol. 17, no. 2, pp. 243-259, Apr. 2015.
F. Xia, L. T. Yang, L. Wang, and A. Vinel, "Internet of Things", Int. J. Commun. Syst., vol. 25, no. 9, pp. 1101-1102, Sep. 2012.
B. L. Risteska Stojkoska and K. V. Trivodaliev, "A review of Internet of Things for smart home: Challenges and solutions", J. Clean. Prod., vol. 140, pp. 1454-1464, Jan. 2017.
A. Zanella, N. Bui, A. Castellani, L. Vangelista, and M. Zorzi, "Internet of Things for Smart Cities", IEEE Internet Things J., vol. 1, no. 1, pp. 22-32, Feb. 2014.
L. D. Xu, W. He, and S. Li, "Internet of Things in Industries: A Survey", IEEE Trans. Ind. Inform., vol. 10, no. 4, pp. 2233-2243, Nov. 2014.
M. Maksimović, V. Vujović, and B. Periśić, "A custom Internet of Things healthcare system", in 2015 10th Iberian Conference on Information Systems and Technologies (CISTI), 2015, pp. 1-6.
G. Kortuem, F. Kawsar, V. Sundramoorthy, and D. Fitton, "Smart objects as building blocks for the Internet of things", IEEE Internet Comput., vol. 14, no. 1, pp. 44-51, Jan. 2010.
P. Dourish, "The Appropriation of Interactive Technologies: Some Lessons from Placeless Documents", Comput. Support. Coop. Work CSCW, vol. 12, no. 4, pp. 465-490, Dec. 2003.
S. Bødker and E. Christiansen, "Poetry in Motion: Appropriation of the World of Apps", in Proceedings of the 30th European Conference on Cognitive Ergonomics, New York, NY, USA, 2012, pp. 78-84.
C. T. de Campos, "O processo de apropriação do desenho à escrita", Dissertação de Mestrado, Universidade Federal de São Carlos, São Carlos, SP, Brasil, 2011.
M. Magnusson and N. Pramling, "Signs of knowledge: the appropriation of a symbolic skill in a five-year-old", Eur. Early Child. Educ. Res. J., vol. 19, no. 3, pp. 357-372, Sep. 2011.
B. Rogoff, "Observing sociocultural activity on three planes: Participatory appropriation, guided participation, and apprenticeship", Pedagogy Pract. Cult. Identities, pp. 58-74, 2008.
J. F. de F. Fernandes, M. G. Carvalho, and E. N. Campos, "Vygotsky and Bakhtin: the educational action as a dialogic project of meaning production", Bakhtiniana Rev. Estud. Discurso, vol. 7, no. 2, pp. 95- 108, Dec. 2012.
A. Dix, "Designing for Appropriation", in Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...But Not As We Know It - Volume 2, Swindon, UK, 2007, pp. 27- 30.
J. P. Bansler and E. Havn, "Sensemaking in Technology-Use Mediation: Adapting Groupware Technology in Organizations", Comput. Support. Coop. Work CSCW, vol. 15, no. 1, pp. 55-91, Feb. 2006.
S. Draxler and G. Stevens, "Supporting the Collaborative Appropriation of an Open Software Ecosystem", Comput. Support. Coop. Work CSCW, vol. 20, no. 4-5, pp. 403-448, Oct. 2011.
J. Carroll, S. Howard, J. Peck, and J. Murphy, "From Adoption to Use: the process of appropriating a mobile phone", Australas. J. Inf. Syst., vol. 10, no. 2, 2003.
G. O. Wiredu, "User appropriation of mobile technologies: Motives, conditions and design properties", Inf. Organ., vol. 17, no. 2, pp. 110- 129, Jan. 2007.
W. Wirth, T. V. Pape, and V. Karnowski, "An Integrative Model of Mobile Phone Appropriation", J. Comput.-Mediat. Commun., vol. 13, no. 3, pp. 593-617, Apr. 2008.
T. Jakobi, C. Ogonowski, N. Castelli, G. Stevens, and V. Wulf, "The Catch(Es) with Smart Home: Experiences of a Living Lab Field Study", in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, New York, NY, USA, 2017, pp. 1620-1633.
T. Ludwig, A. Boden, and V. Pipek, "3D Printers As Sociable Technologies: Taking Appropriation Infrastructures to the Internet of Things", ACM Trans Comput-Hum Interact, vol. 24, no. 2, pp. 17:1- 17:28, Apr. 2017.
J. Carroll, "Completing design in use: closing the appropriation cycle", ECIS 2004 Proc., p. 44, 2004.
G. Stevens, V. Pipek, and V. Wulf, "Appropriation Infrastructure: Supporting the Design of Usages", in End-User Development, 2009, pp. 50-69.
J. Carroll, S. Howard, F. Vetere, J. Peck, and J. Murphy, "Just what do the youth of today want? Technology appropriation by young people", in Proceedings of the 35th Annual Hawaii International Conference on System Sciences, 2002, pp. 1777-1785.
E. Karapanos, J. Zimmerman, J. Forlizzi, and J.-B. Martens, "User Experience over Time: An Initial Framework", in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, NY, USA, 2009, pp. 729-738.
C. S. De Souza, The semiotic engineering of human-computer interaction. Cambridge, Massachusetts: MIT press, 2005.
J. Hoopes, Ed., Peirce on Signs: Writings on Semiotic by Charles Sanders Peirce, New edition edition. Chapel Hill: The University of North Carolina Press, 1991.
H. Meadan, M. M. Ostrosky, and J. W. Halle, "‘What?’; ‘I Don’t Understand’; and ‘Pardon?’: Using Communication Breakdowns to Encourage Communication", Young Except. Child., vol. 9, no. 3, pp. 2-9, Apr. 2006.
S. P. Urquijo, S. A. R. Scrivener, and H. K. Palmén, "The Use of Breakdown Analysis in Synchronous CSCW System Design", in Proceedings of the Third European Conference on ComputerSupported Cooperative Work 13-17 September 1993, Milan, Italy ECSCW ’93, G. de Michelis, C. Simone, and K. Schmidt, Eds. Springer Netherlands, 1993, pp. 281-293.
M. Sharples, "A study of breakdowns and repairs in a computermediated communication system", Interact. Comput., vol. 5, no. 1, pp. 61-77, Mar. 1993.
V. Pipek and V. Wulf, "Infrastructuring: Toward an integrated perspective on the design and use of information technology", J. Assoc. Inf. Syst., vol. 10, no. 5, p. 447, 2009.
R. O. Prates, C. S. de Souza, and S. D. J. Barbosa, "Methods and Tools: A Method for Evaluating the Communicability of User Interfaces", interactions, vol. 7, no. 1, pp. 31-38, Jan. 2000.
C. S. De Souza and C. F. Leitão, Semiotic engineering methods for scientific research in HCI. Morgan & Claypool Publishers, 2009.
C. S. De Souza, R. O. Prates, and S. D. J. Barbosa, "A Method for Evaluating Software Communicability", in Proceedings of the Second Brazilian Workshop in Human-Computer Interaction, Campinas, SP, Brazil, 1999.
E. Goodman, M. Kuniavsky, and A. Moed, Observing the User Experience, Second Edition: A Practitioner’s Guide to User Research, 2nd edition. Morgan Kaufmann, 2012.
V. Braun and V. Clarke, "Using thematic analysis in psychology", Qual. Res. Psychol., vol. 3, no. 2, pp. 77-101, Jan. 2006.
L. Marques Afonso, "Communicative Dimensions of Application Programming Interfaces (APIs)", DOUTOR EM CIÊNCIAS INFORMÁTICA, PONTIFÍCIA UNIVERSIDADE CATÓLICA DO RIO DE JANEIRO, Rio de Janeiro, Brazil, 2015.
C. S. De Souza, R. O. Prates, and T. Carey, "Missing and declining affordances: are these appropriate concepts?", J. Braz. Comput. Soc., vol. 7, no. 1, pp. 26-34, 2000.
J. Carroll, S. Howard, F. Vetere, J. Peck, and J. Murphy, "Identity, power and fragmentation in cyberspace: technology appropriation by young people", in Proceedings of the Twelfth Australasian Conference on Information Systems, 2001, p. 6.
H. Lieberman, F. Paternò, M. Klann, and V. Wulf, "End-user development: An emerging paradigm", in End user development, Springer, 2006, pp. 1-8.
B. A. Chagas, D. F. Redmiles, and Clarisse. S. De Souza, "End-user development for the Internet of Things OR How can a (smart) light bulb be so complicated?", in 2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), 2017, pp. 273- 277.
B. A. Chagas, H. Fuks, and C. S. de Souza, "Lessons Learned in the Design of Configurable Assistive Technology with Smart Devices", in Fifth International Symposium on End User Development, 2015, vol. 9083, pp. 180-185.
D-Link, "DCH-S150 mydlink Wi-Fi Motion Sensor.” [Online]. Available: [Accessed: 12Jan-2019].
R. de A. Maués and S. D. J. Barbosa, "Cross-Communicability: Evaluating the Meta-communication of Cross-Platform Applications", in Human-Computer Interaction - INTERACT 2013, Springer, Berlin, Heidelberg, 2013, pp. 241-258.
R. de A. Maués and S. D. J. Barbosa, "Reflections on the CrossPlatform Semiotic Inspection Method", in Human-Computer Interaction. Theories, Methods, and Tools, Springer, Cham, 2014, pp. 533-544.
A. Kuper, L. Lingard, and W. Levinson, "Critically appraising qualitative research", BMJ, vol. 337, p. a1035, Aug. 2008.
C. W. Morris, "Foundations of the Theory of Signs", in International Encyclopedia of Unified Science, vol. I, No. 2., Chicago University Press, 1938, pp. 1-59.
L. Horn and G. Ward, The Handbook of Pragmatics. John Wiley & Sons, 2008.
K. Doherty and G. Doherty, "The construal of experience in HCI: Understanding self-reports", Int. J. Hum.-Comput. Stud., vol. 110, pp. 63-74, Feb. 2018.




How to Cite

A. CHAGAS, B.; F. REDMILES, D.; S. DE SOUZA, C. Signs of Appropriation: A Semiotic Account of Breakdowns with IoT Technology. Journal on Interactive Systems, Porto Alegre, RS, v. 10, n. 2, p. 3–19, 2019. DOI: 10.5753/jis.2019.550. Disponível em: Acesso em: 22 mar. 2023.



Regular Paper