skip to main content
10.1145/3554364.3559135acmotherconferencesArticle/Chapter ViewAbstractPublication PagesihcConference Proceedingsconference-collections
research-article

Longitudinal user experience studies in the IoT domain: a brief panorama and challenges to overcome

Authors Info & Claims
Published:19 October 2022Publication History

ABSTRACT

User Experience (UX) is affected by users' emotions and motivations, among other subjective factors. Hence, changes in UX occur over time, according to the different contexts, and behavioral and internal user aspects. With the rising development of Internet of Things (IoT) systems to support daily activities and, at the same time, the increasing abandonment of these systems, the importance of ensuring good UX levels over time has become an even greater need. In this context, we conducted a snowballing procedure and systematic literature mapping to understand whether and how long-term UX evaluations have been conducted in IoT and the challenges and opportunities in conducting longitudinal studies in this field. We analyzed 55 papers that reported longitudinal evaluations in different IoT systems and 14 papers that reported UX evaluations in the IoT context. We also interviewed five software engineering professionals to learn about their IoT user-testing and evaluation perspectives. Our results provide a panorama of the conduction of longitudinal IoT studies and a glance at the directions the research on UX evaluation for IoT systems is taking. Hence, we indicate future research opportunities for evaluating long-term UX in IoT systems through the longitudinal approach, considering the complexity of these systems and their impact on users' everyday lives.

References

  1. Muhammad Raisul Alam, Mamun Bin Ibne Reaz, and Mohd Alauddin Mohd Ali. 2012. A review of smart homes---Past, present, and future. IEEE transactions on systems, man, and cybernetics, part C (applications and reviews) 42, 6 (2012), 1190--1203.Google ScholarGoogle Scholar
  2. Ane Alberdi, Alyssa Weakley, Maureen Schmitter-Edgecombe, Diane J Cook, Asier Aztiria, Adrian Basarab, and Maitane Barrenechea. 2018. Smart home-based prediction of multidomain symptoms related to Alzheimer's disease. IEEE journal of biomedical and health informatics 22, 6 (2018), 1720--1731.Google ScholarGoogle Scholar
  3. Rodrigo LA Almeida, Ticianne GR Darin, Rossana MC Andrade, and Italo L de Araújo. 2018. Towards developing a practical tool to assist UX evaluation in the IoT scenario. In Anais Estendidos do XXIV Simpósio Brasileiro de Sistemas Multimídia e Web. SBC, 91--95.Google ScholarGoogle Scholar
  4. Rodrigo Lucas Amora Almeida. 2018. CHASE: checklist para avaliação da experiência do usuário em ambientes de internet das coisas. (2018).Google ScholarGoogle Scholar
  5. Mohsen Amiribesheli and Hamid Bouchachia. 2018. A tailored smart home for dementia care. Journal of Ambient Intelligence and Humanized Computing 9, 6 (2018), 1755--1782.Google ScholarGoogle ScholarCross RefCross Ref
  6. Rossana Andrade, Rainara M Carvalho, Italo Linhares de Araújo, Káthia M Oliveira, and Marcio EF Maia. 2017. What changes from ubiquitous computing to internet of things in interaction evaluation?. In International Conference on Distributed, Ambient, and Pervasive Interactions. Springer, 3--21.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Ane Alberdi Aramendi, Alyssa Weakley, Asier Aztiria Goenaga, Maureen Schmitter-Edgecombe, and Diane J Cook. 2018. Automatic assessment of functional health decline in older adults based on smart home data. Journal of biomedical informatics 81 (2018), 119--130.Google ScholarGoogle ScholarCross RefCross Ref
  8. Parvaneh Asghari, Amir Masoud Rahmani, and Hamid Haj Seyyed Javadi. 2019. Internet of Things applications: A systematic review. Computer Networks 148 (2019), 241--261.Google ScholarGoogle ScholarCross RefCross Ref
  9. Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2010. The internet of things: A survey. Computer networks 54, 15 (2010), 2787--2805.Google ScholarGoogle Scholar
  10. Iman Azimi, Olugbenga Oti, Sina Labbaf, Hannakaisa Niela-Vilen, Anna Axelin, Nikil Dutt, Pasi Liljeberg, and Amir M Rahmani. 2019. Personalized maternal sleep quality assessment: An objective iot-based longitudinal study. IEEE Access 7 (2019), 93433--93447.Google ScholarGoogle ScholarCross RefCross Ref
  11. Iman Azimi, Tapio Pahikkala, Amir M Rahmani, Hannakaisa Niela-Vilén, Anna Axelin, and Pasi Liljeberg. 2019. Missing data resilient decision-making for healthcare IoT through personalization: A case study on maternal health. Future Generation Computer Systems 96 (2019), 297--308.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Javier A Bargas-Avila and Kasper Hornbæk. 2011. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In Proceedings of the SIGCHI conference on human factors in computing systems. 2689--2698.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Diana S Bental, Eliza Papadopoulou, Nicholas K Taylor, M Howard Williams, Fraser R Blackmun, Idris S Ibrahim, Mei Yii Lim, Ioannis Mimtsoudis, Stuart W Whyte, and Edel Jennings. 2015. Smartening up the student learning experience with ubiquitous media. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 12, 1s (2015), 1--23.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Daiana Biduski, Ericles Andrei Bellei, João Pedro Mazuco Rodriguez, Luciana Aparecida Martinez Zaina, and Ana Carolina Bertoletti De Marchi. 2020. Assessing long-term user experience on a mobile health application through an in-app embedded conversation-based questionnaire. Computers in Human Behavior 104 (2020), 106169.Google ScholarGoogle ScholarCross RefCross Ref
  15. Igor Bisio, Chiara Garibotto, Aldo Grattarola, Fabio Lavagetto, and Andrea Sciarrone. 2018. Exploiting context-aware capabilities over the internet of things for industry 4.0 applications. Ieee network 32, 3 (2018), 101--107.Google ScholarGoogle Scholar
  16. Jan Bobeth, Johann Schrammel, Stephanie Deutsch, Michael Klein, Mario Drobics, Christina Hochleitner, and Manfred Tscheligi. 2014. Tablet, gestures, remote control? Influence of age on performance and user experience with iTV applications. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video. 139--146.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Christian Bock, George Demiris, Yong Choi, Thai Le, Hilaire J Thompson, Arjmand Samuel, and Danny Huang. 2016. Engaging older adults in the visualization of sensor data facilitated by an open platform for connected devices. Technology and Health Care 24, 4 (2016), 541--550.Google ScholarGoogle ScholarCross RefCross Ref
  18. Mehmet Cem Bölen. 2020. Exploring the determinants of users' continuance intention in smartwatches. Technology in Society 60 (2020), 101209.Google ScholarGoogle ScholarCross RefCross Ref
  19. Niall Bolger and Jean-Philippe Laurenceau. 2013. Intensive longitudinal methods: An introduction to diary and experience sampling research. Guilford press.Google ScholarGoogle Scholar
  20. Hao Cai, Hans Jørgen Krebs, Yingshan Tao, John Hansen, Ruihuan Pan, Yanguang Cai, Egon Toft, and Birthe Dinesen. 2016. A Qualitative Study on Implementation of the Intelligent Bed: Findings from a Rehabilitation Ward at a Large Chinese Tertiary Hospital. Wireless Personal Communications 90, 1 (2016), 399--420.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Vicente López Camacho, Elena de la Guía, Teresa Olivares, M Julia Flores, and Luis Orozco-Barbosa. 2020. Data Capture and Multimodal Learning Analytics Focused on Engagement With a New Wearable IoT Approach. IEEE Transactions on Learning Technologies 13, 4 (2020), 704--717.Google ScholarGoogle ScholarCross RefCross Ref
  22. Marian Carcary, Giovanni Maccani, Eileen Doherty, and Gerard Conway. 2018. Exploring the determinants of IoT adoption: Findings from a systematic literature review. In International Conference on Business Informatics Research. Springer, 113--125.Google ScholarGoogle ScholarCross RefCross Ref
  23. Diego Casado-Mansilla, Pablo Garaizar, and Diego López-de Ipiña. 2019. User Involvement Matters: The Side-Effects of Automated Smart Objects in Pro-environmental Behaviour. In Proceedings of the 9th International Conference on the Internet of Things. 1--4.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Samir Chatterjee, Jongbok Byun, Kaushik Dutta, Rasmus Ulslev Pedersen, Akshay Pottathil, and Harry Xie. 2018. Designing an Internet-of-Things (IoT) and sensor-based in-home monitoring system for assisting diabetes patients: iterative learning from two case studies. European Journal of Information Systems 27, 6 (2018), 670--685.Google ScholarGoogle ScholarCross RefCross Ref
  25. Richard Chen, Filip Jankovic, Nikki Marinsek, Luca Foschini, Lampros Kourtis, Alessio Signorini, Melissa Pugh, Jie Shen, Roy Yaari, Vera Maljkovic, et al. 2019. Developing measures of cognitive impairment in the real world from consumer-grade multimodal sensor streams. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2145--2155.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Minji Cho, Sang-su Lee, and Kun-Pyo Lee. 2019. Once a kind friend is now a thing: Understanding how conversational agents at home are forgotten. In Proceedings of the 2019 on Designing Interactive Systems Conference. 1557--1569.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Bianca Coelho, Rossana MC Andrade, and Ticianne Darin. 2022. Not the Same Everywhere: Comparing the Scope and Definition of User Experience between the Brazilian and International Communities. International Journal of Human-Computer Interaction 38, 7 (2022), 595--613.Google ScholarGoogle ScholarCross RefCross Ref
  28. Lilian Crum. 2020. Laws of UX: Using Psychology to Design Better Products & Services, by Jon Yablonski Sebastopol, CA: O'Reilly Media, 2020, 152 pp. 9781492055310. US 44.99/CAD 59.99.Google ScholarGoogle Scholar
  29. Ticianne Darin, Nayana Carneiro, Rossana Andrade, Rute Castro, and Rodrigo Almeida. 2019. Integrating HCI Perspective into a Mobile Software Development Team: Strategies and lessons from the field. In Proceedings of the 21st international conference on human-computer interaction with mobile devices and services. 1--10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Ticianne Darin, Bianca Coelho, and Bosco Borges. 2019. Which instrument should I use? Supporting decision-making about the evaluation of User Experience. In International Conference on Human-Computer Interaction. Springer, 49--67.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. George Demiris, Debra Parker Oliver, Geraldine Dickey, Marjorie Skubic, and Marilyn Rantz. 2008. Findings from a participatory evaluation of a smart home application for older adults. Technology and health care 16, 2 (2008), 111--118.Google ScholarGoogle Scholar
  32. Christian Ebi, Fabian Schaltegger, Andreas Rüst, and Frank Blumensaat. 2019. Synchronous LoRa mesh network to monitor processes in underground infrastructure. IEEE access 7 (2019), 57663--57677.Google ScholarGoogle ScholarCross RefCross Ref
  33. Anastasios A Economides. 2016. User perceptions of Internet of Things (IoT) systems. In International Conference on E-Business and Telecommunications. Springer, 3--20.Google ScholarGoogle Scholar
  34. Rebecca J Bartlett Ellis, James H Hill, K Denise Kerley, Arjun Sinha, Aaron Ganci, and Cynthia L Russell. 2019. The Feasibility of a Using a Smart Button Mobile Health System to Self-Track Medication Adherence and Deliver Tailored Short Message Service Text Message Feedback. JMIR formative research 3, 2 (2019), e13558.Google ScholarGoogle ScholarCross RefCross Ref
  35. Daniel A Epstein, Monica Caraway, Chuck Johnston, An Ping, James Fogarty, and Sean A Munson. 2016. Beyond abandonment to next steps: understanding and designing for life after personal informatics tool use. In Proceedings of the 2016 CHI conference on human factors in computing systems. 1109--1113.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Marcos Aurelio Fabricio, Frank Herman Behrens, and David Bianchini. 2020. Monitoring of Industrial Electrical Equipment using IoT. IEEE Latin America Transactions 18, 08 (2020), 1425--1432.Google ScholarGoogle ScholarCross RefCross Ref
  37. Rino Falcone and Alessandro Sapienza. 2018. On the users' acceptance of IoT systems: A theoretical approach. Information 9, 3 (2018), 53.Google ScholarGoogle ScholarCross RefCross Ref
  38. Louis Faust, Priscilla Jiménez-Pazmino, James K Holland, Omar Lizardo, David Hachen, and Nitesh V Chawla. 2019. What 30 Days Tells Us About 3 Years: Identifying Early Signs of User Abandonment and Non-Adherence. In Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare. 216--224.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Mathias Funk, Lin-Lin Chen, Shao-Wen Yang, and Yen-Kuang Chen. 2018. Addressing the need to capture scenarios, intentions and preferences: Interactive intentional programming in the smart home. International Journal of Design 12, 1 (2018), 53--66.Google ScholarGoogle Scholar
  40. Radhika Garg. 2019. An analysis of (non-) use practices and decisions of internet of things. In IFIP Conference on Human-Computer Interaction. Springer, 3--24.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Radhika Garg, Hua Cui, and Yash Kapadia. 2021. "Learn, Use, and (Intermittently) Abandon": Exploring the Practices of Early Smart Speaker Adopters in Urban India. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--28.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Radhika Garg and Jenna Kim. 2018. An exploratory study for understanding reasons of (Not-) using internet of things. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1--6.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Radhika Garg and Subhasree Sengupta. 2020. He Is Just Like Me: A Study of the Long-Term Use of Smart Speakers by Parents and Children. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1--24.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Christine Geeng and Franziska Roesner. 2019. Who's In Control? Interactions In Multi-User Smart Homes. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Jens Gerken. 2011. Longitudinal research in human-computer interaction. Ph.D. Dissertation.Google ScholarGoogle Scholar
  46. Amit K Gupta, Isaac Skog, and Peter Händel. 2015. Long-term performance evaluation of a foot-mounted pedestrian navigation device. In 2015 Annual IEEE India Conference (INDICON). IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  47. Peeyush Gupta, Michael J Carey, Sharad Mehrotra, and oberto Yus. 2020. Smartbench: A benchmark for data management in smart spaces. Proceedings of the VLDB Endowment 13, 12 (2020), 1807--1820.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Stefanie Harbich and Marc Hassenzahl. 2017. User experience in the work domain: A longitudinal field study. Interacting with Computers 29, 3 (2017), 306--324.Google ScholarGoogle Scholar
  49. Md Kamrul Hasan, Golam Mushih Tanimul Ahsan, Sheikh Iqbal Ahamed, Rechard Love, and Reza Salim. 2016. Pain level detection from facial image captured by smartphone. Journal of Information Processing 24, 4 (2016), 598--608.Google ScholarGoogle ScholarCross RefCross Ref
  50. Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91--97.Google ScholarGoogle Scholar
  51. Michael Holmes, Miquel Perello Nieto, Hao Song, Emma Tonkin, Sabrina Grant, and Peter Flach. 2020. Modelling Patient Behaviour Using IoT Sensor Data: a Case Study to Evaluate Techniques for Modelling Domestic Behaviour in Recovery from Total Hip Replacement Surgery. Journal of Healthcare Informatics Research 4, 3 (2020), 238--260.Google ScholarGoogle ScholarCross RefCross Ref
  52. Wei Hong, Baohua Xu, Xuepeng Chi, Xuepei Cui, Yinfa Yan, and Tongyang Li. 2020. Long-Term and Extensive Monitoring for Bee Colonies Based on Internet of Things. IEEE Internet of Things Journal 7, 8 (2020), 7148--7155.Google ScholarGoogle ScholarCross RefCross Ref
  53. Kasper Hornbæk and Morten Hertzum. 2017. Technology acceptance and user experience: A review of the experiential component in HCI. ACM Transactions on Computer-Human Interaction (TOCHI) 24, 5 (2017), 1--30.Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Rui Hu, Bruno Michel, Dario Russo, Niccolò Mora, Guido Matrella, Paolo Ciampolini, Francesca Cocchi, Enrico Montanari, Stefano Nunziata, and Thomas Brunschwiler. 2021. An Unsupervised Behavioral Modeling and Alerting System Based on Passive Sensing for Elderly Care. Future Internet 13, 1 (2021), 6.Google ScholarGoogle ScholarCross RefCross Ref
  55. Yu Huang, Yi-Chao Chen, Chuang-Wen You, Dian-Xuan Wu, Yi-Ling Chen, Kai-Lung Hua, and Jane Yung-Jen Hsu. 2017. Toward an easy deployable outdoor parking system---Lessons from long-term deployment. In 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE, 227--236.Google ScholarGoogle ScholarCross RefCross Ref
  56. Ane Irizar-Arrieta, Diego Casado-Mansilla, Pablo Garaizar, Diego López-de Ipiña, and Aiur Retegi. 2020. User perspectives in the design of interactive everyday objects for sustainable behaviour. International Journal of Human-Computer Studies 137 (2020), 102393.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Timo Jakobi, Corinna Ogonowski, Nico Castelli, Gunnar Stevens, and Volker Wulf. 2017. The catch (es) with smart home: Experiences of a living lab field study. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 1620--1633.Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Timo Jakobi, Gunnar Stevens, Nico Castelli, Corinna Ogonowski, Florian Schaub, Nils Vindice, Dave Randall, Peter Tolmie, and Volker Wulf. 2018. Evolving needs in iot control and accountability: A longitudinal study on smart home intelligibility. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4 (2018), 1--28.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Rebecca Jamwal, Libby Callaway, Jane Ackerl, Louise Farnworth, and Di Winkler. 2017. Electronic assistive technology used by people with acquired brain injury in shared supported accommodation: Implications for occupational therapy. British Journal of Occupational Therapy 80, 2 (2017), 89--98.Google ScholarGoogle ScholarCross RefCross Ref
  60. Rikke Hagensby Jensen, Jesper Kjeldskov, and Mikael B Skov. 2018. Assisted shifting of electricity use: a long-term study of managing residential heating. ACM Transactions on Computer-Human Interaction (TOCHI) 25, 5 (2018), 1--33.Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Jie Jiang, Riccardo Pozza, Kristrún Gunnarsdóttir, Nigel Gilbert, and Klaus Moessner. 2017. Recognising activities at home: Digital and human sensors. In Proceedings of the International Conference on Future Networks and Distributed Systems. 1--11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Evangelos Karapanos, Jens Gerken, Jesper Kjeldskov, and Mikael B Skov. 2021. Advances in Longitudinal HCI Research. Springer.Google ScholarGoogle Scholar
  63. Evangelos Karapanos, Jean-Bernard Martens, and Marc Hassenzahl. 2010. On the retrospective assessment of users' experiences over time: memory or actuality? In CHI'10 extended abstracts on human factors in computing systems. 4075--4080.Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Evangelos Karapanos, Jean-Bernard Martens, and Marc Hassenzahl. 2012. Reconstructing experiences with iScale. International Journal of Human-Computer Studies 70, 11 (2012), 849--865.Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Pariya Kashfi, Robert Feldt, Agneta Nilsson, and R Berntsson Svensson. 2014. Models for integrating UX into software engineering practice: an industrial validation. Software Engineering (2014).Google ScholarGoogle Scholar
  66. Ivo Käthner, Sebastian Halder, Christoph Hintermüller, Arnau Espinosa, Christoph Guger, Felip Miralles, Eloisa Vargiu, Stefan Dauwalder, Xavier Rafael-Palou, Marc Solà, et al. 2017. A multifunctional brain-computer interface intended for home use: an evaluation with healthy participants and potential end users with dry and gel-based electrodes. Frontiers in Neuroscience 11 (2017), 286.Google ScholarGoogle ScholarCross RefCross Ref
  67. Pallavi Kaushik, SS Intille, and K Larson. 2008. User-adaptive reminders for home-based medical tasks. Methods of Information in Medicine 47, 03 (2008), 203--207.Google ScholarGoogle ScholarCross RefCross Ref
  68. Barbara A Kitchenham, David Budgen, and O Pearl Brereton. 2010. The value of mapping studies-A participant-observer case study. In 14th international conference on evaluation and assessment in software engineering (ease). 1--9.Google ScholarGoogle ScholarCross RefCross Ref
  69. Maria Kjærup, Mikael B Skov, Peter Axel Nielsen, Jesper Kjeldskov, Jens Gerken, and Harald Reiterer. 2021. Longitudinal Studies in HCI Research: A Review of CHI Publications From 1982--2019. Advances in Longitudinal HCI Research (2021), 11--39.Google ScholarGoogle Scholar
  70. Sari Kujala, Talya Miron-Shatz, and Jussi J Jokinen. 2019. The Cross-Sequential Approach: A Short-Term Method for Studying Long-Term User Experience. Journal of Usability Studies 14, 2 (2019).Google ScholarGoogle Scholar
  71. Sari Kujala, Virpi Roto, Kaisa Väänänen-Vainio-Mattila, Evangelos Karapanos, and Arto Sinnelä. 2011. UX Curve: A method for evaluating long-term user experience. Interacting with computers 23, 5 (2011), 473--483.Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Sari Kujala, Virpi Roto, Kaisa Väänänen-Vainio-Mattila, and Arto Sinnelä. 2011. Identifying hedonic factors in long-term user experience. In Proceedings of the 2011 Conference on Designing Pleasurable Products and Interfaces. 1--8.Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Sari Kujala, Marlene Vogel, Anna E Pohlmeyer, and Marianna Obrist. 2013. Lost in time: the meaning of temporal aspects in user experience. In CHI'13 extended abstracts on human factors in computing systems. 559--564.Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Amanda Lazar, Christian Koehler, Theresa Jean Tanenbaum, and David H Nguyen. 2015. Why we use and abandon smart devices. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing. 635--646.Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann.Google ScholarGoogle Scholar
  76. Bogyeong Lee, Changbum Ryan Ahn, Prakhar Mohan, Theodora Chaspari, and Hyun-Soo Lee. 2020. Evaluating Routine Variability of Daily Activities in Smart Homes with Image Complexity Measures. Journal of Computing in Civil Engineering 34, 6 (2020), 04020042.Google ScholarGoogle ScholarCross RefCross Ref
  77. Seungyeon Lee, Hyejin Ryu, Byungho Park, and Myung Hwan Yun. 2020. Using Physiological Recordings for Studying User Experience: Case of Conversational Agent-Equipped TV. International Journal of Human-Computer Interaction 36, 9 (2020), 815--827.Google ScholarGoogle ScholarCross RefCross Ref
  78. Gerhard Leitner, Anton Josef Fercher, Alexander Felfernig, and Martin Hitz. 2012. Reducing the entry threshold of AAL systems: preliminary results from casa vecchia. In International Conference on Computers for Handicapped Persons. Springer, 709--715.Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Edmond Lou, Gabrielle C Lam, Douglas L Hill, and Man-Sang Wong. 2012. Development of a smart garment to reduce kyphosis during dailyl iving. Medical & biological engineering & computing 50, 11 (2012), 1147--1154.Google ScholarGoogle Scholar
  80. Aigul Mavletova. 2015. A gamification effect in longitudinal web surveys among children and adolescents. International Journal of Market Research 57, 3 (2015), 413--438.Google ScholarGoogle ScholarCross RefCross Ref
  81. Jochen Meyer, Wilko Heuten, and Susanne Boll. 2016. No effects but useful? Long term use of smart health devices. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. 516--521.Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Mateusz Mikusz, Peter Shaw, Nigel Davies, Petteri Nurmi, Sarah Clinch, Ludwig Trotter, Ivan Elhart, Marc Langheinrich, and Adrian Friday. 2021. A longitudinal study of pervasive display personalisation. ACM Transactions on Computer-Human Interaction (TOCHI) 28, 1 (2021), 1--45.Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. Angélique Montuwy, Béatrice Cahour, and Aurélie Dommes. 2019. Using Sensory wearable devices to navigate the city: effectiveness and user experience in older pedestrians. Multimodal Technologies and Interaction 3, 1 (2019), 17.Google ScholarGoogle ScholarCross RefCross Ref
  84. Mohsin Munir, Steffen Erkel, Andreas Dengel, and Sheraz Ahmed. 2017. Pattern-based contextual anomaly detection in HVAC systems. In 2017 IEEE International Conference on Data Mining Workshops (ICDMW). IEEE, 1066--1073.Google ScholarGoogle ScholarCross RefCross Ref
  85. Walter Takashi Nakamura, Iftekhar Ahmed, David Redmiles, Edson Oliveira, David Fernandes, Elaine HT de Oliveira, and Tayana Conte. 2021. Are UX Evaluation Methods Providing the Same Big Picture? Sensors 21, 10 (2021), 3480.Google ScholarGoogle ScholarCross RefCross Ref
  86. Robert C Nickerson, Upkar Varshney, and Jan Muntermann. 2013. A method for taxonomy development and its application in information systems. European Journal of Information Systems 22, 3 (2013), 336--359.Google ScholarGoogle ScholarCross RefCross Ref
  87. Stavroula Ntoa, George Margetis, Margherita Antona, and Constantine Stephanidis. 2021. User Experience Evaluation in Intelligent Environments: A Comprehensive Framework. Technologies 9, 2 (2021), 41.Google ScholarGoogle Scholar
  88. Alexandra Oliveira, Eliana Silva, Joyce Aguiar, Brígida Mónica Faria, Luís Paulo Reis, Henrique Cardoso, Joaquim Gonçalves, Jorge Oliveira e Sá, Victor Carvalho, and Herlander Marques. 2020. Biometrics and quality of life of lymphoma patients: A longitudinal mixed-model approach. Expert Systems (2020), e12640.Google ScholarGoogle Scholar
  89. Luis Oliveira, Val Mitchell, and Andrew May. 2019. Smart home technology---comparing householder expectations at the point of installation with experiences 1 year later. Personal and Ubiquitous Computing (2019), 1--14.Google ScholarGoogle Scholar
  90. Federica Paganelli, Georgios Mylonas, Giovanni Cuffaro, and Ilaria Nesi. 2019. Experiences from using gamification and IoT-based educational tools in high schools towards energy savings. In European Conference on Ambient Intelligence. Springer, 75--91.Google ScholarGoogle ScholarCross RefCross Ref
  91. Charith Perera, Arkady Zaslavsky, Peter Christen, and Dimitrios Georgakopoulos. 2013. Context aware computing for the internet of things: A survey. IEEE communications surveys & tutorials 16, 1 (2013), 414--454.Google ScholarGoogle Scholar
  92. Francesco Piccialli, Yuji Yoshimura, Paolo Benedusi, Carlo Ratti, and Salvatore Cuomo. 2019. Lessons learned from longitudinal modeling of mobile-equipped visitors in a complex museum. Neural Computing and Applications (2019), 1--17.Google ScholarGoogle Scholar
  93. Jinxian Qi, Guozhang Jiang, Gongfa Li, Ying Sun, and Bo Tao. 2019. Intelligent human-computer interaction based on surface EMG gesture recognition. IEEE Access 7 (2019), 61378--61387.Google ScholarGoogle ScholarCross RefCross Ref
  94. Jun Qi, Po Yang, Martin Hanneghan, Dina Fan, Zhikun Deng, and Feng Dong. 2016. Ellipse fitting model for improving the effectiveness of life-logging physical activity measures in an Internet of Things environment. Iet Networks 5, 5 (2016), 107--113.Google ScholarGoogle ScholarCross RefCross Ref
  95. Peter Wilhelm Victor Rasche, Katharina Schäfer, Matthias Wille, Sabine Theis, Christopher Schlick, and Alexander Mertens. 2016. Self monitoring-an age-related comparison. Universitätsbibliothek der RWTH Aachen.Google ScholarGoogle Scholar
  96. Vijay Kumar Ravishankar, Winslow Burleson, and Diane Mahoney. 2015. Smart home strategies for user-centered functional assessment of older adults. International Journal of Automation and Smart Technology 5, 4 (2015), 233--242.Google ScholarGoogle ScholarCross RefCross Ref
  97. Sai Deepika Regani, Qinyi Xu, Beibei Wang, Min Wu, and KJ Ray Liu. 2019. Driver authentication for smart car using wireless sensing. IEEE Internet of Things Journal 7, 3 (2019), 2235--2246.Google ScholarGoogle ScholarCross RefCross Ref
  98. Y Rogers, H Sharp, and J Preece. 2013. Design de Interação: além dea interação humano-computador.Google ScholarGoogle Scholar
  99. Virpi Roto, EL-C Law, Arnold POS Vermeeren, and Jettie Hoonhout. 2011. User experience white paper: Bringing clarity to the concept of user experience. (2011).Google ScholarGoogle Scholar
  100. Claire Rowland, Elizabeth Goodman, Martin Charlier, Ann Light, and Alfred Lui. 2015. Designing connected products: UX for the consumer Internet of Things. "O'Reilly Media, Inc.".Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. Oliver Sack and Carsten Röcker. 2014. "Like a Family Member Who Takes Care of Me" Users' Anthropomorphic Representations and Trustworthiness of Smart Home Environments. Journal ISSN 2368 (2014), 6103.Google ScholarGoogle Scholar
  102. Christos Sardianos, Iraklis Varlamis, George Dimitrakopoulos, Dimosthenis Anagnostopoulos, Abdullah Alsalemi, Faycal Bensaali, Yassine Himeur, and Abbes Amira. 2020. Rehab-c: Recommendations for energy habits change. Future Generation Computer Systems 112 (2020), 394--407.Google ScholarGoogle ScholarCross RefCross Ref
  103. Lisa Schuhmacher, Anne Pagenkopf, Ragavendra Lingamaneni, and Jürgen Scheible. 2018. Emotion Enhancement through Ubiquitous Media Technology in a Smart Kitchen Environment. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia. 317--325.Google ScholarGoogle ScholarDigital LibraryDigital Library
  104. Grace Shin, Yuanyuan Feng, Mohammad Hossein Jarrahi, and Nicci Gafinowitz. 2019. Beyond novelty effect: a mixed-methods exploration into the motivation for long-term activity tracker use. JAMIA open 2, 1 (2019), 62--72.Google ScholarGoogle Scholar
  105. Lukas Sigrist, Rehan Ahmed, Andres Gomez, and Lothar Thiele. 2020. Harvesting-aware optimal communication scheme for infrastructure-less sensing. ACM Transactions on Internet of Things 1, 4 (2020), 1--26.Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. Sandra Souza Rodrigues, Vinicius Luiz da Silva Genesio, Debora Maria Barroso Paiva, and Renata Pontin de Mattos Fortes. 2020. A Case Study on How Brazilian Companies Deal with the User Experience in IoT Projects. In Proceedings of the 38th ACM International Conference on Design of Communication. 1--7.Google ScholarGoogle ScholarDigital LibraryDigital Library
  107. Gina Lee Sprint, Diane J Cook, and Roschelle Fritz. 2020. Behavioral Differences Between Subject Groups Identified Using Smart Homes and Change Point Detection. IEEE Journal of Biomedical and Health Informatics (2020).Google ScholarGoogle Scholar
  108. Rodney A Stewart, Rachelle M Willis, Kriengsak Panuwatwanich, and Oz Sahin. 2013. Showering behavioural response to alarming visual display monitors: longitudinal mixed method study. Behaviour & Information Technology 32, 7 (2013), 695--711.Google ScholarGoogle ScholarCross RefCross Ref
  109. Elena Torta, Franz Werner, David O Johnson, James F Juola, Raymond H Cuijpers, Marco Bazzani, Johannes Oberzaucher, John Lemberger, Hadas Lewy, and Joseph Bregman. 2014. Evaluation of a small socially-assistive humanoid robot in intelligent homes for the care of the elderly. Journal of Intelligent & Robotic Systems 76, 1 (2014), 57--71.Google ScholarGoogle ScholarDigital LibraryDigital Library
  110. Noam Tractinsky. 2018. The usability construct: a dead end? Human-Computer Interaction 33, 2 (2018), 131--177.Google ScholarGoogle ScholarCross RefCross Ref
  111. Milka Trajkova and Aqueasha Martin-Hammond. 2020. "Alexa is a Toy": Exploring Older Adults' Reasons for Using, Limiting, and Abandoning Echo. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1--13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. Yuji Uema and Kazutaka Inoue. 2017. Toward large scale study using smart eyewear. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. 712--716.Google ScholarGoogle ScholarDigital LibraryDigital Library
  113. Thomas van de Werff, Karin Niemantsverdriet, Harm van Essen, and Berry Eggen. 2017. Evaluating interface characteristics for shared lighting systems in the office environment. In Proceedings of the 2017 Conference on Designing Interactive Systems. 209--220.Google ScholarGoogle ScholarDigital LibraryDigital Library
  114. Kristof Van Laerhoven, Mario Wenzel, Anouk Geelen, Christopher Hübel, Maike Wolters, Antje Hebestreit, Lene Frost Andersen, Pieter van't Veer, and Thomas Kubiak. 2017. Experiences from a wearable-mobile acquisition system for ambulatory assessment of diet and activity. In Proceedings of the 4th international Workshop on Sensor-based Activity Recognition and Interaction. 1--8.Google ScholarGoogle ScholarDigital LibraryDigital Library
  115. Elena Vildjiounaite, Ville Huotari, Johanna Kallio, Vesa Kyllönen, Satu-Marja Mäkelä, and Georgy Gimel'farb. 2018. Detection of Prolonged Stress in Smart Office. In Science and Information Conference. Springer, 1253--1261.Google ScholarGoogle Scholar
  116. Jorick Vissers, Lode De Bot, and Bieke Zaman. 2013. MemoLine: evaluating long-term UX with children. In Proceedings of the 12th International Conference on Interaction Design and Children. 285--288.Google ScholarGoogle ScholarDigital LibraryDigital Library
  117. Claes Wohlin. 2014. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th international conference on evaluation and assessment in software engineering. 1--10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  118. Qianli Xu, Jamie SL Ng, Odelia Y Tan, and Zhiyong Huang. 2015. Needs and attitudes of Singaporeans towards home service robots: a multi-generational perspective. Universal access in the information society 14, 4 (2015), 477--486.Google ScholarGoogle Scholar
  119. Supriya Yadav and Gareth Howells. 2017. Analysis of ICMetrics features/technology for wearable devices IOTsensors. In 2017 Seventh International Conference on Emerging Security Technologies (EST). IEEE, 175--178.Google ScholarGoogle ScholarCross RefCross Ref
  120. Sihao Yang, Bin Gao, Long Jiang, Jikun Jin, Zhao Gao, Xiaole Ma, and Wai Lok Woo. 2018. IoT structured long-term wearable social sensing for mental wellbeing. IEEE Internet of Things Journal 6, 2 (2018), 3652--3662.Google ScholarGoogle ScholarCross RefCross Ref
  121. Fenghua Zhu, Yisheng Lv, Yuanyuan Chen, Xiao Wang, Gang Xiong, and Fei-Yue Wang. 2019. Parallel transportation systems: toward IoT-enabled smart urban traffic control and management. IEEE Transactions on Intelligent Transportation Systems 21, 10 (2019), 4063--4071.Google ScholarGoogle ScholarCross RefCross Ref
  122. Martina Ziefle, Philipp Brauner, Felix Heidrich, Christian Möllering, Kriz Lee, and Claudia Armbrüster. 2014. Understanding requirements for textile input devices individually tailored interfaces within home environments. In International Conference on Universal Access in Human-Computer Interaction. Springer, 587--598.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Longitudinal user experience studies in the IoT domain: a brief panorama and challenges to overcome

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          IHC '22: Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems
          October 2022
          482 pages
          ISBN:9781450395069
          DOI:10.1145/3554364

          Copyright © 2022 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 19 October 2022

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate331of973submissions,34%
        • Article Metrics

          • Downloads (Last 12 months)58
          • Downloads (Last 6 weeks)7

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader