Evaluating the User Experience of Consumer Sleep Technologies with the MALTU mode
Abstract
Sleep is a vital physiological need for human health and well-being, and its quality plays a crucial role in our daily lives. Inadequate sleep can lead to a range of health problems, including chronic fatigue, lack of concentration, cognitive impairment, and an increased risk of cardiovascular and metabolic diseases. Amidst an increasingly aware society of the benefits of well slept nights, there is a growing interest in monitoring and optimizing sleep. This trend is amplified by the continuous advancement of technology, particularly the increase of the Internet of Things (IoT) and E-Health technologies. In this context, the development of consumer sleep technologies emerges alongside the increasingly easier methods to utilize them and the growing awareness of the importance of sleep for health. These technologies offer a variety of solutions, ranging from mobile applications to smart wearable devices. These tools can empower individuals to take steps to improve their sleep hygiene and, consequently, their quality of life. However, some user reviews on the Google Play platform raises issues related to their user experience across all consumer sleep technologies. This article aims to evaluate the User Experience of consumer sleep technologies based on users reviews on Google Play by using the extended MALTU instrument. The evaluation consists in collecting reviews on the platform to analyse and categorize them with consistency and real user reviews. A bibliographical research about consumer sleep technologies was also carried out. The technologies under evaluation include Oura, a sensor-equipped ring, Whoop, a sensorequipped band and the Sleep as Android app. The results revealed issues regarding interface, synchronization and metrics.
Keywords:
E-Health, Ubiquitous Systems, User Experience, Consumer Sleep Technologies
References
Sachin Ananth. 2021. Sleep apps: current limitations and challenges. Sleep Science 14, 01 (2021), 83–86.
Oresti Banos, Claudia Villalonga, Rafael Garcia, Alejandro Saez, Miguel Damas, Juan A Holgado-Terriza, Hector Pomares Sungyong Lee, and Ignacio Rojas. 2015. Design, implementation and validation of a novel open framework for agile development of mobile health applications. BioMedical Engineering OnLine 14, 56 (2015). DOI: 10.1186/1475-925X-14-S2-S6
Simone Barbosa and Bruno Silva. 2010. Interação humano-computador. Elsevier Brasil.
Marcos Randel Freitas Brito. 2018. Explorando o modelo MALTU na avaliação de usabilidade e experiência de uso em um dispositivo ubíquo. (2018).
Rainara Maia Carvalho. 2019. Correlate & lead: process and catalog of nonfunctional requirements correlations in ubicomp and iot systems. (2019).
Yong K Choi, George Demiris, Shih-Yin Lin, Sarah J Iribarren, Carol A Landis, Hilaire J Thompson, Susan M McCurry, Margaret M Heitkemper, and Teresa M Ward. 2018. Smartphone applications to support sleep self-management: review and evaluation. Journal of Clinical Sleep Medicine 14, 10 (2018), 1783–1790.
José Cezar de Souza Filho, Marcos Randel Freitas Brito, Antonio Raimundo Rocha Mendonça, Marcos Vitor Martins, and Andréia Libório Sampaio. 2018. Hidrate spark: Avaliando um sistema ubíquo para motivar a ingestão de Água. In Anais Estendidos do XVII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais. SBC.
Karl Doghramji and William C Jangro. 2016. Adverse effects of psychotropic medications on sleep. Psychiatric Clinics 39, 3 (2016), 487–502.
Peyman Emamian and Juan Li. 2017. SimpleHealth — A mobile cloud platform to support lightweight mobile health applications for low-end cellphones. In 2017 IEEE 19th International Conference on e-Health Networking, Applications and Services (Healthcom). 1–6. DOI: 10.1109/HealthCom.2017.8210759
Carlos Eduardo Almeida Feitosa. 2022. Estendendo o modelo maltu para a avaliação da usabilidade e experiência do usuário em sistemas ubíquos. (2022).
Quinn Grundy, Kellia Chiu, Fabian Held, Andrea Continella, Lisa Bero, and Ralph Holz. 2019. Data sharing practices of medicines related apps and the mobile ecosystem: traffic, content, and network analysis. bmj 364 (2019).
Ian B Hickie, Sharon L Naismith, Rébecca Robillard, Elizabeth M Scott, and Daniel F Hermens. 2013. Manipulating the sleep-wake cycle and circadian rhythms to improve clinical management of major depression. BMC medicine 11 (2013), 1–27.
David R Hillman and Leon C Lack. 2013. Public health implications of sleep loss: the community burden. Medical Journal of Australia 199 (2013), S7–S10.
HIMSS. 2019. HIMSS Healthcare Information and Management Systems Society| HIMSS. [link]
ISO. 1998. ISO 9241-11:1998(en), Last visited 14/05/2015. (1998). URL: [link].
ISO/IEC. 2001. ISO/IEC 9126. Software engineering – Product quality. ISO/IEC.
Hammad Khalid, Emad Shihab, Meiyappan Nagappan, and Ahmed E Hassan. 2014. What do mobile app users complain about? IEEE software 32, 3 (2014), 70–77.
Seema Khosla, Maryann C Deak, Dominic Gault, Cathy A Goldstein, Dennis Hwang, Younghoon Kwon, Daniel O’Hearn, Sharon Schutte-Rodin, Michael Yurcheshen, Ilene M Rosen, et al. 2018. Consumer sleep technology: an American Academy of Sleep Medicine position statement. Journal of clinical sleep medicine 14, 5 (2018), 877–880.
Yoojung Kim, Bongshin Lee, and Eun Kyoung Choe. 2019. Investigating data accessibility of personal health apps. Journal of the American Medical Informatics Association 26, 5 (2019), 412–419.
Ping-Ru T Ko, Julie A Kientz, Eun Kyoung Choe, Matthew Kay, Carol A Landis, and Nathaniel F Watson. 2015. Consumer sleep technologies: a review of the landscape. Journal of clinical sleep medicine 11, 12 (2015), 1455–1461.
Peta A Lee-Tobin, Rowan P Ogeil, Michael Savic, and Dan I Lubman. 2017. Rate my sleep: examining the information, function, and basis in empirical evidence within sleep applications for mobile devices. Journal of Clinical Sleep Medicine 13, 11 (2017), 1349–1354.
Lorena Caligiuri Lemes. 2023. Aplicativos móveis para monitorar o tempo de sono: uma busca sistemática nas lojas online no Brasil. (2023).
Marília Soares Mendes. 2015. MALTU–Um modelo para avaliação da interação em sistemas sociais a partir da linguagem textual do usuário. (2015).
Francisco Moreira and Emanuel Coutinho. 2023. Evaluating the User Experience of Type 1 Diabetes Control Applications. In Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems. 1–11.
M. M. Neto, J. N. de Souza, A. R. da Rocha, E. F. Coutinho, and L. O. Moreira. 2017. Miner: an approach for management of iot elements in a cloud using software defined network. In 5th International Workshop on ADVANCEs in ICT INfrastructures and Services (ADVANCE 2017).
Jakob Nielsen. 1994. Usability inspection methods. In Conference companion on Human factors in computing systems. 413–414.
Achilleas Papageorgiou, Michael Strigkos, Eugenia Politou, Efthimios Alepis, Agusti Solanas, and Constantinos Patsakis. 2018. Security and privacy analysis of mobile health applications: the alarming state of practice. Ieee Access 6 (2018), 9390–9403.
Larissa Castro Rocha. 2017. HUbis: heurísticas de usabilidade para avaliar sistemas ubíquos. (2017).
Hangsik Shin and Jaegeol Cho. 2014. Unconstrained snoring detection using a smartphone during ordinary sleep. Biomedical engineering online 13 (2014), 1–14.
Annemieke van Straten and Pim Cuijpers. 2009. Self-help therapy for insomnia: a meta-analysis. Sleep medicine reviews 13, 1 (2009), 61–71.
Oresti Banos, Claudia Villalonga, Rafael Garcia, Alejandro Saez, Miguel Damas, Juan A Holgado-Terriza, Hector Pomares Sungyong Lee, and Ignacio Rojas. 2015. Design, implementation and validation of a novel open framework for agile development of mobile health applications. BioMedical Engineering OnLine 14, 56 (2015). DOI: 10.1186/1475-925X-14-S2-S6
Simone Barbosa and Bruno Silva. 2010. Interação humano-computador. Elsevier Brasil.
Marcos Randel Freitas Brito. 2018. Explorando o modelo MALTU na avaliação de usabilidade e experiência de uso em um dispositivo ubíquo. (2018).
Rainara Maia Carvalho. 2019. Correlate & lead: process and catalog of nonfunctional requirements correlations in ubicomp and iot systems. (2019).
Yong K Choi, George Demiris, Shih-Yin Lin, Sarah J Iribarren, Carol A Landis, Hilaire J Thompson, Susan M McCurry, Margaret M Heitkemper, and Teresa M Ward. 2018. Smartphone applications to support sleep self-management: review and evaluation. Journal of Clinical Sleep Medicine 14, 10 (2018), 1783–1790.
José Cezar de Souza Filho, Marcos Randel Freitas Brito, Antonio Raimundo Rocha Mendonça, Marcos Vitor Martins, and Andréia Libório Sampaio. 2018. Hidrate spark: Avaliando um sistema ubíquo para motivar a ingestão de Água. In Anais Estendidos do XVII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais. SBC.
Karl Doghramji and William C Jangro. 2016. Adverse effects of psychotropic medications on sleep. Psychiatric Clinics 39, 3 (2016), 487–502.
Peyman Emamian and Juan Li. 2017. SimpleHealth — A mobile cloud platform to support lightweight mobile health applications for low-end cellphones. In 2017 IEEE 19th International Conference on e-Health Networking, Applications and Services (Healthcom). 1–6. DOI: 10.1109/HealthCom.2017.8210759
Carlos Eduardo Almeida Feitosa. 2022. Estendendo o modelo maltu para a avaliação da usabilidade e experiência do usuário em sistemas ubíquos. (2022).
Quinn Grundy, Kellia Chiu, Fabian Held, Andrea Continella, Lisa Bero, and Ralph Holz. 2019. Data sharing practices of medicines related apps and the mobile ecosystem: traffic, content, and network analysis. bmj 364 (2019).
Ian B Hickie, Sharon L Naismith, Rébecca Robillard, Elizabeth M Scott, and Daniel F Hermens. 2013. Manipulating the sleep-wake cycle and circadian rhythms to improve clinical management of major depression. BMC medicine 11 (2013), 1–27.
David R Hillman and Leon C Lack. 2013. Public health implications of sleep loss: the community burden. Medical Journal of Australia 199 (2013), S7–S10.
HIMSS. 2019. HIMSS Healthcare Information and Management Systems Society| HIMSS. [link]
ISO. 1998. ISO 9241-11:1998(en), Last visited 14/05/2015. (1998). URL: [link].
ISO/IEC. 2001. ISO/IEC 9126. Software engineering – Product quality. ISO/IEC.
Hammad Khalid, Emad Shihab, Meiyappan Nagappan, and Ahmed E Hassan. 2014. What do mobile app users complain about? IEEE software 32, 3 (2014), 70–77.
Seema Khosla, Maryann C Deak, Dominic Gault, Cathy A Goldstein, Dennis Hwang, Younghoon Kwon, Daniel O’Hearn, Sharon Schutte-Rodin, Michael Yurcheshen, Ilene M Rosen, et al. 2018. Consumer sleep technology: an American Academy of Sleep Medicine position statement. Journal of clinical sleep medicine 14, 5 (2018), 877–880.
Yoojung Kim, Bongshin Lee, and Eun Kyoung Choe. 2019. Investigating data accessibility of personal health apps. Journal of the American Medical Informatics Association 26, 5 (2019), 412–419.
Ping-Ru T Ko, Julie A Kientz, Eun Kyoung Choe, Matthew Kay, Carol A Landis, and Nathaniel F Watson. 2015. Consumer sleep technologies: a review of the landscape. Journal of clinical sleep medicine 11, 12 (2015), 1455–1461.
Peta A Lee-Tobin, Rowan P Ogeil, Michael Savic, and Dan I Lubman. 2017. Rate my sleep: examining the information, function, and basis in empirical evidence within sleep applications for mobile devices. Journal of Clinical Sleep Medicine 13, 11 (2017), 1349–1354.
Lorena Caligiuri Lemes. 2023. Aplicativos móveis para monitorar o tempo de sono: uma busca sistemática nas lojas online no Brasil. (2023).
Marília Soares Mendes. 2015. MALTU–Um modelo para avaliação da interação em sistemas sociais a partir da linguagem textual do usuário. (2015).
Francisco Moreira and Emanuel Coutinho. 2023. Evaluating the User Experience of Type 1 Diabetes Control Applications. In Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems. 1–11.
M. M. Neto, J. N. de Souza, A. R. da Rocha, E. F. Coutinho, and L. O. Moreira. 2017. Miner: an approach for management of iot elements in a cloud using software defined network. In 5th International Workshop on ADVANCEs in ICT INfrastructures and Services (ADVANCE 2017).
Jakob Nielsen. 1994. Usability inspection methods. In Conference companion on Human factors in computing systems. 413–414.
Achilleas Papageorgiou, Michael Strigkos, Eugenia Politou, Efthimios Alepis, Agusti Solanas, and Constantinos Patsakis. 2018. Security and privacy analysis of mobile health applications: the alarming state of practice. Ieee Access 6 (2018), 9390–9403.
Larissa Castro Rocha. 2017. HUbis: heurísticas de usabilidade para avaliar sistemas ubíquos. (2017).
Hangsik Shin and Jaegeol Cho. 2014. Unconstrained snoring detection using a smartphone during ordinary sleep. Biomedical engineering online 13 (2014), 1–14.
Annemieke van Straten and Pim Cuijpers. 2009. Self-help therapy for insomnia: a meta-analysis. Sleep medicine reviews 13, 1 (2009), 61–71.
Published
2024-11-07
How to Cite
MOREIRA, Francisco; COUTINHO, Emanuel; MARTINS, Marcelo; FEITOSA, Carlos.
Evaluating the User Experience of Consumer Sleep Technologies with the MALTU mode. In: BRAZILIAN SYMPOSIUM ON HUMAN FACTORS IN COMPUTATIONAL SYSTEMS (IHC), 23. , 2024, Brasília/DF.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 300-313.
