AuriCheeks: Assistive Technology to Assist in Desktop Navigation


With the increasing effectiveness of various technologies, several devices have been introduced to help people in their daily lives. In this study, we present AuriCheeks, it functions to aid tetraplegics or amputees in navigating on desktop computers, and it is a combination of an ear-worn equipment with the functions of a mouse. It has sensors that capture the movements of the user’s head and process this data in real time. We conducted a performance evaluation and observation. In our findings, we managed to reach a sensitivity rate of 80%, specificity of 76.66%, and a precision level of 77.41%.

Palavras-chave: Accessibility, Wearable Devices, Quadraplegic


Rahib H Abiyev and Murat Arslan. 2020. Head mouse control system for people with disabilities. Expert Systems 37, 1 (2020), e12398.

Wajeeha Akram, Laura Tiberii, and Margrit Betke. 2007. A customizable camera-based human computer interaction system allowing people with disabilities autonomous hands-free navigation of multiple computing tasks. In Universal Access in Ambient Intelligence Environments: 9th ERCIM Workshop on User Interfaces for All, Königswinter, Germany, September 27-28, 2006. Revised Papers. Springer, 28–42.

Leonardo Angelini, Maurizio Caon, Stefano Carrino, Luc Bergeron, Nathalie Nyffeler, Mélanie Jean-Mairet, and Elena Mugellini. 2013. Designing a desirable smart bracelet for older adults. In Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication. 425–434.

Simone Barbosa and Bruno Silva. 2010. Interação humano-computador. Elsevier Brasil.

Rita BERSCH and José C TONOLLI. 2006. Introdução ao conceito de Tecnologia Assistiva e modelos de abordagem da deficiência. Bengala Legal (2006).

Marie Chan, Daniel Estève, Jean-Yves Fourniols, Christophe Escriba, and Eric Campo. 2012. Smart wearable systems: Current status and future challenges. Artificial intelligence in medicine 56, 3 (2012), 137–156.

Heng-Tze Cheng, Martin Griss, Paul Davis, Jianguo Li, and Di You. 2013. Towards zero-shot learning for human activity recognition using semantic attribute sequence model. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. 355–358.

James Clawson, Jessica A Pater, Andrew D Miller, Elizabeth D Mynatt, and Lena Mamykina. 2015. No longer wearing: investigating the abandonment of personal health-tracking technologies on craigslist. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing. 647–658.

Marcelo Martins da Silva, Pedro Muniz, Francisco Carlos de Mattos Brito Oliveira, Lidiane Silva, and Eder Furtado. 2019. Dispositivo vestível para auxiliar alunos tetraplégicos em ambientes escolares.. In Anais do VIII Workshop de Desafios da Computação aplicada à Educação. SBC, 19–21.

Reece Dano. 2015. Health and Fitness Wearables: Affecting Healthy Behaviors, Moving Beyond Fashion.

Dércia Antunes de Souza, Evandro Douglas Moore de Lucena, Fernanda Deolinda Fajan, Cristina Becker Matos Nabarro, and Marcos Antonio Maia de Oliveira. 2017. Gestão de pessoas com deficiência: A empregabilidade de PcD no Brasil. (2017).

Ana Luiza Dias. 2014. Um processo para sistemas web com foco em acessibilidade e usabilidade. Ph. D. Dissertation. Universidade de São Paulo.

Vivian NC DUARTE. [n. d.]. Ergonomia e Acessibilidade: Estudo da acessibilidade física da UniPiaget na cidade da Praia. Santiago: Campus Universitário da Cidade da Praia. Monografia. Licenciatura em Fisioterapia ([n. d.]).

Cláudio Luciano Dusik. 2013. Teclado virtual silábico-alfabético: tecnologia assistiva para pessoas com deficiência física. (2013).

Dennis Ellis, Tony Kennedy, Vamsi Pasupuleti, Adam Williams, and Yalu Ye. 2013. Strive: student-athletes transitioning with camaraderie and competition. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. 2585–2590.

Cemre Eda Erkılıç and Aybüke Yalçın. 2020. Evaluation of the wearable technology market within the scope of digital health technologies., 310 - 323 pages. DOI: 10.30855/gjeb.2020.6.3.006

Paul M Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement.Journal of experimental psychology 47, 6 (1954), 381.

Leire Francés-Morcillo, Paz Morer-Camo, María Isabel Rodríguez-Ferradas, and Aitor Cazón-Martín. 2020. Wearable Design Requirements Identification and Evaluation. Sensors 20, 9 (2020). DOI: 10.3390/s20092599

Vivian Genaro Motti and Kelly Caine. 2014. Understanding the wearability of head-mounted devices from a human-centered perspective. In Proceedings of the 2014 ACM international symposium on wearable computers. 83–86.

A. Godfrey, V. Hetherington, H. Shum, P. Bonato, N.H. Lovell, and S. Stuart. 2018. From A to Z: Wearable technology explained. Maturitas 113 (2018), 40–47. DOI: 10.1016/j.maturitas.2018.04.012

Erik Grönvall and Nervo Verdezoto. 2013. Beyond self-monitoring: understanding non-functional aspects of home-based healthcare technology. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. 587–596.

Pengfei Gui, Liqiong Tang, and Subhas Mukhopadhyay. 2015. MEMS based IMU for tilting measurement: Comparison of complementary and kalman filter based data fusion. In 2015 IEEE 10th conference on Industrial Electronics and Applications (ICIEA). IEEE, 2004–2009.

Romy Britt Hernadez Ferrada. 2009. Inclusão digital de sujeitos com deficiência física através do uso da tecnologia assistiva. (2009).

IBGE. 2010. Censo Demográfico, características gerais da população, religião e pessoas com deficiência. Rio de Janeiro 29 (2010).

ISO 9241-11:2018 1999. Human-centred design processes for interactive systems. Standard. International Organization for Standardization.

Douglas Kaminski 2014. Redes sociais temáticas inclusivas. (2014).

Soochan Kim, Minje Park, Sasiporn Anumas, and Jaeha Yoo. 2010. Head mouse system based on gyro- and opto-sensors. In 2010 3rd International Conference on Biomedical Engineering and Informatics, Vol. 4. 1503–1506. DOI: 10.1109/BMEI.2010.5639399

Paula Kotzé, Mariki Eloff, and Ayodele Adesina-Ojo. 2004. Accessible computer interaction for people with disabilities: The case of quadriplegics. 6th International Conference on Enterprise Information Systems, Porto ….

Hunter Larson, James Gips, Fulton Hall, and C Stephanidis. 2003. A web browser for people with quadriplegia. Universal Access in HCI: Inclusive Design in the Information Society 4 (2003), 226–230.

Amanda Lazar, Christian Koehler, Theresa Jean Tanenbaum, and David H Nguyen. 2015. Why we use and abandon smart devices. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing. 635–646.

Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann.

Yingzi Lin, Jeffrey Breugelmans, Maura Iversen, and David Schmidt. 2017. An Adaptive Interface Design (AID) for enhanced computer accessibility and rehabilitation. International Journal of Human-Computer Studies 98 (2017), 14–23.

Suelen Moraes Lorenzo and Nilson Rogério Silva. 2017. Contratação de pessoas com deficiência nas empresas na perspectiva dos profissionais de recursos humanos. Revista Brasileira de Educação Especial 23 (2017), 345–360.

A Melo, Lara Schibelsky Godoy Piccolo, Ismael Mattos Andrade Ávila, and C Tambascia. 2009. Usabilidade, acessibilidade e inteligibilidade aplicadas em interfaces para analfabetos, idosos e pessoas com deficiência. Anais do Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais. 9 (2009). [link]

Amanda Meincke Melo. 2014. Acessibilidade e inclusão digital. Livro dos Tutoriais do XIII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (2014), 29.

Amanda Meincke Melo and M Cecília C Baranauskas. 2005. Design e avaliação de tecnologia web-acessível. In Congresso da Sociedade Brasileira de Computação, Vol. 25. 1500–1544.

Kathryn Mercer, Lora Giangregorio, Eric Schneider, Parmit Chilana, Melissa Li, Kelly Grindrod, 2016. Acceptance of commercially available wearable activity trackers among adults aged over 50 and with chronic illness: a mixed-methods evaluation. JMIR mHealth and uHealth 4, 1 (2016), e4225.

Microsoft. 2013. Microsoft Accessibility. [link].

Maria Carolina Monard and José Augusto Baranauskas. 2003. Conceitos sobre aprendizado de máquina. Sistemas inteligentes-Fundamentos e aplicações 1, 1 (2003), 32.

Janaíne Mônica de Oliveira. 2016. Obtenção e caracterização de compósitos biodegradáveis de Poliácido Láctico (PLA) reforçados com fibras de curauá. (2016).

Chulsung Park, Pai H Chou, and Yicun Sun. 2006. A wearable wireless sensor platform for interactive dance performances. In Fourth Annual IEEE International Conference on Pervasive Computing and Communications (PERCOM’06). IEEE, 6–pp.

Sandra Souza Rodrigues and Renata Pontin de Mattos Fortes. 2019. Uma revisão sobre acessibilidade no desenvolvimento de Internet das Coisas: oportunidades e tendências. Revista de Sistemas e Computação-RSC 9, 1 (2019).

Yvonne Rogers, Helen Sharp, and Jennifer Preece. 2013. Design de Interação. Bookman Editora.

Márcia Barros de Sales 2002. Desenvolvimento de um checklist para a avaliação de acessibilidade da Web para usuários idosos. (2002).


Carlos Alberto Silva and André Pimenta Freire. 2018. Inspeção da Acessibilidade de Aplicativos Móveis Utilizando Software Leitor de Telas. In Anais Estendidos do XVII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (Belém). SBC, Porto Alegre, RS, Brasil. DOI: 10.5753/ihc.2018.4174

Nigel Sim, Constantinos Gavriel, William W. Abbott, and A. Aldo Faisal. 2013. The head mouse — Head gaze estimation “In-the-Wild” with low-cost inertial sensors for BMI use. In 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER). 735–738. DOI: 10.1109/NER.2013.6696039

Gregg C Vanderheiden. 1994. Application software design guidelines: Increasing the accessibility of application software to people with disabilities and older users. Trace Center,[online] Available [link] (1994).

Greg Welch, Gary Bishop, 1995. An introduction to the Kalman filter. (1995).

Dong Wen, Xingting Zhang, and Jianbo Lei. 2017. Consumers’ perceived attitudes to wearable devices in health monitoring in China.: A survey study. Computer methods and programs in biomedicine 140 (2017), 131–137.
NEVES FILHO, Petrucio De Carvalho; ALMEIDA FEITOSA, Carlos Eduardo; SOUSA BARRETO, Juliana; MARTINS DA SILVA, Marcelo. AuriCheeks: Assistive Technology to Assist in Desktop Navigation. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 22. , 2023, Maceió/AL. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2023 .