Smart device to improve the experience of people with hearing disabilities in Inclusive Smart Cities

  • Marcos Rodrigo B. Carvalho UFBA
  • João Soares de Oliveira Neto UFBA

Abstract


This paper presents the development of a wearable device designed to support the mobility of deaf individuals in urban environments. The system is composed of two modules: a sensory belt equipped with directional microphones and vibration motors, and a wrist interface with an OLED display, both controlled by ESP32 microcontrollers. Communication between the modules is performed using the ESP-NOW protocol. The device detects urban sounds and converts them into visual and tactile alerts indicating direction and intensity. Initial tests demonstrated reliable detection, effective feedback, and intuitive user interaction. The project aligns with universal design principles and aims to contribute to more inclusive smart cities.

References

ALMEIDA, Jônatas Loureiro de. Sistema wireless de aquisição e sinalização de eventos sonoros para deficientes auditivos. 2016. 57 f. Trabalho de Conclusão de Curso (Engenharia de Computação) – Universidade Tecnológica Federal do Paraná, Pato Branco, 2016.

AQUINO, Maria Lucilene de Oliveira. Caminhando no chão da metrópole Manaus: a Geografia dos surdos. 2024.

GUERRA, Camila Stéfany Diógenes. VibraSom: sistema embarcado de reprodução sonora por meio de vibração para pessoas com deficiência auditiva. 2021. 70 f. Trabalho de Conclusão de Curso (Bacharelado em Engenharia de Computação) – Universidade Federal do Ceará, Fortaleza, 2021.

HERSH, Marion A.; JOHNSON, Michael A. Assistive Technology for Visually Impaired and Blind People. London: Springer, 2008.

LEE, K.; CHEN, Y.; WANG, X. A wearable IoT device using deep learning for AI-based hearing assistance automation. arXiv preprint, 2020. Disponível em: [link]. Acesso em: 22 jun. 2025.

ORGANIZAÇÃO MUNDIAL DA SAÚDE (OMS). World report on hearing. Geneva: World Health Organization, 2021. Disponível em: [link]. Acesso em: 22 jun. 2025.
Published
2025-08-12
CARVALHO, Marcos Rodrigo B.; OLIVEIRA NETO, João Soares de. Smart device to improve the experience of people with hearing disabilities in Inclusive Smart Cities. In: REGIONAL SCHOOL ON COMPUTING OF BAHIA, ALAGOAS, AND SERGIPE (ERBASE), 25. , 2025, Lagarto/SE. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2025 . p. 381-386. DOI: https://doi.org/10.5753/erbase.2025.14095.