Reliable Traffic Sign Recognition System

  • Muhammad Atif University of Florence
  • Andrea Ceccarelli University of Florence
  • Andrea Bondavalli University of Florence


Traffic sign detection and recognition is an important part of Advance Driving Assistance Systems (ADAS), which aims to provide assistance to the driver, autonomous driving, or even monitoring of traffic signs for maintenance. Particularly, misclassification of traffic signs may have severe negative impact on safety of drivers, infrastructures, and human in the surrounding environment. In addition to shape and colors, there are many challenges to recognize traffic signs correctly such as occlusion, motion blur, visual camera’s failures, or physically altering the integrity of traffic signs. In Literature, different machine learning based classifiers and deep classifiers are utilized for Traffic Sign Recognition (TSR), with a few studies consider sequences of frames to commit final decision about traffic signs. This paper proposes a robust TSR against different attacks/failures such as camera related failures, occlusion, broken signs, and patches inserted on traffic signs. We are planning to utilize generative adversarial networks to corrupt images of traffic signs and investigate the robustness of TSR. Furthermore, we are currently working on designing a failure detector, which will help the TSR in advance before recognition, whether images are corrupted with some type of failure. Our conjecture is that failure detector with classifiers will improve the robustness of TSR system.

Palavras-chave: Traffic Sign Recognition, Deep Learning, Camera Failures, Generative Adversarial Networks


Creswell, Antonia, et al. "Generative adversarial networks: An  overview." IEEE Signal Processing Magazine 35.1 (2018): 53-65.

Yuan, Y., Xiong, Z., & Wang, Q. (2016). An incremental framework for video-based traffic sign detection, tracking, and recognition. IEEE Transactions on Intelligent Transportation Systems, 18(7), 1918-1929.

Secci, F., & Ceccarelli, A. (2020, October). On failures of RGB  cameras and their effects in autonomous driving applications. In 2020 IEEE 31st International Symposium on Software Reliability  Engineering (ISSRE) (pp. 13-24). IEEE. 

Atif, M., Zoppi, T., Gharib, M., & Bondavalli, A. (2021, March).  Quantitative comparison of supervised algorithms and feature sets for  traffic sign recognition. In Proceedings of the 36th Annual ACM Symposium on Applied Computing (pp. 174-177).
ATIF, Muhammad; CECCARELLI, Andrea; BONDAVALLI, Andrea. Reliable Traffic Sign Recognition System. In: FAST ABSTRACT - LATIN-AMERICAN SYMPOSIUM ON DEPENDABLE COMPUTING (LADC), 10. , 2021, Florianópolis. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2021 . p. 1-2. DOI: