Efficient License Plate Recognition in Videos Using Visual Rhythm and Accumulative Line Analysis

• Victor Nascimento Ribeiro USP
• Nina S. T. Hirata USP

DOI: https://doi.org/10.5753/sibgrapi.est.2024.31664

Resumo

Video-based Automatic License Plate Recognition (ALPR) involves extracting vehicle license plate text information from video captures. Traditional systems typically rely heavily on high-end computing resources and utilize multiple frames to recognize license plates, leading to increased computational overhead. In this paper, we propose two methods capable of efficiently extracting exactly one frame per vehicle and recognizing its license plate characters from this single image, thus significantly reducing computational demands. The first method uses Visual Rhythm (VR) to generate time-spatial images from videos, while the second employs Accumulative Line Analysis (ALA), a novel algorithm based on single-line video processing for real-time operation. Both methods leverage YOLO for license plate detection within the frame and a Convolutional Neural Network (CNN) for Optical Character Recognition (OCR) to extract textual information. Experiments on real videos demonstrate that the proposed methods achieve results comparable to traditional frame-by-frame approaches, with processing speeds three times faster.

Referências

P. Kaur, Y. Kumar, S. Ahmed, A. Alhumam, R. Singla, and M. F. Ijaz, “Automatic License Plate Recognition System for Vehicles Using a CNN,” Computers, Materials & Continua, vol. 71, no. 1, pp. 35–50, 2022.

P. Mukhija, P. K. Dahiya, and P. Priyanka, “Challenges in automatic license plate recognition system: An indian scenario,” in Fourth International Conference on Computational Intelligence and Communication Technologies (CCICT), 2021, pp. 255–259.

C.-J. Lin, C.-C. Chuang, and H.-Y. Lin, “Edge-AI-Based Real-Time Automated License Plate Recognition System,” Applied Sciences, vol. 12, no. 3, 2022.

C.-N. Anagnostopoulos, I. Anagnostopoulos, I. Psoroulas, V. Loumos, and E. Kayafas, “License Plate Recognition From Still Images and Video Sequences: A Survey,” IEEE Transactions on Intelligent Transportation Systems, vol. 9, pp. 377 – 391, 10 2008.

Q. Wang, X. Lu, C. Zhang, Y. Yuan, and X. Li, “LSV-LP: Large-Scale Video-Based License Plate Detection and Recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 1, pp. 752–767, 2023.

M. A. Arefeen, S. T. Nimi, and M. Y. S. Uddin, “FrameHopper: Selective Processing of Video Frames in Detection-driven Real-Time Video Analytics,” arXiv:2203.11493, 2022.

C. Ngo, T. Pong, and R. Chin, “Detection of gradual transitions through temporal slice analysis,” in Conference on Computer Vision and Pattern Recognition, vol. 1, 1999, pp. 36–41.

A. d. S. Pinto, H. Pedrini, W. Schwartz, and A. Rocha, “Video-based face spoofing detection through visual rhythm analysis,” in 25th SIBGRAPI Conference on Graphics, Patterns and Images, 2012, pp. 221–228.

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” arXiv:1506.02640, 2016.

J. Terven, D.-M. Córdova-Esparza, and J.-A. Romero-González, “A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS,” Machine Learning and Knowledge Extraction, vol. 5, no. 4, pp. 1680–1716, 2023. [Online]. Available: [link]

N. Sarika, N. Sirisala, and M. S. Velpuru, “CNN based Optical Character Recognition and Applications,” in 6th International Conference on Inventive Computation Technologies (ICICT), 2021, pp. 666–672.

R. Shashidhar, A. S. Manjunath, R. Santhosh Kumar, M. Roopa, and S. B. Puneeth, “Vehicle Number Plate Detection and Recognition using YOLO-V3 and OCR Method,” in IEEE International Conference on Mobile Networks and Wireless Communications (ICMNWC), 2021, pp. 1–5.

D. J. Matuszewski, “Computer vision for continuous plankton monitoring,” Master’s thesis, Instituto de Matemática e Estatística, University of São Paulo, São Paulo, 2014, retrieved 2023-08-06.

V. Ribeiro and N. Hirata, “Combining YOLO and Visual Rhythm for Vehicle Counting,” in Anais Estendidos da XXXVI Conference on Graphics, Patterns and Images. Porto Alegre, RS, Brasil: SBC, 2023, pp. 164–167.

R. U. Projects, “License plate recognition dataset,” [link], dec 2022, visited on 2024-07-02.

S. Montazzolli and C. Jung, “Real-Time Brazilian License Plate Detection and Recognition Using Deep Convolutional Neural Networks,” in 30th Conference on Graphics, Patterns and Images (SIBGRAPI), 2017, pp. 55–62.

I. O. De Oliveira, R. Laroca, D. Menotti, K. V. O. Fonseca, and R. Minetto, “Vehicle-Rear: A New Dataset to Explore Feature Fusion for Vehicle Identification Using Convolutional Neural Networks,” IEEE Access, vol. 9, pp. 101 065–101 077, 2021.

B. Dwyer, J. Nelson, J. Solawetz et al., “Roboflow (version 1.0) [software],” [link], 2022, computer vision.