Masked Faces: Overcoming Recognition Challenges with Transfer Learning in CNNs

• Italo T. Noé Universidade Federal de Ouro Preto (UFOP)
• Lucas H. L. Costa Universidade Federal de Ouro Preto (UFOP)
• Talles H. Medeiros Universidade Federal de Ouro Preto (UFOP)

DOI: https://doi.org/10.5753/kdmile.2023.232907

Resumo

Amidst the coronavirus pandemic, the use of masks has become one of the main ways to prevent and control the spread of this virus. However, masks impacted the performance of several face recognition models, by reducing visible features in images. The objective of this work is to present a model of convolutional neural networks with transfer learning capable of classifying thirty individuals regardless of the use of masks. The model was trained in a dataset with real images of masks and another with the insertion of computationally simulated masks and the accuracy results obtained were greater than 90%. Due to the number of classes and limitations of the dataset used, the result is consistent with the low number of related works to facial recognition with masks and highlights the complexity of the problem. It is believed that the use of a dataset with superior quality and quantity of images would make the use of the model more viable for the real world, but the tests presented are promising.

Palavras-chave: Convolutional Neural Networks, Facial Recognition, Transfer learning

Referências

Anwar, A. and Raychowdhury, A. Masked face recognition for secure authentication. arXiv preprint arXiv:2008.11104 , 2020.

Chawla, N. V., Bowyer, K. W., Hall, L. O., and Kegelmeyer, W. P. Smote: synthetic minority over-sampling technique. Journal of artificial intelligence research vol. 16, pp. 321–357, 2002.

Hariri, W. Efficient masked face recognition method during the covid-19 pandemic. Signal, image and video processing 16 (3): 605–612, 2022.

Ngan, M. L., Grother, P. J., and Hanaoka, K. K. Ongoing face recognition vendor test (frvt) part 6a: Face recognition accuracy with masks using pre-covid-19 algorithms, 2020.

Noe, I. T. Redes neurais convolucionais aplicadas ao reconhecimento facial em indivíduos com máscara. https://github.com/ItaloTN10/TCC2, 2021.

Pan, S. J. and Yang, Q. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 22 (10): 1345–1359, 2010.

Simonyan, K. and Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv, 2014.

Vincent Chi-Chung Cheng, e. a. The role of community-wide wearing of face mask for control of coronavirus disease 2019 (covid-19) epidemic due to sars-cov-2. Journal of Infection vol. 81.1, pp. 107–114, 2020.

Wang, Z., Huang, B., Wang, G., Yi, P., and Jiang, K. Masked face recognition dataset and application. IEEE Transactions on Biometrics, Behavior, and Identity Science, 2020.