Entropy-based Client Selection Mechanism for Vehicular Federated Environments

• John Lucas R. P. de Sousa UFPA
• Wellington Lobato UNICAMP
• Denis Rosário UFPA
• Eduardo Cerqueira UFPA
• Leandro A. Villas UNICAMP

DOI: https://doi.org/10.5753/wperformance.2023.230700

Resumo

Autonomous driving requires machine learning models to be trained at the edge for improved efficiency and reduced communication latency. Federated learning (FL) allows knowledge sharing among all devices, but Not Independent and Identically Distributed (non-IID) scenarios with biased device data distributions can lead to statistical heterogeneity and lower classification accuracy. This paper proposes an entropy-based client selection approach for vehicular federated learning environments that aims to address the challenges posed by non-IID data in vehicular networks. The proposed method is compared to a random selection mechanism in both IID and non-IID scenarios, as well as in a scenario with random client drops. The results show that the entropy-based selection method outperforms the random selection method in all compared metrics, particularly in non-IID scenarios.

Palavras-chave: Federated Learning, Vehicular Networks, Client Selection, Entropy

Referências

AbdulRahman, S., Tout, H., Mourad, A., and Talhi, C. (2020). Fedmccs: Multicriteria client selection model for optimal iot federated learning. IEEE Internet of Things Journal, 8(6):4723–4735.

Agarwal, N., Kairouz, P., and Liu, Z. (2021). The Skellam Mechanism for Differentially Private Federated Learning. In Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P. S., and Vaughan, J. W., editors, Advances in Neural Information Processing Systems, volume 34, pages 5052–5064. Curran Associates, Inc.

Barros, A., Rosário, D., Cerqueira, E., and da Fonseca, N. L. (2021). A strategy to the reduction of communication overhead and overfitting in federated learning. In Anais do XXVI Workshop de Gerência e Operação de Redes e Serviços, pages 1–13. SBC.

Damaj, I. W., Serhal, D. K., Hamandi, L. A., Zantout, R. N., and Mouftah, H. T. (2021). Connected and autonomous electric vehicles: Quality of experience survey and taxonomy. Vehicular Communications, 28:100312.

Du, A., Shen, Y., Tseng, L., Higuchi, T., Ucar, S., and Altintas, O. (2021). Enabling pervasive federated learning using vehicular virtual edge servers. In 2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), pages 324–327. IEEE.

Huang, T., Lin, W., Shen, L., Li, K., and Zomaya, A. Y. (2022). Stochastic client selection for federated learning with volatile clients. IEEE Internet of Things Journal.

Jee Cho, Y., Wang, J., and Joshi, G. (2022). Towards understanding biased client selection in federated learning. In Camps-Valls, G., Ruiz, F. J. R., and Valera, I., editors, Proceedings of The 25th International Conference on Artificial Intelligence and Statistics, volume 151 of Proceedings of Machine Learning Research, pages 10351–10375. PMLR.

Li, A., Zhang, L., Tan, J., Qin, Y., Wang, J., and Li, X.-Y. (2021). Sample-level data selection for federated learning. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications, pages 1–10. IEEE.

Liu, S., Yu, J., Deng, X., and Wan, S. (2022). Fedcpf: An efficient-communication federated learning approach for vehicular edge computing in 6g communication networks. IEEE Transactions on Intelligent Transportation Systems, 23(2):1616–1629.

Liu, Y., Yu, J. J., Kang, J., Niyato, D., and Zhang, S. (2020). Privacy-Preserving Traffic Flow Prediction: A Federated Learning Approach. IEEE Internet of Things Journal, 7(8):7751–7763.

Lobato, W., Costa, J. B. D. D., Souza, A. M. d., Rosário, D., Sommer, C., and Villas, L. A. (2022). Flexe: Investigating federated learning in connected autonomous vehicle simulations. In 2022 IEEE 96th Vehicular Technology Conference (VTC2022-Fall), pages 1–5.

Lobato, W., Mendes, P., Rosário, D., Cerqueira, E., and Villas, L. A. (2023). Redundancy mitigation mechanism for collective perception in connected and autonomous vehicles. Future Internet, 15(2):41.

Luo, M., Chen, F., Hu, D., Zhang, Y., Liang, J., and Feng, J. (2021). No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data. In Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P. S., and Vaughan, J. W., editors, Advances in Neural Information Processing Systems, volume 34, pages 5972–5984. Curran Associates, Inc.

Nagalapatti, L. and Narayanam, R. (2021). Game of gradients: Mitigating irrelevant clients in federated learning. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 9046–9054.

Nguyen, A., Do, T., Tran, M., Nguyen, B. X., Duong, C., Phan, T., Tjiputra, E., and Tran, Q. D. (2022). Deep Federated Learning for Autonomous Driving. IEEE Intelligent Vehicles Symposium, Proceedings, 2022-June(Iv):1824–1830.

Nishio, T. and Yonetani, R. (2019). Client selection for federated learning with heterogeneous resources in mobile edge. In ICC 2019 2019 IEEE International Conference on Communications (ICC). IEEE.

Pilz, C., Ulbel, A., and Steinbauer-Wagner, G. (2021). The components of cooperative perception-a proposal for future works. In 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), pages 7–14. IEEE.

Schiegg, F. A., Llatser, I., Bischoff, D., and Volk, G. (2020). Collective perception: A safety perspective. Sensors, 21(1):159.

Shi, R.-H. and Li, Y.-F. (2022). Quantum private set intersection cardinality protocol with application to privacy-preserving condition query. IEEE Transactions on Circuits and Systems I: Regular Papers, 69(6):2399–2411.

Shladover, S. E. (2021). Opportunities and challenges in cooperative road vehicle automation. IEEE Open Journal of Intelligent Transportation Systems, 2:216–224.

Wahab, O. A., Mourad, A., Otrok, H., and Taleb, T. (2021). Federated machine learning: Survey, multi-level classification, desirable criteria and future directions in communication and networking systems. IEEE Communications Surveys & Tutorials, 23(2):1342–1397.