Dynamic Semi-Synchronous Federated Learning for Connected Autonomous Vehicles

• Wellington Lobato UNICAMP
• Joahannes B. D. da Costa UNICAMP
• Allan M. de Souza UNICAMP
• Denis Rosário UFPA
• Christoph Sommer TU Dresden
• Leandro Villas UNICAMP

DOI: https://doi.org/10.5753/sbrc.2024.1352

Resumo

Due to the increased computational capacity of Connected and Autonomous Vehicles (CAVs) and concerns about transferring private information, storing data locally and moving network computing to the edge is becoming increasingly appealing. This makes Federated Learning (FL) appealing for CAV applications. However, the synchronous protocols used in FL have several limitations, such as low round efficiency. In this context, this work presents FALCON, a semi-synchronous protocol for FL based on the link duration. FALCON leverages data periodically transmitted by CAVs to compute link duration and establish a dynamic temporal synchronization point. Additionally, FALCON includes a client selection mechanism that considers the local model versions and models with higher local loss. FALCON reduces the communication rounds and the number of selected clients while maintaining the same level of accuracy for FL applications.

Referências

Almanifi, O. R. A., Chow, C.-O., Tham, M.-L., Chuah, J. H., and Kanesan, J. (2023). Communication and computation efficiency in federated learning: A survey. Internet of Things, 22:100742.

Chellapandi, V. P., Yuan, L., Brinton, C. G., Żak, S. H., and Wang, Z. (2024). Federated learning for connected and automated vehicles: A survey of existing approaches and challenges. IEEE Transactions on Intelligent Vehicles, 9(1):119–137.

Chen, Y., Sun, X., and Jin, Y. (2020). Communication-efficient federated deep learning with layerwise asynchronous model update and temporally weighted aggregation. IEEE Transactions on Neural Networks and Learning Systems, 31(10):4229–4238.

Codeca, L., Frank, R., Faye, S., and Engel, T. (2017). Luxembourg SUMO Traffic (LuST) Scenario: Traffic Demand Evaluation. IEEE Intelligent Transportation Systems Magazine, 9(2):52–63.

Damaj, I. W., Serhal, D. K., Hamandi, L. A., Zantout, R. N., and Mouftah, H. T. (2021). Connected and Autonomous Electric Vehicles: Quality of Experience survey and taxonomy. Vehicular Communications, 28:100312.

Hao, J., Zhao, Y., and Zhang, J. (2020). Time Efficient Federated Learning with Semi-asynchronous Communication. In IEEE 26th International Conference on Parallel and Distributed Systems (ICPADS), pages 156–163.

Jee Cho, Y., Gupta, S., Joshi, G., and Yağan, O. (2020). Bandit-based Communication-Efficient Client Selection Strategies for Federated Learning. In 2020 54th Asilomar Conference on Signals, Systems, and Computers. IEEE.

Li, Q., He, B., and Song, D. (2021). Model-contrastive federated learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 10713–10722.

Liang, F., Yang, Q., Liu, R., Wang, J., Sato, K., and Guo, J. (2022). Semi-Synchronous Federated Learning Protocol With Dynamic Aggregation in Internet of Vehicles. IEEE Transactions on Vehicular Technology, 71(5):4677–4691.

Liu, S. and Gaudiot, J.-L. (2022). Rise of the Autonomous Machines. Computer, 55(1):64–73.

Lobato, W., Costa, J. B. D. D., Souza, A. M. d., Rosário, D., Sommer, C., and Villas, L. A. (2022). FLEXE: Investigating Federated Learning in Connected Autonomous Vehicle Simulations. In IEEE 96th Vehicular Technology Conference (VTC-Fall). IEEE.

Lv, P., Xu, W., Nie, J., Yuan, Y., Cai, C., Chen, Z., and Xu, J. (2023). Edge Computing Task Offloading for Environmental Perception of Autonomous Vehicles in 6G Networks. IEEE Transactions on Network Science and Engineering, 10(3):1228–1245.

Ma, Q., Xu, Y., Xu, H., Jiang, Z., Huang, L., and Huang, H. (2021). FedSA: A Semi-Asynchronous Federated Learning Mechanism in Heterogeneous Edge Computing. IEEE Journal on Selected Areas in Communications, 39(12):3654–3672.

Niknam, S., Dhillon, H. S., and Reed, J. H. (2020). Federated learning for wireless communications: Motivation, opportunities, and challenges. IEEE Communications Magazine, 58(6):46–51.

Nishio, T. and Yonetani, R. (2019). Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge. In IEEE International Conference on Communications (ICC). IEEE.

Song, R., Zhou, L., Lakshminarasimhan, V., Festag, A., and Knoll, A. (2022). Federated Learning Framework Coping with Hierarchical Heterogeneity in Cooperative ITS. In IEEE 25th International Conference on Intelligent Transportation Systems (ITSC). IEEE.

Stripelis, D., Thompson, P. M., and Ambite, J. L. (2022). Semi-Synchronous Federated Learning for Energy-Efficient Training and Accelerated Convergence in Cross-Silo Settings. ACM Transactions on Intelligent Systems and Technology, 13(5):1–29.

Sun, J., Li, A., Duan, L., Alam, S., Deng, X., Guo, X., Wang, H., Gorlatova, M., Zhang, M., Li, H., and Chen, Y. (2022a). FedSEA: A Semi-Asynchronous Federated Learning Framework for Extremely Heterogeneous Devices. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems (SenSys). ACM.

Sun, X., Yu, F. R., and Zhang, P. (2022b). A Survey on Cyber-Security of Connected and Autonomous Vehicles (CAVs). IEEE Transactions on Intelligent Transportation Systems, 23(7):6240–6259.

Wang, S., Li, C., Ng, D. W. K., Eldar, Y. C., Poor, H. V., Hao, Q., and Xu, C. (2023). Federated deep learning meets autonomous vehicle perception: Design and verification. IEEE Network, 37(3):16–25.

Wu, W., He, L., Lin, W., Mao, R., Maple, C., and Jarvis, S. (2021). SAFA: A Semi-Asynchronous Protocol for Fast Federated Learning With Low Overhead. IEEE Transactions on Computers, 70(5):655–668.

You, C., Feng, D., Guo, K., Yang, H. H., Feng, C., and Quek, T. Q. S. (2023). Semi-Synchronous Personalized Federated Learning Over Mobile Edge Networks. IEEE Transactions on Wireless Communications, 22(4).

Zhang, X., Liu, J., Hu, T., Chang, Z., Zhang, Y., and Min, G. (2023). Federated learning-assisted vehicular edge computing: Architecture and research directions. IEEE Vehicular Technology Magazine, pages 2–11.