Optimal Time and Energy-Aware Client Selection Algorithms for Federated Learning on Heterogeneous Resources

• Alan L. Nunes UFF / University of Bordeaux / CNRS / Bordeaux INP / Inria / LaBRI
• Cristina Boeres UFF
• Lúcia M. A. Drummond UFF
• Laércio L. Pilla University of Bordeaux / CNRS / Bordeaux INP / Inria / LaBRI

Resumo

Federated Learning systems allow training machine learning models distributed across multiple clients, each one using private local data. Iteratively, the clients send their training contributions to a server, which performs a merge to produce an enhanced global model. Due to resource and data heterogeneity, client selection is crucial to optimize the system efficiency and improve the global model generalization. Selecting more clients is likely to increase the overall energy consumption, while a small number of clients may decline the performance of the trained model or require longer training time. We propose two time- and energy-aware client selection algorithms, MEC and ECMTC, which are proven regarding their optimality and evaluated against state-of-the-art algorithms on an extensive series of experiments in both simulation and HPC platform scenarios. The results indicate the benefits of jointly optimizing the time and energy consumption metrics using our proposals.

Palavras-chave: Training, Measurement, Energy consumption, Federated learning, High performance computing, Distributed databases, Computer architecture, Data models, Servers, Proposals, client selection, optimal schedule, makespan optimization, energy consumption