Federated Residual Learning

Citations Over Time

Abstract

We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared model can be minimized while still gaining all the performance benefits that joint training provides. Our framework is robust to data heterogeneity, addressing the slow convergence problem traditional federated learning methods face when the data is non-i.i.d. across clients. We test the theory empirically and find substantial performance gains over baselines.

Related Papers

• → Advances and Open Problems in Federated Learning(2020)4,363 cited
• → Communication-Efficient Learning of Deep Networks from Decentralized Data(2016)5,172 cited
• → Improving Federated Learning Personalization via Model Agnostic Meta Learning(2019)368 cited
• → Adaptive Personalized Federated Learning(2020)337 cited
• → Federated Learning of a Mixture of Global and Local Models(2020)242 cited