A Field Guide to Federated Optimization
Jianyu Wanga, Zachary Charlesb, Xu, Zhengb, Gauri Joshia, H. Brendan McMahanb, Blaise Agüera y Arcasb, Maruan Al-Shedivata, Galen Andrewb, Salman Avestimehrc, Katharine Dalyb, Deepesh Datad, Suhas N. Diggavid, Hubert Eichnerb, Advait Gadhikara, Zachary Garrettb, Antonious M. Girgisd, Filip Hanzelye, Andrew Hardb, Chaoyang Hec, Samuel Horváthf, Zhouyuan Huob, Alex Ingermanb, Martin Jaggig, Tara Javidih, Peter Kairouzb, Satyen Kaleb, Sai Praneeth Karimireddyg, Jakub Konečnýb, Sanmi Koyejoi, Tian Lia and 23 others
- aCarnegie Mellon University
- bGoogle Research
- cUniversity of Southern California
- dUniversity of California , Los Angeles
- eToyota Technological Institute at Chicago
- fKing Abdullah University of Science and Technology
- gÉcole Polytechnique Fédérale de Lausanne
- hUniversity of California , San Diego
- iUniversity of Illinois Urbana-Champaign , 12
Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.
Abstract
Federated learning and analytics are a distributed approach for collaboratively learning models (or statistics) from decentralized data, motivated by and designed for privacy protection. The distributed learning process can be formulated as solving federated optimization problems, which emphasize communication efficiency, data heterogeneity, compatibility with privacy and system requirements, and other constraints that are not primary considerations in other problem settings. This paper provides recommendations and guidelines on formulating, designing, evaluating and analyzing federated optimization algorithms through concrete examples and practical implementation, with a focus on conducting effective simulations to infer real-world performance. The goal of this work is not to survey the current literature, but to inspire researchers and practitioners to design federated learning algorithms that can be used in various practical applications.
TL;DRThis paper provides recommendations and guidelines on formulating, designing, evaluating and analyzing federated optimization algorithms through concrete examples and practical implementation, with a focus on conducting effective simulations to infer real-world performance. (Semantic Scholar)