Applications of Federated Learning; Taxonomy, Challenges, and Research Trends

Momina Shaheen; Muhammad Shoaib Farooq; Tariq Umer; Byung-Seo Kim

doi:10.3390/electronics11040670

journal article Open Access Feb 21, 2022

Applications of Federated Learning; Taxonomy, Challenges, and Research Trends

Momina Shaheen

Muhammad Shoaib Farooq

Tariq Umer

Byung-Seo Kim

Electronics Vol. 11 No. 4 pp. 670 · MDPI AG

View at Publisher Save 10.3390/electronics11040670

Abstract

The federated learning technique (FL) supports the collaborative training of machine learning and deep learning models for edge network optimization. Although a complex edge network with heterogeneous devices having different constraints can affect its performance, this leads to a problem in this area. Therefore, some research can be seen to design new frameworks and approaches to improve federated learning processes. The purpose of this study is to provide an overview of the FL technique and its applicability in different domains. The key focus of the paper is to produce a systematic literature review of recent research studies that clearly describes the adoption of FL in edge networks. The search procedure was performed from April 2020 to May 2021 with a total initial number of papers being 7546 published in the duration of 2016 to 2020. The systematic literature synthesizes and compares the algorithms, models, and frameworks of federated learning. Additionally, we have presented the scope of FL applications in different industries and domains. It has been revealed after careful investigation of studies that 25% of the studies used FL in IoT and edge-based applications and 30% of studies implement the FL concept in the health industry, 10% for NLP, 10% for autonomous vehicles, 10% for mobile services, 10% for recommender systems, and 5% for FinTech. A taxonomy is also proposed on implementing FL for edge networks in different domains. Moreover, another novelty of this paper is that datasets used for the implementation of FL are discussed in detail to provide the researchers an overview of the distributed datasets, which can be used for employing FL techniques. Lastly, this study discusses the current challenges of implementing the FL technique. We have found that the areas of medical AI, IoT, edge systems, and the autonomous industry can adapt the FL in many of its sub-domains; however, the challenges these domains can encounter are statistical heterogeneity, system heterogeneity, data imbalance, resource allocation, and privacy.

Topics

No keywords indexed for this article. Browse by subject →

References

198

[1]

Reinsel "Data Age 2025: The Digitization of the World From Edge to Core" Int. Data Corp. (2018)

[2]

Khan "Dispersed Federated Learning: Vision, Taxonomy, and Future Directions" IEEE Wireless Commun. (2021) 10.1109/mwc.011.2100003

[3]

McMahan, B., Moore, E., Ramage, D., Hampson, S., and Arcas, B.A. (2017, January 20–22). Communication-Efficient Learning of Deep Networks from Decentralized Data. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA.

[4]

Ji, S., Saravirta, T., Pan, S., Long, G., and Walid, A. (2021). Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning. arXiv.

[5]

Kairouz, P., McMahan, H.B., Avent, B., Bellet, A., Bennis, M., Bhagoji, A.N., Bonawitz, K., Charles, Z., Cormode, G., and Cummings, R. (2021). Advances and Open Problems in Federated Learning. arXiv. 10.1561/9781680837896

[6]

Kang "Reliable Federated Learning for Mobile Networks" IEEE Wirel. Commun. (2020) 10.1109/mwc.001.1900119

[7]

Xu "Federated Learning for Healthcare Informatics" J. Healthc. Inform. Res. (2020) 10.1007/s41666-020-00082-4

[8]

Zhao, Y., Zhao, J., Jiang, L., Tan, R., and Niyato, D. (2020). Mobile Edge Computing, Blockchain and Reputation-based Crowdsourcing IoT Federated Learning: A Secure, Decentralized and Privacy-preserving System. arXiv.

[9]

Samarakoon, S., Bennis, M., Saad, W., and Debbah, M. (2018, January 9–13). Federated Learning for Ultra-Reliable Low-Latency V2V Communications. Proceedings of the 2018 IEEE Global Communications Conference (GLOBECOM), Abu Dhabi, United Arab Emirates. 10.1109/glocom.2018.8647927

[10]

Liu, Y., Ma, Z., Liu, X., Ma, S., Nepal, S., and Deng, R. (2019). Boosting Privately: Privacy-Preserving Federated Extreme Boosting for Mobile Crowdsensing. arXiv. 10.1109/icdcs47774.2020.00017

[11]

Yang "Federated Machine Learning : Concept and Applications" ACM Trans. Intell. Syst. Technol. (2019) 10.1145/3339474

[12]

Federated Learning in Mobile Edge Networks: A Comprehensive Survey

Wei Yang Bryan Lim, Nguyen Cong Luong, Dinh Thai Hoang et al.

IEEE Communications Surveys & Tutorials 2020 10.1109/comst.2020.2986024

[13]

Niknam "Federated Learning for Wireless Communications: Motivation, Opportunities and Challenges" IEEE Commun. Mag. (2019) 10.1109/mcom.001.1900461

[14]

A survey on federated learning

Chen Zhang, Yu Xie, Hang Bai et al.

Knowledge-Based Systems 2021 10.1016/j.knosys.2021.106775

[15]

Mothukuri "A survey on security and privacy of federated learning" Futur. Gener. Comput. Syst. (2020) 10.1016/j.future.2020.10.007

[16]

Hou, D., Zhang, J., Man, K.L., Ma, J., and Peng, Z. (2021, January 7–9). A Systematic Literature Review of Blockchain-based Federated Learning: Architectures, Applications and Issues. Proceedings of the 2021 2nd Information Communication Technologies Conference (ICTC), Nanjing, China. 10.1109/ictc51749.2021.9441499

[17]

Li "Federated Learning: Challenges, Methods, and Future Directions" IEEE Signal Proces. Mag. (2020)

[18]

Bouzinis "Wireless Federated Learning (WFL) for 6G Networks—Part I: Research Challenges and Future Trends" IEEE Commun. Lett. (2021) 10.1109/lcomm.2021.3121071

[19]

Soto, J.C., Kyt, W., Jahn, M., Pullmann, J., Bonino, D., Pastrone, C., and Spirito, M. (December, January 30). Towards a Federation of Smart City Services. Proceedings of the International Conference on Recent Advances in Computer Systems (RACS 2015), Hail, Saudi Arabia.

[20]

Liu, Y., Zhang, L., Ge, N., and Li, G. (2020). A Systematic Literature Review on Federated Learning: From A Model Quality Perspective. arXiv.

[21]

Bonawitz "Towards Federated Learning at Scale: System Design" Proc. Mach. Learn. Syst. (2019)

[22]

Nishio, T., and Yonetani, R. (2019, January 20–24). Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge. Proceedings of the ICC 2019—IEEE International Conference on Communications (ICC), Shanghai, China. 10.1109/icc.2019.8761315

[23]

Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H.B., Patel, S., Ramage, D., Segal, A., and Seth, K. (November, January 30). Practical secure aggregation for privacy-preserving machine learning. Proceedings of the ACM Conference on Computer and Communications Security, Dallas, TX, USA.

[24]

Rusu "How to develop usability heuristics: A systematic literature review" Comput. Stand. Interfaces (2017) 10.1016/j.csi.2017.03.009

[25]

Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., and Chandra, V. (2018). Federated Learning with Non-IID Data. arXiv.

[26]

Duan, M., Liu, D., Chen, X., Tan, Y., Ren, J., Qiao, L., and Liang, L. (2019, January 17–20). Astraea: Self-Balancing Federated Learning for Improving Classification Accuracy of Mobile Deep Learning Applications. Proceedings of the 2019 IEEE 37th International Conference on Computer Design (ICCD), Abu Dahbi, United Arab Emirates. 10.1109/iccd46524.2019.00038

[27]

Li, X., Huang, K., Yang, W., Wang, S., and Zhang, Z. (2019). On the Convergence of FedAvg on Non-IID Data. arXiv.

[28]

Ramaswamy, S., Mathews, R., Rao, K., and Beaufays, F. (2019). Federated Learning for Emoji Prediction in a Mobile Keyboard. arXiv.

[29]

Brisimi "Federated learning of predictive models from federated Electronic Health Records" Int. J. Med. Inform. (2018) 10.1016/j.ijmedinf.2018.01.007

[30]

Huang, L., Yin, Y., Fu, Z., Zhang, S., Deng, H., and Liu, D. (2018). LoAdaBoost: Loss-Based AdaBoost Federated Machine Learning on medical Data. PLoS ONE, 15.

[31]

(2020, June 13). Federated Learning—OWKIN. Available online: https://owkin.com/federated-learning/.

[32]

(2020, June 13). Intel Works with University of Pennsylvania in Using Privacy-Preserving AI to Identify Brain Tumors|Intel Newsroom. Available online: https://newsroom.intel.com/news/intel-works-university-pennsylvania-using-privacy-preserving-ai-identify-brain-tumors/#gs.7wuma4.

[33]

Xiao "A federated learning system with enhanced feature extraction for human activity recognition" Knowl.-Based Syst. (2021) 10.1016/j.knosys.2021.107338

[34]

Qi "Privacy-preserving blockchain-based federated learning for traffic flow prediction" Futur. Gener. Comput. Syst. (2021) 10.1016/j.future.2020.12.003

[35]

Demertzis, K. (2021). Blockchained Federated Learning for Threat Defense. arXiv.

[36]

Zhang "Federated learning for machinery fault diagnosis with dynamic validation and self-supervision" Knowl. Based Syst. (2021) 10.1016/j.knosys.2020.106679

[37]

Zhang "FASTGNN: A Topological Information Protected Federated Learning Approach for Traffic Speed Forecasting" IEEE Trans. Ind. Inform. (2021) 10.1109/tii.2021.3055283

[38]

Zellinger "Beyond federated learning: On confidentiality-critical machine learning applications in industry" Procedia Comput. Sci. (2019) 10.1016/j.procs.2021.01.296

[39]

Huang, Z., Liu, F., and Zou, Y. (2020, January 8–13). Federated Learning for Spoken Language Understanding. Proceedings of the 28th International Conference on Computational Linguistics, Barcelona, Spain. 10.18653/v1/2020.coling-main.310

[40]

Yang, Z., Chen, M., Wong, K.K., Poor, H.V., and Cui, S. (Engineering, 2021). Federated Learning for 6G: Applications, Challenges, and Opportunities, Engineering, in press. 10.1016/j.eng.2021.12.002

[41]

Mun, H., and Lee, Y. (2020). Internet Traffic Classification with Federated Learning. Electronics, 10. 10.3390/electronics10010027

[42]

Mahmood, Z., and Jusas, V. (2021). Implementation Framework for a Blockchain-Based Federated Learning Model for Classification Problems. Symmetry, 13. 10.3390/sym13071116

[43]

Moubayed "Water Leak Detection Survey: Challenges & Research Opportunities Using Data Fusion & Federated Learning" IEEE Access (2021) 10.1109/access.2021.3064445

[44]

Tzinis, E., Casebeer, J., Wang, Z., and Smaragdis, P. (2021, January 17–20). Separate But Together: Unsupervised Federated Learning for Speech Enhancement from Non-IID Data. Proceedings of the 2021 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY, USA. 10.1109/waspaa52581.2021.9632783

[45]

Wang "ATOMO: Communication-efficient learning via atomic sparsification" Adv. Neural Inf. Process. Syst. (2018)

[46]

Stich "Sparsified SGD with Memory" Adv. Neural Info. Process. Syst. (2018)

[47]

Nikolenko, S.I. (2021). Synthetic Data for Deep Learning, Springer. 10.1007/978-3-030-75178-4

[48]

Dwork "Calibrating Noise to Sensitivity in Private Data Analysis" J. Priv. Confid. (2017)

[49]

Wang, L., Wang, W., and Li, B. (2019, January 7–10). CMFL: Mitigating Communication Overhead for Federated Learning. Proceedings of the 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), Dallas, TX, USA. 10.1109/icdcs.2019.00099

[50]

Konečný, J., McMahan, H.B., Yu, F.X., Richtárik, P., Suresh, A.T., and Bacon, D. (2016). Federated learning: Strategies for improving communication efficiency. arXiv.

Showing 50 of 198 references

Cited By

127

Towards trustworthy AI-driven leukemia diagnosis: A hybrid Hierarchical Federated Learning and explainable AI framework

Khadija Pervez, Syed Irfan Sohail · 2025

Informatics in Medicine Unlocked

FFM: Flood Forecasting Model Using Federated Learning

Muhammad Shoaib Farooq, Rabia Tehseen · 2023

IEEE Access

Security of federated learning with IoT systems: Issues, limitations, challenges, and solutions

Jean-Paul A. Yaacoub, Hassan N. Noura · 2023

Internet of Things and Cyber-Physic...

Federated Learning Enabled SDN for Routing Emergency Safety Messages (ESMs) in IoV Under 5G Environment

Diana Hayder Hussein, Shavan Askar · 2023

IEEE Access

Federated learning-based AI approaches in smart healthcare: concepts, taxonomies, challenges and open issues

Anichur Rahman, Md. Sazzad Hossain · 2022

Cluster Computing

Metrics

127

Citations

198

References

Details

Published: Feb 21, 2022
Vol/Issue: 11(4)
Pages: 670
License: View

Authors

M

Momina Shaheen

Department of Computer Science, SST, University of Management and Technology, Lahore 54000, Pakistan; Department of Computer Science, COMSATS University Islamabad Lahore Campus, Lahore 54000, Pakistan

M

Muhammad Shoaib Farooq

Department of Computer Science, SST, University of Management and Technology, Lahore 54000, Pakistan

T

Tariq Umer

Department of Computer Science, COMSATS University Islamabad Lahore Campus, Lahore 54000, Pakistan

B

Byung-Seo Kim

Department of Software and Communication Engineering, Hongik University, Sejong 30016, Korea

Funding

National Research Foundation of Korea Award: BK21 FOUR (F21YY8102068)

Cite This Article

Momina Shaheen, Muhammad Shoaib Farooq, Tariq Umer, et al. (2022). Applications of Federated Learning; Taxonomy, Challenges, and Research Trends. Electronics, 11(4), 670. https://doi.org/10.3390/electronics11040670

Applications of Federated Learning; Taxonomy, Challenges, and Research Trends

You May Also Like