Federated Learning: A Potentially Effective Method for Improving the Efficiency and Privacy of Machine Learning
Keywords:
Federated learning, privacy, security, blocking, adversarial attack, decentralized learning federation, approved federal trainingAbstract
A new AI paradigm called federated learning (FL) decentralizes data and enhances privacy by delivering education straight to the user's device. However, additional privacy concerns arose during the exchange and training of server and client parameters. Integrating FL privacy solutions at the edge level can result in higher computational and communication costs, which can compromise learning performance metrics and data value. To promote the best trade-offs among FL privateness and different performance-associated application needs, including precision, privation, convergency, value, computational protection and connection, this study offers a thorough research overview of key techniques and metrics. Reaching stability among privateness and different standards of factual international Federated Learning utilization is the focus of this paper, which also explores quantitative methodologies for evaluating privacy in FL. To mitigate server-related risks, decentralized federated learning removes the server from the network and uses blockchain technology to compensate for its loss. However, this benefit comes at the expense of exposing the system to additional privacy risks. An extensive safety study is required in this new paradigm. This survey examines various security mechanisms and addresses potential adversaries and dangers in decentralized federated learning. The verifiability and trustworthiness of decentralized federated learning are also considered.
References
Abad, G., Picek, S., & Urbieta, A. (2021). SoK: On the security & privacy in federated learning. arXiv. https://arxiv.org/abs/2112.05423
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016). Deep learning with differential privacy. In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security (pp. 308–318). Association for Computing Machinery.
AbdulRahman, S., Tout, H., Ould-Slimane, H., Mourad, A., Talhi, C., & Guizani, M. (2021). A survey on federated learning: The journey from centralized to distributed on-site learning and beyond. IEEE Internet of Things Journal, 8(7), 5476–5497.
Alzubi, J. A., Alzubi, O. A., Singh, A., & Ramachandran, M. (2022). Cloud-IIoT-based electronic health record privacy-preserving by CNN and blockchain-enabled federated learning. IEEE Transactions on Industrial Informatics, 19(1), 1080–1087.
Ampatzoglou, A., Bibi, S., Avgeriou, P., & Chatzigeorgiou, A. (2020). Guidelines for managing threats to validity of secondary studies in software engineering. In Contemporary empirical methods in software engineering (pp. 415–441). Springer.
Asad, M., Moustafa, A., & Aslam, M. (2021). CEEP-FL: A comprehensive approach for communication efficiency and enhanced privacy in federated learning. Applied Soft Computing, 104, 107235.
Baek, C., Kim, S., Nam, D., & Park, J. (2021). Enhancing differential privacy for federated learning at scale. IEEE Access, 9, 148090–148103.
Bagdasaryan, E., Veit, A., Hua, Y., Estrin, D., & Shmatikov, V. (2020). How to backdoor federated learning. In Proceedings of the International Conference on Artificial Intelligence and Statistics (pp. 2938–2948). PMLR.
Bhagoji, A. N., Chakraborty, S., Mittal, P., & Calo, S. (2019). Analyzing federated learning through an adversarial lens. In Proceedings of the International Conference on Machine Learning (pp. 634–643). PMLR.
Bharati, S., Mondal, M., Podder, P., & Prasath, V. (2022). Federated learning: Applications, challenges, and future scopes. International Journal of Hybrid Intelligent Systems.
Blanco-Justicia, A., Domingo-Ferrer, J., Martínez, S., Sánchez, D., Flanagan, A., & Tan, K. E. (2021). Achieving security and privacy in federated learning systems: Survey, research challenges, and future directions. Engineering Applications of Artificial Intelligence, 106, 104468.
Boutet, A., Lebrun, T., Aalmoes, J., & Baud, A. (2021). Mixnn: Protection of federated learning against inference attacks by mixing neural network layers. arXiv. https://arxiv.org/abs/2109.12550
Chatterjee, P., Das, D., & Rawat, D. B. (2023). Next-generation financial services: Role of blockchain-enabled federated learning and metaverse. In 2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing Workshops (CCGridW) (pp. 69–74). IEEE.
Jia, B., Zhang, X., Liu, J., Zhang, Y., Huang, K., & Liang, Y. (2021). Blockchain-enabled federated learning data protection aggregation scheme with differential privacy and homomorphic encryption in IIoT. IEEE Transactions on Industrial Informatics, 18(6), 4049–4058.
Keele, S. (2007). Guidelines for performing systematic literature reviews in software engineering (Version 2.3). EBSE.
Lakhan, A., Mohammed, M. A., Nedoma, J., Martinek, R., Tiwari, P., Vidyarthi, A., Alkhayyat, A., & Wang, W. (2022). Federated-learning-based privacy preservation and fraud-enabled blockchain IoMT system for healthcare. IEEE Journal of Biomedical and Health Informatics, 27(2), 664–672.
Lee, H., Kim, J., Hussain, R., Cho, S., & Son, J. (2021). On defensive neural networks against inference attack in federated learning. In ICC 2021—IEEE International Conference on Communications (pp. 1–6). IEEE.
Voigt, P., & Von dem Bussche, A. (2017). The EU General Data Protection Regulation (GDPR): A practical guide (1st ed.). Springer International Publishing.
Wahab, O. A., Mourad, A., Otrok, H., & Taleb, T. (2021). Federated machine learning: Survey, multi-level classification, desirable criteria, and future directions in communication and networking systems. IEEE Communications Surveys & Tutorials, 23(2), 1342–1397.
Wainakh, A., Ventola, F., Müßig, T., Keim, J., Cordero, C. G., Zimmer, E., Grube, T., Kersting, K., & Mühlhäuser, M. (2021). User-level label leakage from gradients in federated learning. arXiv. https://arxiv.org/abs/2105.09369
Wang, C., Wu, X., Liu, G., Deng, T., Peng, K., & Wan, S. (2021). Safeguarding cross-silo federated learning with local differential privacy. Digital Communications and Networks.
Wang, F., Zhu, H., Lu, R., Zheng, Y., & Li, H. (2021). A privacy-preserving and non-interactive federated learning scheme for regression training with gradient descent. Information Sciences, 552, 183–200.
Wang, H., Yurochkin, M., Sun, Y., Papailiopoulos, D., & Khazaeni, Y. (2020). Federated learning with matched averaging. arXiv. https://arxiv.org/abs/2002.06440
Wang, N., Yang, W., Wang, X., Wu, L., Guan, Z., Du, X., & Guizani, M. (2022). A blockchain-based privacy-preserving federated learning scheme for Internet of Vehicles. Digital Communications and Networks.
Wang, Q., Liao, W., Guo, Y., McGuire, M., & Yu, W. (2023). Blockchain-empowered federated learning through model and feature calibration. IEEE Internet of Things Journal.
Wei, K., Li, J., Ding, M., Ma, C., Su, H., Zhang, B., & Poor, H. V. (2021). User-level privacy-preserving federated learning: Analysis and performance optimization. IEEE Transactions on Mobile Computing.
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q., & Poor, H. V. (2020). Federated learning with differential privacy: Algorithms and performance analysis. IEEE Transactions on Information Forensics and Security, 15, 3454–3469.
Wei, K., Li, J., Ma, C., Ding, M., Chen, C., Jin, S., Han, Z., & Poor, H. V. (2021). Low-latency federated learning over wireless channels with differential privacy. IEEE Journal on Selected Areas in Communications, 40(1), 290–307.
Zhang, M., Wei, E., & Berry, R. (2021). Faithful edge federated learning: Scalability and privacy. IEEE Journal on Selected Areas in Communications, 39(12), 3790–3804.
Zhao, B., Fan, K., Yang, K., Wang, Z., Li, H., & Yang, Y. (2021). Anonymous and privacy-preserving federated learning with industrial big data. IEEE Transactions on Industrial Informatics, 17(9), 6314–6323.
Zhou, C., Fu, A., Yu, S., Yang, W., Wang, H., & Zhang, Y. (2020). Privacy-preserving federated learning in fog computing. IEEE Internet of Things Journal, 7(11), 10782–10793.
Zhu, H., Wang, R., Jin, Y., Liang, K., & Ning, J. (2021). Distributed additive encryption and quantization for privacy-preserving federated deep learning. Neurocomputing, 463, 309–327.
Zhu, L., Liu, Z., & Han, S. (2019). Deep leakage from gradients. In Advances in Neural Information Processing Systems (Vol. 32).
Zhu, S., & Han, M. (2023). Privacy-preserving federated learning and authentication for energy trading system in Energy Internet of Things. Future Generation Computer Systems, 135, 339–353.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Nishant Jakhar, Sajjan Singh
This work is licensed under a Creative Commons Attribution 4.0 International License.
