Evaluating Differential Privacy Mechanisms in Machine Learning with Emphasis on Utility and Robustness
Downloads
Federated learning enables collaborative model training across distributed clients without sharing raw data, yet it remains susceptible to inference threats such as membership inference attacks. This study aims to enhance the privacy of federated learning by integrating differential privacy and systematically evaluating its effects on model utility and adversarial robustness. A synthetic multimodal dataset was developed by combining demographic attributes from the UCI Adult dataset, mobility indicators from Google COVID-19 Mobility Reports, and semantic descriptors from LAION-400M, creating a high-dimensional and bias-reduced benchmark for privacy-preserving experimentation. Differentially private stochastic gradient descent (DP-SGD) was applied under multiple privacy budgets and ablation settings to isolate the individual contributions of gradient clipping and noise injection. Experimental results reveal that model accuracy increases with larger privacy budgets, while membership inference attack accuracy remains close to random guessing, confirming strong defense capability. Gradient clipping proved essential for training stability, whereas excessive noise caused measurable degradation in learning utility. The proposed framework establishes reproducible benchmarks for tuning differential privacy parameters in federated environments and demonstrates that robust privacy guarantees can be achieved without substantial loss of performance, providing practical guidance for deploying trustworthy, privacy-preserving machine learning systems across domains such as healthcare, finance, and mobility.
Downloads
[1] Pustozerova, A., Baumbach, J., & Mayer, R. (2023). Differentially Private Federated Learning: Privacy and Utility Analysis of Output Perturbation and DP-SGD. Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023, 5549–5558. doi:10.1109/BigData59044.2023.10386466.
[2] Pustozerova, A., Baumbach, J., & Mayer, R. (2023). Analysing Utility Loss in Federated Learning with Differential Privacy. Proceedings - 2023 IEEE 22nd International Conference on Trust, Security and Privacy in Computing and Communications, TrustCom/BigDataSE/CSE/EUC/ISCI 2023, 1230–1235. doi:10.1109/TrustCom60117.2023.00167.
[3] Liu, W., Han, R., Guo, X., Ouyang, J., Zuo, X., & Liu, C. H. (2024). NeuronDP: Neuron-grained Differential Privacy of Deep Neural Networks in Edge-based Federated Learning. 2024 IEEE 4th International Conference on Electronic Technology, Communication and Information, ICETCI 2024, 166–171. doi:10.1109/ICETCI61221.2024.10594030.
[4] Chen, Z., Liao, G., Ma, Q., & Chen, X. (2024). Adaptive Privacy Budget Allocation in Federated Learning: A Multi-Agent Reinforcement Learning Approach. IEEE International Conference on Communications, 5166–5171. doi:10.1109/ICC51166.2024.10622685.
[5] Pan, J., Liang, X., & Du, R. (2025). AIDPFL: An Adaptive Improvement Approach for Differential Privacy Federated Learning. Proceedings of the International Conference on Computer Supported Cooperative Work in Design, CSCWD2025, 1350–1355. doi:10.1109/CSCWD64889.2025.11033624.
[6] Cai, H., Zhang, M., Wang, S., Zhao, A., & Zhang, Y. (2024). PLFa-FL: Personalized Local Differential Privacy for Fair Federated Learning. Proceedings of the 2024 27th International Conference on Computer Supported Cooperative Work in Design, CSCWD2024, 2325–2332. doi:10.1109/CSCWD61410.2024.10580666.
[7] Liu, Y., Wang, Z., Zhu, Y., & Chen, C. (2024). DPBalance: Efficient and Fair Privacy Budget Scheduling for Federated Learning as a Service. Proceedings - IEEE INFOCOM, 21–30. doi:10.1109/INFOCOM52122.2024.10621227.
[8] Zhao, J., Chen, Y., & Zhang, W. (2019). Differential Privacy Preservation in Deep Learning: Challenges, Opportunities and Solutions. IEEE Access, 7, 48901–48911. doi:10.1109/ACCESS.2019.2909559.
[9] Miao, L., Yang, W., Hu, R., Li, L., & Huang, L. (2022). Defending Against Backdoor Attacks in Federated Learning with Differential Privacy. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2022-May, 2999–3003. doi:10.1109/ICASSP43922.2022.9747653.
[10] Hu, J., Du, J., Wang, Z., Pang, X., Zhou, Y., Sun, P., & Ren, K. (2024). Does Differential Privacy Really Protect Federated Learning from Gradient Leakage Attacks? IEEE Transactions on Mobile Computing, 23(12), 12635–12649. doi:10.1109/TMC.2024.3417930.
[11] Zhou, H., & Kong, J. (2024). Distributed Differential Privacy for Federated Learning: A Privacy-Enhancing Approach. 2024 4th International Conference on Artificial Intelligence, Robotics, and Communication, ICAIRC2024, 969–972. doi:10.1109/ICAIRC64177.2024.10900017.
[12] Xin, B., Yang, W., Geng, Y., Chen, S., Wang, S., & Huang, L. (2020). Private FL-GAN: Differential privacy synthetic data generation based on federated learning. ICASSP2020, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2020-May, 2927–2931. doi:10.1109/ICASSP40776.2020.9054559.
[13] Adiwijaya, J., Tanaya, V. R., Anderies, & Chowanda, A. (2023). Federated Learning and Differential Privacy in AI-Based Surveillance Systems Model. 14th International Conference on Information and Communication Technology and System, ICTS 2023, 283–288. doi:10.1109/ICTS58770.2023.10330863.
[14] Amjath, M., & Henna, S. (2024). Rényi Differential Privacy Analysis of Skellam under Federated Learning in Internet of Health Things. Proceedings of the 2024 IEEE International Conference on Cyber Security and Resilience, CSR 2024, 427–431. doi:10.1109/CSR61664.2024.10679499.
[15] Wu, M. (2024). Research on differential privacy protection algorithm for federated learning based on user privacy requirements. Proceedings of 2024 IEEE 6th International Conference on Civil Aviation Safety and Information Technology, ICCASIT 2024, 149–155. doi:10.1109/ICCASIT62299.2024.10827947.
[16] Yue, G., Yan, L., Kang, L., & Shen, C. (2025). AdapLDP-FL: An Adaptive Local Differential Privacy for Federated Learning. IEEE Transactions on Mobile Computing, 24(6), 5569–5583. doi:10.1109/TMC.2025.3533090.
[17] Wang, X., Fan, W., Hu, X., He, J., & Chi, C. H. (2024). Differential Privacy-Preserving of Multi-Party Collaboration under Federated Learning in Data Center Networks. IEEE Transactions on Emerging Topics in Computational Intelligence, 8(2), 1223–1237. doi:10.1109/TETCI.2023.3341299.
[18] Zhang, X., Ma, X., Yang, X., Zhang, X., Xiao, Y., & Bai, X. (2025). An Efficient Federated Learning with Correlation-Based Pruning: Improving Accuracy under Layer-Wise Differential Privacy. Proceedings of the International Conference on Computer Supported Cooperative Work in Design, CSCWD 2025, 990–995. doi:10.1109/CSCWD64889.2025.11033391.
[19] Ueda, R., Nakai, T., Yoshida, K., & Fujino, T. (2023). Evaluation of Membership Inference Attack Against Federated Learning with Differential Privacy on Edge Devices. GCCE 2023 - 2023 IEEE 12th Global Conference on Consumer Electronics, 1161–1165. doi:10.1109/GCCE59613.2023.10315549.
[20] Kim, E. J., & Lee, E. K. (2022). Performance Impact of Differential Privacy on Federated Learning in Vehicular Networks. Proceedings of the IEEE/IFIP Network Operations and Management Symposium 2022: Network and Service Management in the Era of Cloudification, Softwarization and Artificial Intelligence, NOMS 2022, 9789814. doi:10.1109/NOMS54207.2022.9789814.
[21] Sun, P., Li, Z., Zhu, H., Peng, T., & Zhang, Q. (2024). Research on network intrusion detection based on differential privacy federated learning. 2024 IEEE International Conference on Software System and Information Processing, ICSSIP 2024, 143–147. doi:10.1109/ICSSIP63203.2024.11012464.
[22] Lal, A. K., & Karthikeyan, S. (2022). Deep Learning Classification of Fetal Cardiotocography Data with Differential Privacy. Proceedings of the 2022 International Conference on Connected Systems and Intelligence, CSI 2022. doi:10.1109/CSI54720.2022.9924087.
[23] Augello, A., Falzone, G., & Re, G. Lo. (2023). DCFL: Dynamic Clustered Federated Learning under Differential Privacy Settings. 2023 IEEE International Conference on Pervasive Computing and Communications Workshops and Other Affiliated Events, PerCom Workshops 2023, 614–619. doi:10.1109/PerComWorkshops56833.2023.10150285.
- This work (including HTML and PDF Files) is licensed under a Creative Commons Attribution 4.0 International License.



















