Javascript must be enabled to continue!
Federated Learning Framework for Privacy-Preserving Threat Detection in Distributed IT Systems
View through CrossRef
Introduction: This study investigates the practicality and efficiency of federated learning as a privacy-preserving threat detection approach in distributed IT systems. The research is motivated by the limitations of centralized intrusion detection systems and increasing regulatory constraints on data sharing. The primary aim is to evaluate whether federated learning can achieve competitive detection performance while maintaining strict data privacy.
Methods: An end-to-end federated learning framework was implemented and evaluated using the UNSW-NB15 dataset, consisting of 257,673 network flow records with 36 traffic-related features. A deep neural network model was collaboratively trained across multiple non-IID clients using the Federated Averaging algorithm, ensuring that raw network traffic data remained local to each client. The federated model was compared with centralized deep learning, local-only training, and a centralized Random Forest classifier. In addition to predictive performance, system-level metrics such as communication efficiency, convergence behaviour, and deployment feasibility were analysed.
Results: Experimental results show that the federated model achieved competitive detection performance, closely approaching centralized deep learning while outperforming local-only training. The centralized Random Forest classifier achieved the highest predictive accuracy but required full data aggregation and therefore lacked privacy guarantees. The federated model demonstrated stable convergence within 20 communication rounds, with most performance gains achieved by round 15. Communication overhead remained modest at approximately 10.85 MB, and computational costs were manageable. Although federated training required more time than centralized deep learning, it preserved privacy by ensuring that raw network traffic remained within client environments.
Conclusion: The findings demonstrate that federated learning provides a practical and privacy-aware alternative to centralized intrusion detection systems. It effectively balances detection performance, communication efficiency, and reduced data exposure, making it suitable for deployment in distributed environments with realistic non-IID data conditions.
Content Majestic LLC
Title: Federated Learning Framework for Privacy-Preserving Threat Detection in Distributed IT Systems
Description:
Introduction: This study investigates the practicality and efficiency of federated learning as a privacy-preserving threat detection approach in distributed IT systems.
The research is motivated by the limitations of centralized intrusion detection systems and increasing regulatory constraints on data sharing.
The primary aim is to evaluate whether federated learning can achieve competitive detection performance while maintaining strict data privacy.
Methods: An end-to-end federated learning framework was implemented and evaluated using the UNSW-NB15 dataset, consisting of 257,673 network flow records with 36 traffic-related features.
A deep neural network model was collaboratively trained across multiple non-IID clients using the Federated Averaging algorithm, ensuring that raw network traffic data remained local to each client.
The federated model was compared with centralized deep learning, local-only training, and a centralized Random Forest classifier.
In addition to predictive performance, system-level metrics such as communication efficiency, convergence behaviour, and deployment feasibility were analysed.
Results: Experimental results show that the federated model achieved competitive detection performance, closely approaching centralized deep learning while outperforming local-only training.
The centralized Random Forest classifier achieved the highest predictive accuracy but required full data aggregation and therefore lacked privacy guarantees.
The federated model demonstrated stable convergence within 20 communication rounds, with most performance gains achieved by round 15.
Communication overhead remained modest at approximately 10.
85 MB, and computational costs were manageable.
Although federated training required more time than centralized deep learning, it preserved privacy by ensuring that raw network traffic remained within client environments.
Conclusion: The findings demonstrate that federated learning provides a practical and privacy-aware alternative to centralized intrusion detection systems.
It effectively balances detection performance, communication efficiency, and reduced data exposure, making it suitable for deployment in distributed environments with realistic non-IID data conditions.
Related Results
Multi-Institution AI Security in Federated Drug Design Systems.
Multi-Institution AI Security in Federated Drug Design Systems.
Abstract
Background: Drug discovery and development face critical data silos and collaboration barriers across pharmaceutical institutions, research centers, and healthcare organi...
FedXGB-OptDP: A Privacy-Optimised Federated XGBoost Framework with Differential Privacy for IID and Non-IID healthcare data
FedXGB-OptDP: A Privacy-Optimised Federated XGBoost Framework with Differential Privacy for IID and Non-IID healthcare data
Abstract
The rapid growth of sensitive healthcare data results in a significant need for machine learning systems capable of providing accurate predictions while sa...
Federated Learning Approaches for Privacy-Preserving Educational Data Mining
Federated Learning Approaches for Privacy-Preserving Educational Data Mining
The recent explosion in educational data produced by digital learning systems, learning management systems, and intelligent tutoring systems have presented tremendous opportunities...
Federated Data Linkage in Practice
Federated Data Linkage in Practice
In recent years, great strides have been made towards the deployment of federated systems for data research, including exploring federated trusted research environments (TREs). The...
Enhancing Privacy-Preserving Intrusion Detection through Federated Learning
Enhancing Privacy-Preserving Intrusion Detection through Federated Learning
Detecting anomalies, intrusions, and security threats in the network (including Internet of Things) traffic necessitates the processing of large volumes of sensitive data, which ra...
Augmented Differential Privacy Framework for Data Analytics
Augmented Differential Privacy Framework for Data Analytics
Abstract
Differential privacy has emerged as a popular privacy framework for providing privacy preserving noisy query answers based on statistical properties of databases. ...
Privacy and Security for Digital Health: Assessing Risks and Harms to Users
Privacy and Security for Digital Health: Assessing Risks and Harms to Users
Electronic Health (e-Health), such as mobile health (mHealth) and Health Information Systems (HIS), benefits healthcare consumers and professionals. However, it also poses potentia...
Exploring privacy mechanisms and metrics in federated learning
Exploring privacy mechanisms and metrics in federated learning
Abstract
The federated learning (FL) principle ensures multiple clients jointly develop a machine learning model without exchanging their local data. Various government e...

