Big Data in Real Time to Detect Anomalies

Abstract

The proliferation of linked devices and the Internet have made it easier for hackers to infiltrate networks, which can result in cyber attacks, financial loss, healthcare information theft, and cyber war. As a result, network security analytics has drawn a lot of interest from researchers lately, especially in the field of anomaly detection in networks, which is seen to be essential for network security. Current methods are ineffective mostly because of the large amounts of data that linked devices have amassed. It is essential to provide a framework that can manage real-time massive data processing and identify network irregularities. This study makes an effort to solve the problem of real-time anomaly detection. This work has examined both the key features of related machine learning algorithms and the most recent real-time big data processing technologies for anomaly detection. The recognized research problems of massive data processing in real-time for anomaly detection are described at this point.