Anomaly Detection Using System Logs
Author:
Affiliation:
1. The Neotia University, India
2. International Management Institute, Kolkata, India
Abstract
Anomaly detection is a very important step in building a secure and trustworthy system. Manually it is daunting to analyze and detect failures and anomalies. In this paper, we proposed an approach that leverages the pattern matching capabilities of Convolution Neural Network (CNN) for anomaly detection in system logs. Features from log files are extracted using a windowing technique. Based on this feature, a one-dimensional image (1×n dimension) is generated where the pixel values of an image correlate with the features of the logs. On these images, the 1D Convolution operation is applied followed by max pooling. Followed by Convolution layers, a multi-layer feed-forward neural network is used as a classifier that learns to classify the logs as normal or abnormal from the representation created by the convolution layers. The model learns the variation in log pattern for normal and abnormal behavior. The proposed approach achieved improved accuracy compared to existing approaches for anomaly detection in Hadoop Distributed File System (HDFS) logs.
Publisher
IGI Global
Subject
Information Systems
Reference54 articles.
1. Performance debugging for distributed systems of black boxes
2. Artificial neural networks based techniques for anomaly detection in Apache Spark
3. Altalhi, S., & Gutub, A. (2021). A survey on predictions of cyber-attacks utilizing real-time twitter tracing recognition. Journal of Ambient Intelligence and Humanized Computing, 1-13.
4. Weighted LSTM for intrusion detection and data mining to prevent attacks. International Journal of Data Mining;M.Amar;Modelling and Management,2020
Cited by 7 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Log anomaly detection based on BERT;Signal, Image and Video Processing;2024-06-13
2. Blockchain-based deep learning in IoT, healthcare and cryptocurrency price prediction: a comprehensive review;International Journal of Quality & Reliability Management;2024-02-27
3. Landscape and Taxonomy of Online Parser-Supported Log Anomaly Detection Methods;IEEE Access;2024
4. KG-ADS: A Log Anomaly Detection Assisted Decision-Making with Support of Knowledge Graph and Reinforcement Learning;2023 9th International Conference on Computer and Communications (ICCC);2023-12-08
5. Image Identification and Land Use Management of Anomalous Minerals from Geophysical Information and Deep Convolutional Networks;The Journal of Geology;2023-07-01
1.学者识别学者识别
2.学术分析学术分析
3.人才评估人才评估
"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370
www.globalauthorid.com
TOP
Copyright © 2019-2024 北京同舟云网络信息技术有限公司 京公网安备11010802033243号 京ICP备18003416号-3