Research on Fault Detection for Microservices Based on Log Information and Social Network Mechanism Using BiLSTM-DCNN Model

Abstract

The microservice architecture breaks through the traditional cluster architecture mode based on virtual machines and uses containers as carriers to interact through lightweight communication mechanisms to reduce system coupling and provide more flexible system service support. With the expansion of the system scale, a large number of system logs with complex structures and chaotic relationships are generated. How to accurately analyze the system logs and make efficient fault prediction is particularly important for building a safe and reliable system. By studying neural network technology, this paper proposes an Attention-Based Bidirectional Long Short-Term Memory Network (Bi-LSTM). Combined with the dual channel convolutional neural network model (DCNN), it uses the attention mechanism to explore the differences between dimensional features, realizes multi-dimensional feature fusion, and establishes a BiLSTM-DCNN deep learning model that integrates the attention mechanism. From the perspective of social network analysis, a data preprocessing method is proposed to process fault redundant data and improve the accuracy of fault prediction under Microservices. Compare BiLSTM-DCNN with the mainstream system log analysis machine learning models SVM, CNN and Bi-LSTM, and explore the advantages of BiLSTM-DCNN in processing microservice system log text. The model is applied to simulation data and HDFS data set for experimental comparison, which proves the good generalization ability and universality of BiLSTM-DCNN.