• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

A New Distributed Log Anomaly Detection Method based on Message Middleware and ATT-GRU

Vol. 17, No. 2, February 28, 2023
10.3837/tiis.2023.02.011, Download Paper (Free):

Abstract

Logs play an important role in mastering the health of the system, experienced operation and maintenance engineer can judge which part of the system has a problem by checking the logs. In recent years, many system architectures have changed from single application to distributed application, which leads to a very huge number of logs in the system and manually check the logs to find system errors impractically. To solve the above problems, we propose a method based on Message Middleware and ATT-GRU (Attention Gate Recurrent Unit) to detect the logs anomaly of distributed systems. The works of this paper mainly include two aspects: (1) We design a high-performance distributed logs collection architecture to complete the logs collection of the distributed system. (2)We improve the existing GRU by introducing the attention mechanism to weight the key parts of the logs sequence, which can improve the training efficiency and recognition accuracy of the model to a certain extent. The results of experiments show that our method has better superiority and reliability.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
W. Fang, X. Jia, W. Zhang, V. S. Sheng, "A New Distributed Log Anomaly Detection Method based on Message Middleware and ATT-GRU," KSII Transactions on Internet and Information Systems, vol. 17, no. 2, pp. 486-503, 2023. DOI: 10.3837/tiis.2023.02.011.

[ACM Style]
Wei Fang, Xuelei Jia, Wen Zhang, and Victor S. Sheng. 2023. A New Distributed Log Anomaly Detection Method based on Message Middleware and ATT-GRU. KSII Transactions on Internet and Information Systems, 17, 2, (2023), 486-503. DOI: 10.3837/tiis.2023.02.011.

[BibTeX Style]
@article{tiis:38397, title="A New Distributed Log Anomaly Detection Method based on Message Middleware and ATT-GRU", author="Wei Fang and Xuelei Jia and Wen Zhang and Victor S. Sheng and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2023.02.011}, volume={17}, number={2}, year="2023", month={February}, pages={486-503}}