• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Sequential Pattern Mining for Intrusion Detection System with Feature Selection on Big Data


Abstract

Big data is an emerging technology which deals with wide range of data sets with sizes beyond the ability to work with software tools which is commonly used for processing of data. When we consider a huge network, we have to process a large amount of network information generated, which consists of both normal and abnormal activity logs in large volume of multi-dimensional data. Intrusion Detection System (IDS) is required to monitor the network and to detect the malicious nodes and activities in the network. Massive amount of data makes it difficult to detect threats and attacks. Sequential Pattern mining may be used to identify the patterns of malicious activities which have been an emerging popular trend due to the consideration of quantities, profits and time orders of item. Here we propose a sequential pattern mining algorithm with fuzzy logic feature selection and fuzzy weighted support for huge volumes of network logs to be implemented in Apache Hadoop YARN, which solves the problem of speed and time constraints. Fuzzy logic feature selection selects important features from the feature set. Fuzzy weighted supports provide weights to the inputs and avoid multiple scans. In our simulation we use the attack log from NS-2 MANET environment and compare the proposed algorithm with the state-of-the-art sequential Pattern Mining algorithm, SPADE and Support Vector Machine with Hadoop environment.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
Fidalcastro.A and Baburaj.E, "Sequential Pattern Mining for Intrusion Detection System with Feature Selection on Big Data," KSII Transactions on Internet and Information Systems, vol. 11, no. 10, pp. 5023-5038, 2017. DOI: 10.3837/tiis.2017.10.018.

[ACM Style]
Fidalcastro.A and Baburaj.E. 2017. Sequential Pattern Mining for Intrusion Detection System with Feature Selection on Big Data. KSII Transactions on Internet and Information Systems, 11, 10, (2017), 5023-5038. DOI: 10.3837/tiis.2017.10.018.

[BibTeX Style]
@article{tiis:21582, title="Sequential Pattern Mining for Intrusion Detection System with Feature Selection on Big Data", author=" Fidalcastro.A and Baburaj.E and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2017.10.018}, volume={11}, number={10}, year="2017", month={October}, pages={5023-5038}}