• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

A Machine Learning-based Real-time Monitoring System for Classification of Elephant Flows on KOREN


Abstract

With the advent and realization of Software Defined Network (SDN) architecture, many organizations are now shifting towards this paradigm. SDN brings more control, higher scalability, and serene elasticity. The SDN spontaneously changes the network configuration according to the dynamic network requirements inside the constrained environments. Therefore, a monitoring system that can monitor the physical and virtual entities is needed to operate this type of network technology with high efficiency and proficiency. In this manuscript, we propose a real-time monitoring system for data collection and visualization that includes the Prometheus, node exporter, and Grafana. A node exporter is configured on the physical devices to collect the physical and virtual entities resources utilization logs. A real-time Prometheus database is configured to collect and store the data from all the exporters. Furthermore, the Grafana is affixed with Prometheus to visualize the current network status and device provisioning. A monitoring system is deployed on the physical infrastructure of the KOREN topology. Data collected by the monitoring system is further pre-processed and restructured into a dataset. A monitoring system is further enhanced by including machine learning techniques applied on the formatted datasets to identify the elephant flows. Additionally, a Random Forest is trained on our generated labeled datasets, and the classification models’ performance are verified using accuracy metrics.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
W. Akbar, J. J. D. Rivera, K. T. Ahmed, A. Muhammad, W. Song, "A Machine Learning-based Real-time Monitoring System for Classification of Elephant Flows on KOREN," KSII Transactions on Internet and Information Systems, vol. 16, no. 8, pp. 2801-2815, 2022. DOI: 10.3837/tiis.2022.08.019.

[ACM Style]
Waleed Akbar, Javier J. D. Rivera, Khan T. Ahmed, Afaq Muhammad, and Wang-Cheol Song. 2022. A Machine Learning-based Real-time Monitoring System for Classification of Elephant Flows on KOREN. KSII Transactions on Internet and Information Systems, 16, 8, (2022), 2801-2815. DOI: 10.3837/tiis.2022.08.019.

[BibTeX Style]
@article{tiis:25921, title="A Machine Learning-based Real-time Monitoring System for Classification of Elephant Flows on KOREN", author="Waleed Akbar and Javier J. D. Rivera and Khan T. Ahmed and Afaq Muhammad and Wang-Cheol Song and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2022.08.019}, volume={16}, number={8}, year="2022", month={August}, pages={2801-2815}}