• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Performance Evaluation and Analysis of Multiple Scenarios of Big Data Stream Computing on Storm Platform

Vol. 12, No.7, July 31, 2018
10.3837/tiis.2018.07.002 , Download Paper (Free):

Abstract

In big data era, fresh data grows rapidly every day. More than 30,000 gigabytes of data are created every second and the rate is accelerating. Many organizations rely heavily on real time streaming, while big data stream computing helps them spot opportunities and risks from real time big data. Storm, one of the most common online stream computing platforms, has been used for big data stream computing, with response time ranging from milliseconds to sub-seconds. The performance of Storm plays a crucial role in different application scenarios, however, few studies were conducted to evaluate the performance of Storm. In this paper, we investigate the performance of Storm under different application scenarios. Our experimental results show that throughput and latency of Storm are greatly affected by the number of instances of each vertex in task topology, and the number of available resources in data center. The fault-tolerant mechanism of Storm works well in most big data stream computing environments. As a result, it is suggested that a dynamic topology, an elastic scheduling framework, and a memory based fault-tolerant mechanism are necessary for providing high throughput and low latency services on Storm platform.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
Dawei Sun, Hongbin Yan, Shang Gao and Zhangbing Zhou, "Performance Evaluation and Analysis of Multiple Scenarios of Big Data Stream Computing on Storm Platform," KSII Transactions on Internet and Information Systems, vol. 12, no. 7, pp. 2977-2997, 2018. DOI: 10.3837/tiis.2018.07.002

[ACM Style]
Sun, D., Yan, H., Gao, S., and Zhou, Z. 2018. Performance Evaluation and Analysis of Multiple Scenarios of Big Data Stream Computing on Storm Platform. KSII Transactions on Internet and Information Systems, 12, 7, (2018), 2977-2997. DOI: 10.3837/tiis.2018.07.002