• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Managing Flow Transfers in Enterprise Datacenter Networks with Flow Chasing

Vol. 10, No. 4, April 29, 2016
10.3837/tiis.2016.04.003, Download Paper (Free):

Abstract

In this paper, we study how to optimize the data shuffle phase by leveraging the flow relationship in datacenter networks (DCNs). In most of the clustering computer frameworks, the completion of a transfer (a group of flows that can enable a computation stage to start or complete) is determined by the flow completing last, so that limiting the rate of other flows (not the last one) appropriately can save bandwidth without impacting the performance of any transfer. Furthermore, for the flows enter network late, more bandwidth can be assigned to them to accelerate the completion of the entire transfer. Based on these characteristics, we propose the flow chasing algorithm (FCA) to optimize the completion of the entire transfer. We implement FCA on a real testbed. By evaluation, we find that FCA can not only reduce the completion time of data transfer by 6.24% on average, but also accelerate the completion of data shuffle phase and entire job.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
C. Ren and S. Wang, "Managing Flow Transfers in Enterprise Datacenter Networks with Flow Chasing," KSII Transactions on Internet and Information Systems, vol. 10, no. 4, pp. 1519-1534, 2016. DOI: 10.3837/tiis.2016.04.003.

[ACM Style]
Cheng Ren and Sheng Wang. 2016. Managing Flow Transfers in Enterprise Datacenter Networks with Flow Chasing. KSII Transactions on Internet and Information Systems, 10, 4, (2016), 1519-1534. DOI: 10.3837/tiis.2016.04.003.