• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Energy Efficient and Low-Cost Server Architecture for Hadoop Storage Appliance

Vol. 14, No. 12, December 31, 2020
10.3837/tiis.2020.12.002, Download Paper (Free):

Abstract

This paper proposes the Lempel-Ziv 4(LZ4) compression accelerator optimized for scale-out servers in data centers. In order to reduce CPU loads caused by compression, we propose an accelerator solution and implement the accelerator on an Field Programmable Gate Array(FPGA) as heterogeneous computing. The LZ4 compression hardware accelerator is a fully pipelined architecture and applies 16 dictionaries to enhance the parallelism for high throughput compressor. Our hardware accelerator is based on the 20-stage pipeline and dictionary architecture, highly customized to LZ4 compression algorithm and parallel hardware implementation. Proposing dictionary architecture allows achieving high throughput by comparing input sequences in multiple dictionaries simultaneously compared to a single dictionary. The experimental results provide the high throughput with intensively optimized in the FPGA. Additionally, we compare our implementation to CPU implementation results of LZ4 to provide insights on FPGA-based data centers. The proposed accelerator achieves the compression throughput of 639MB/s with fine parallelism to be deployed into scale-out servers. This approach enables the low power Intel Atom processor to realize the Hadoop storage along with the compression accelerator.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
D. Y. Choi, J. H. Oh, J. K. Kim, S. E. Lee, "Energy Efficient and Low-Cost Server Architecture for Hadoop Storage Appliance," KSII Transactions on Internet and Information Systems, vol. 14, no. 12, pp. 4648-4663, 2020. DOI: 10.3837/tiis.2020.12.002.

[ACM Style]
Do Young Choi, Jung Hwan Oh, Ji Kwang Kim, and Seung Eun Lee. 2020. Energy Efficient and Low-Cost Server Architecture for Hadoop Storage Appliance. KSII Transactions on Internet and Information Systems, 14, 12, (2020), 4648-4663. DOI: 10.3837/tiis.2020.12.002.

[BibTeX Style]
@article{tiis:24136, title="Energy Efficient and Low-Cost Server Architecture for Hadoop Storage Appliance", author="Do Young Choi and Jung Hwan Oh and Ji Kwang Kim and Seung Eun Lee and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2020.12.002}, volume={14}, number={12}, year="2020", month={December}, pages={4648-4663}}