• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

A Hybrid Mechanism of Particle Swarm Optimization and Differential Evolution Algorithms based on Spark

Vol. 13, No. 12, December 31, 2019
10.3837/tiis.2019.12.010, Download Paper (Free):

Abstract

With the onset of the big data age, data is growing exponentially, and the issue of how to optimize large-scale data processing is especially significant. Large-scale global optimization (LSGO) is a research topic with great interest in academia and industry. Spark is a popular cloud computing framework that can cluster large-scale data, and it can effectively support the functions of iterative calculation through resilient distributed datasets (RDD). In this paper, we propose a hybrid mechanism of particle swarm optimization (PSO) and differential evolution (DE) algorithms based on Spark (SparkPSODE). The SparkPSODE algorithm is a parallel algorithm, in which the RDD and island models are employed. The island model is used to divide the global population into several subpopulations, which are applied to reduce the computational time by corresponding to RDD’s partitions. To preserve population diversity and avoid premature convergence, the evolutionary strategy of DE is integrated into SparkPSODE. Finally, SparkPSODE is conducted on a set of benchmark problems on LSGO and show that, in comparison with several algorithms, the proposed SparkPSODE algorithm obtains better optimization performance through experimental results.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
D. Fan and J. Lee, "A Hybrid Mechanism of Particle Swarm Optimization and Differential Evolution Algorithms based on Spark," KSII Transactions on Internet and Information Systems, vol. 13, no. 12, pp. 5972-5989, 2019. DOI: 10.3837/tiis.2019.12.010.

[ACM Style]
Debin Fan and Jaewan Lee. 2019. A Hybrid Mechanism of Particle Swarm Optimization and Differential Evolution Algorithms based on Spark. KSII Transactions on Internet and Information Systems, 13, 12, (2019), 5972-5989. DOI: 10.3837/tiis.2019.12.010.

[BibTeX Style]
@article{tiis:23090, title="A Hybrid Mechanism of Particle Swarm Optimization and Differential Evolution Algorithms based on Spark", author="Debin Fan and Jaewan Lee and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2019.12.010}, volume={13}, number={12}, year="2019", month={December}, pages={5972-5989}}