• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Stage-GAN with Semantic Maps for Large-scale Image Super-resolution

Vol. 13, No. 8, August 30, 2019
10.3837/tiis.2019.08.007, Download Paper (Free):

Abstract

Recently, the models of deep super-resolution networks can successfully learn the non-linear mapping from the low-resolution inputs to high-resolution outputs. However, for large scaling factors, this approach has difficulties in learning the relation of low-resolution to high-resolution images, which lead to the poor restoration. In this paper, we propose Stage Generative Adversarial Networks (Stage-GAN) with semantic maps for image super-resolution (SR) in large scaling factors. We decompose the task of image super-resolution into a novel semantic map based reconstruction and refinement process. In the initial stage, the semantic maps based on the given low-resolution images can be generated by Stage-0 GAN. In the next stage, the generated semantic maps from Stage-0 and corresponding low-resolution images can be used to yield high-resolution images by Stage-1 GAN. In order to remove the reconstruction artifacts and blurs for high-resolution images, Stage-2 GAN based post-processing module is proposed in the last stage, which can reconstruct high-resolution images with photo-realistic details. Extensive experiments and comparisons with other SR methods demonstrate that our proposed method can restore photo-realistic images with visual improvements. For scale factor ×8, our method performs favorably against other methods in terms of gradients similarity.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
Z. Wei, H. Bai and Y. Zhao, "Stage-GAN with Semantic Maps for Large-scale Image Super-resolution," KSII Transactions on Internet and Information Systems, vol. 13, no. 8, pp. 3942-3961, 2019. DOI: 10.3837/tiis.2019.08.007.

[ACM Style]
Zhensong Wei, Huihui Bai, and Yao Zhao. 2019. Stage-GAN with Semantic Maps for Large-scale Image Super-resolution. KSII Transactions on Internet and Information Systems, 13, 8, (2019), 3942-3961. DOI: 10.3837/tiis.2019.08.007.