• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

FD-StackGAN: Face De-occlusion Using Stacked Generative Adversarial Networks


Abstract

It has been widely acknowledged that occlusion impairments adversely distress many face recognition algorithms' performance. Therefore, it is crucial to solving the problem of face image occlusion in face recognition. To solve the image occlusion problem in face recognition, this paper aims to automatically de-occlude the human face majority or discriminative regions to improve face recognition performance. To achieve this, we decompose the generative process into two key stages and employ a separate generative adversarial network (GAN)-based network in both stages. The first stage generates an initial coarse face image without an occlusion mask. The second stage refines the result from the first stage by forcing it closer to real face images or ground truth. To increase the performance and minimize the artifacts in the generated result, a new refine loss (e.g., reconstruction loss, perceptual loss, and adversarial loss) is used to determine all differences between the generated de-occluded face image and ground truth. Furthermore, we build occluded face images and corresponding occlusion-free face images dataset. We trained our model on this new dataset and later tested it on real-world face images. The experiment results (qualitative and quantitative) and the comparative study confirm the robustness and effectiveness of the proposed work in removing challenging occlusion masks with various structures, sizes, shapes, types, and positions.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
A. Jabbar, X. Li, M. M. Iqbal and A. J. Malik, "FD-StackGAN: Face De-occlusion Using Stacked Generative Adversarial Networks," KSII Transactions on Internet and Information Systems, vol. 15, no. 7, pp. 2547-2567, 2021. DOI: 10.3837/tiis.2021.07.014.

[ACM Style]
Abdul Jabbar, Xi Li, M. Munawwar Iqbal, and Arif Jamal Malik. 2021. FD-StackGAN: Face De-occlusion Using Stacked Generative Adversarial Networks. KSII Transactions on Internet and Information Systems, 15, 7, (2021), 2547-2567. DOI: 10.3837/tiis.2021.07.014.

[BibTeX Style]
@article{tiis:24812, title="FD-StackGAN: Face De-occlusion Using Stacked Generative Adversarial Networks", author="Abdul Jabbar and Xi Li and M. Munawwar Iqbal and Arif Jamal Malik and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2021.07.014}, volume={15}, number={7}, year="2021", month={July}, pages={2547-2567}}