• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Semi-Supervised Spatial Attention Method for Facial Attribute Editing


Abstract

In recent years, facial attribute editing has been successfully used to effectively change face images of various attributes based on generative adversarial networks and encoder–decoder models. However, existing models have a limitation in that they may change an unintended part in the process of changing an attribute or may generate an unnatural result. In this paper, we propose a model that improves the learning of the attention mask by adding a spatial attention mechanism based on the unified selective transfer network (referred to as STGAN) using semi-supervised learning. The proposed model can edit multiple attributes while preserving details independent of the attributes being edited. This study makes two main contributions to the literature. First, we propose an encoder–decoder model structure that learns and edits multiple facial attributes and suppresses distortion using an attention mask. Second, we define guide masks and propose a method and an objective function that use the guide masks for multiple facial attribute editing through semi-supervised learning. Through qualitative and quantitative evaluations of the experimental results, the proposed method was proven to yield improved results that preserve the image details by suppressing unintended changes than existing methods.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
H. S. Yang, J. H. Han and Y. S. Moon, "Semi-Supervised Spatial Attention Method for Facial Attribute Editing," KSII Transactions on Internet and Information Systems, vol. 15, no. 10, pp. 3685-3707, 2021. DOI: 10.3837/tiis.2021.10.012.

[ACM Style]
Hyeon Seok Yang, Jeong Hoon Han, and Young Shik Moon. 2021. Semi-Supervised Spatial Attention Method for Facial Attribute Editing. KSII Transactions on Internet and Information Systems, 15, 10, (2021), 3685-3707. DOI: 10.3837/tiis.2021.10.012.

[BibTeX Style]
@article{tiis:25020, title="Semi-Supervised Spatial Attention Method for Facial Attribute Editing", author="Hyeon Seok Yang and Jeong Hoon Han and Young Shik Moon and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2021.10.012}, volume={15}, number={10}, year="2021", month={October}, pages={3685-3707}}