• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Stylized Image Generation based on Music-image Synesthesia Emotional Style Transfer using CNN Network

Vol. 15, No. 4, April 30, 2021
10.3837/tiis.2021.04.015, Download Paper (Free):

Abstract

Emotional style of multimedia art works are abstract content information. This study aims to explore emotional style transfer method and find the possible way of matching music with appropriate images in respect to emotional style. DCNNs (Deep Convolutional Neural Networks) can capture style and provide emotional style transfer iterative solution for affective image generation. Here, we learn the image emotion features via DCNNs and map the affective style on the other images. We set image emotion feature as the style target in this style transfer problem, and held experiments to handle affective image generation of eight emotion categories, including dignified, dreaming, sad, vigorous, soothing, exciting, joyous, and graceful. A user study was conducted to test the synesthesia emotional image style transfer result with ground truth user perception triggered by the music-image pairs’ stimuli. The transferred affective image result for music-image emotional synesthesia perception was proved effective according to user study result.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
B. Xing, J. Dou, Q. Huang and H. Si, "Stylized Image Generation based on Music-image Synesthesia Emotional Style Transfer using CNN Network," KSII Transactions on Internet and Information Systems, vol. 15, no. 4, pp. 1464-1485, 2021. DOI: 10.3837/tiis.2021.04.015.

[ACM Style]
Baixi Xing, Jian Dou, Qing Huang, and Huahao Si. 2021. Stylized Image Generation based on Music-image Synesthesia Emotional Style Transfer using CNN Network. KSII Transactions on Internet and Information Systems, 15, 4, (2021), 1464-1485. DOI: 10.3837/tiis.2021.04.015.

[BibTeX Style]
@article{tiis:24533, title="Stylized Image Generation based on Music-image Synesthesia Emotional Style Transfer using CNN Network", author="Baixi Xing and Jian Dou and Qing Huang and Huahao Si and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2021.04.015}, volume={15}, number={4}, year="2021", month={April}, pages={1464-1485}}