Cyclic Consistent Image Style Transformation: From Model to System
-
Published:2024-08-29
Issue:17
Volume:14
Page:7637
-
ISSN:2076-3417
-
Container-title:Applied Sciences
-
language:en
-
Short-container-title:Applied Sciences
Author:
Peng Jun1ORCID, Chen Kaiyi2, Gong Yuqing3, Zhang Tianxiang3, Su Baohua2ORCID
Affiliation:
1. School of Education, City University of Macau, Macao 999078, China 2. College of Chinese Language and Culture, Jinan University, Guangzhou 510610, China 3. School of Computer Science, Zhuhai College of Science and Technology, Zhuhai 519041, China
Abstract
Generative Adversarial Networks (GANs) have achieved remarkable success in various tasks, including image generation, editing, and reconstruction, as well as in unsupervised and representation learning. Despite their impressive capabilities, GANs are often plagued by challenges such as unstable training dynamics and limitations in generating complex patterns. To address these challenges, we propose a novel image style transfer method, named C3GAN, which leverages CycleGAN architecture to achieve consistent and stable transformation of image style. In this context, “image style” refers to the distinct visual characteristics or artistic elements, such as the color schemes, textures, and brushstrokes that define the overall appearance of an image. Our method incorporates cyclic consistency, ensuring that the style transformation remains coherent and visually appealing, thus enhancing the training stability and overcoming the generative limitations of traditional GAN models. Additionally, we have developed a robust and efficient image style transfer system by integrating Flask for web development and MySQL for database management. Our system demonstrates superior performance in transferring complex styles compared to existing model-based approaches. This paper presents the development of a comprehensive image style transfer system based on our advanced C3GAN model, effectively addressing the challenges of GANs and expanding application potential in domains such as artistic creation and cinematic special effects.
Funder
2024 Macao Foundation Project 2022 Research Topic of Online Open Course Guidance Committee of Undergraduate Universities in Guangdong Province “Four New” Experimental Teaching Curriculum Reform Project of Jinan University
Reference39 articles.
1. Chen, H., Wang, Z., Zhang, H., Zuo, Z., Li, A., Xing, W., and Lu, D. (2021, January 6–14). Artistic style transfer with internal-external learning and contrastive learning. Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Online. 2. CineScale: A dataset of cinematic shot scale in movies;Savardi;Data Brief,2021 3. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial nets. Advances in Neural Information Processing Systems, MIT Press. 4. Goodfellow, I. (2016). NIPS 2016 tutorial: Generative adversarial networks. arXiv. 5. Fang, Z., Shahbazi, M., Probst, T., Paudel, D.P., and Van Gool, L. (2022, January 4–8). Training dynamics aware neural network optimization with stabilization. Proceedings of the Asian Conference on Computer Vision, Macau, China.
|
|