Cycle generative adversarial network for unpaired sketch-to-character translation

Cartoon characters are currently being used in various applications such as comic and cartoon production. The ability to generate a variety of poses and facial expression of cartoon characters from simple sketches of stickfigures can ease the drawing process in production. Previous studies show only...

पूर्ण विवरण

ग्रंथसूची विवरण
मुख्य लेखक: Alsaati, Leena Zeini J.
स्वरूप: थीसिस
भाषा:अंग्रेज़ी
प्रकाशित: 2019
विषय:
ऑनलाइन पहुंच:http://eprints.utm.my/96646/1/LeenaZeiniJAlsaatiMSC2019.pdf.pdf
_version_ 1846218567308017664
author Alsaati, Leena Zeini J.
author_facet Alsaati, Leena Zeini J.
author_sort Alsaati, Leena Zeini J.
description Cartoon characters are currently being used in various applications such as comic and cartoon production. The ability to generate a variety of poses and facial expression of cartoon characters from simple sketches of stickfigures can ease the drawing process in production. Previous studies show only few research focused on the task of sketch to character translation. With low performance of detecting rare pose features and improving rare feature detection has not been significantly studied. The aim of our research is to investigate the capabilities of generative adversarial networks (GANs) in the application of Sketch to Character translation. A wide range of extended GAN versions has been reviewed and in this research, a new dataset collection has been proposed which consists of images of sketches and cartoon characters that are manually drawn. A Cycle GAN has been implemented and its performance against Conditional GAN is compared. Cycle GAN’s cycle consistent loss is the main reason for learning a mapping between the domain of source images and the domain of target images without the need of paired training samples. Cycle GAN has been proven successful in handling a verity of applications in unpaired translation setting. The Conditional GAN has been also proven successful in a wide range of applications, however, it requires paired training samples. Results show that Conditional outperforms the Cycle GAN in accurately mapping the cartoon characters to the stickfigure, which is due to the nature of the paired training sample. However, the Cycle GAN still managed to produce sharper images that compete with the results of a Conditional GAN.
format Thesis
id uthm-96646
institution Universiti Teknologi Malaysia
language English
publishDate 2019
record_format eprints
spelling uthm-966462022-08-15T04:42:07Z http://eprints.utm.my/96646/ Cycle generative adversarial network for unpaired sketch-to-character translation Alsaati, Leena Zeini J. QA75 Electronic computers. Computer science Cartoon characters are currently being used in various applications such as comic and cartoon production. The ability to generate a variety of poses and facial expression of cartoon characters from simple sketches of stickfigures can ease the drawing process in production. Previous studies show only few research focused on the task of sketch to character translation. With low performance of detecting rare pose features and improving rare feature detection has not been significantly studied. The aim of our research is to investigate the capabilities of generative adversarial networks (GANs) in the application of Sketch to Character translation. A wide range of extended GAN versions has been reviewed and in this research, a new dataset collection has been proposed which consists of images of sketches and cartoon characters that are manually drawn. A Cycle GAN has been implemented and its performance against Conditional GAN is compared. Cycle GAN’s cycle consistent loss is the main reason for learning a mapping between the domain of source images and the domain of target images without the need of paired training samples. Cycle GAN has been proven successful in handling a verity of applications in unpaired translation setting. The Conditional GAN has been also proven successful in a wide range of applications, however, it requires paired training samples. Results show that Conditional outperforms the Cycle GAN in accurately mapping the cartoon characters to the stickfigure, which is due to the nature of the paired training sample. However, the Cycle GAN still managed to produce sharper images that compete with the results of a Conditional GAN. 2019 Thesis NonPeerReviewed application/pdf en http://eprints.utm.my/96646/1/LeenaZeiniJAlsaatiMSC2019.pdf.pdf Alsaati, Leena Zeini J. (2019) Cycle generative adversarial network for unpaired sketch-to-character translation. Masters thesis, Universiti Teknologi Malaysia. http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:143196
spellingShingle QA75 Electronic computers. Computer science
Alsaati, Leena Zeini J.
Cycle generative adversarial network for unpaired sketch-to-character translation
title Cycle generative adversarial network for unpaired sketch-to-character translation
title_full Cycle generative adversarial network for unpaired sketch-to-character translation
title_fullStr Cycle generative adversarial network for unpaired sketch-to-character translation
title_full_unstemmed Cycle generative adversarial network for unpaired sketch-to-character translation
title_short Cycle generative adversarial network for unpaired sketch-to-character translation
title_sort cycle generative adversarial network for unpaired sketch to character translation
topic QA75 Electronic computers. Computer science
url http://eprints.utm.my/96646/1/LeenaZeiniJAlsaatiMSC2019.pdf.pdf
url-record http://eprints.utm.my/96646/
http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:143196
work_keys_str_mv AT alsaatileenazeinij cyclegenerativeadversarialnetworkforunpairedsketchtocharactertranslation