Image Transformation based on onomatopia words

Abstract

In recent years, deep learning has attracted attention not only as a method on image recognition but also as a technique for image generation and transformation. Above all, a method called Style Transfer [Gatys 16] is drawing much attention which can integrate two photos into one integrated photo regarding their content and style. In this paper, we propose to use words expressing photo styles instead of using style images for neural image style transfer. In our method, we take into account the content of an input image to be stylized to decide a style for style transfer in addition to a given word. We implemented the propose method by modifying the network for Unseen Style Transfer [Yanai 17]. By the experiments, we show that the proposed method has ability to change the style of an input image taking account of both a given word and its contents.