日本感性工学会論文誌
Online ISSN : 1884-5258
Print ISSN : 1884-0833
ISSN-L : 1884-5258
原著論文
感情推定を利用した感性的な画像説明文自動生成システム
三由 裕也萩原 将文
著者情報
ジャーナル フリー

2019 年 18 巻 2 号 p. 151-158

詳細
抄録

Image captioning has been actively studied these days, however, most of the systems output captions of factual expression. In this paper, an automatic affective image captioning system using emotion estimation is proposed. The proposed system consists of four parts: a base caption generation part composed by the conventional CNN (VGG16), a scene estimation part, an emotion estimation part, and a figurative expression generation part. When a human exists in an image, the emotion is estimated from his/her facial expression and simile is used. When a human does not exist in an image, personification of metaphor is used. Evaluation experiments have been carried out using three kinds of evaluation indexes; BLUE, METEOR, and CIDEr. The experimental results indicate the effectiveness of the proposed system to generate affective captions.

著者関連情報
© 2019 日本感性工学会
次の記事
feedback
Top