Interactive Font Retrieval System with Multimodal Input For Advertising Design

Abstract

Choosing an appropriate font is crucial in graphic design for advertisements and posters. However, conventional font search methods require users to sift through many fonts to find one that meets their needs, demanding considerable effort before arriving at the right choice. To address this issue, we propose an interactive font search system that leverages a large-scale language model and utilizes textual and visual information. In our proposed method, users retain the freedom to browse fonts sequentially while engaging in intuitive chat-based interactions that effectively capture their intentions, enabling a more efficient font search. Through user studies, we compared our system with a baseline method and demonstrated that our approach can more effectively identify fonts suited to the target advertising images.