Comments generation using MAGMA for fashion outfit

Abstract

In this study we build a model to generate comments when recommending two coordinated fashion items in personal styling. In coordinating recommendations, advice is also provided on the compatibility of these items and their combination with accessories and other items. We uses MAGMA, a method that supports multimodal input for language models by using adapters, to generate coordinating comment sentences with the combined image of two clothes and prompts as input. Quantitative and qualitative comparisons with manually generated comments and conventional methods based on machine learning were conducted to confirm that the proposed model is fully capable.