食品チラシ画像を用いたレシピ推薦システム

抄録

Making everyday dishes is a vital part of everyday life. This paper proposes a novel system that takes a food flyer of a grocery store to automatically recommend popular recipes containing ingredients appeared in the flyer. Based on an optical character recognition (OCR) technique, our algorithm extracts the ingredient names from the words in the flyer by matching them with a dedicated ingredient dictionary. The extracted ingredients are used as queries to retrieve cooking information from a recipe database. Newly proposed word correction scheme using multiple similarity measures robustly corrects misrecognized characters from the OCR to boost the extraction performance. We conducted both quantitative and subjective evaluations to confirm the effectiveness of the proposed method. The subjective evaluation revealed that more than 90% of the participants rated the proposed system as practical and were satisfied with the quality of recommended recipes.