2023 Volume 62 Issue 2 Pages 128-138
We attempted to read changes in mental states from food images using image recognition. We created a dataset of 19,012 food items, 7,834 food images, and the mental states of the same period. Experiments using the nutritional values estimated from these images showed a significant correlation between nutritional values and changes in mental states in a subgroup of people with the same life background, suggesting that nutritional values inferred from food images can also be used to predict mental states. In addition, we showed that changes in stress can be predicted with features directly extracted from the food images much better than the baseline in a dataset of people living alone.