This paper introduces the “smart guide in farming” system, which supports the user’s determination in farming. This system has several functions for supporting workers’ tasks and for calculating several criteria which are required for farm managers. In this paper, we focus on the method for predicting the time of crop harvest, which is especially required for evaluating their farming business, based on the image information.