Key Considerations for Image Evaluation Experiments

Abstract

Various objective evaluation criteria, such as image compression performance and processing speed, have been established for digital image processing results depending on the purpose. Conversely, objective evaluation methods related to human perception and sensitivity, such as visual comfort and aesthetic evaluation, are currently being developed. Therefore, it is necessary to conduct subjective evaluation, sensory evaluation, and psychophysical experiments to evaluate the results of image processing. However, if these experiments are not executed correctly, they may yield incorrect evaluation results; therefore, it is important to design and conduct appropriate experiments. In this paper, we summarize the key considerations when evaluating images involving human observers.