It is experimentally clarified how the degree of the semantic harmony could be estimated in order to derive the degree of the general harmony. In the experiment, four patterns of audiovisual materials are used. These are created by combining the semantically matched and mismatched sound clips and the temporally matched and mismatched video clips. Subjects evaluate impression of the materials and semantic similarity of the sound and the video clips. This experiment clarifies that the degree of the semantic harmony could be estimated with certain accuracy by using the degree of the impressive similarity and that of the semantic one of the sound and the video clips.