Abstract
Recently, a robust method of stereo matching using coarse to fine hierarchical color segmentation on each scanline in stereo images has been proposed. However, the stereo matching method has a crucial problem that several fault correspondences cannot be removed in the case of that a lot of similar color segments exist on same scanlines. Therefore, this paper proposes an advanced approach to detect and remove fault correspondences by taking into account of consistency of disparity of region contours. Furthermore, by using a Delaunay triangulation and a finite element method, the proposed method can reconstruct 3D structures of surfaces with the contours which are obtained by a suboptimal 3D line segmentation.