We propose a method for depth super-resolution using spatio-temporal correlation of RGB-D videos. The use of spatio-temporal correlations of RGB-D video allows us to suppress false artifacts caused by the color image in synthesizing super-resolved depth images. Our experiments demonstrate the effectiveness of our method.