RGB-Dカメラによる寸法情報付きオルソ画像を用いた手術用鋼製器具の識別

抄録

In this study, to realize a simple identification of surgical steel instruments, we proposed a method to detect surgical steel instruments using Faster R-CNN on ortho-images of surgical steel instruments acquired with an RGB-D camera, and furthermore, to identify surgical steel instruments based on their dimensional information. In the proposed method, ortho-images are generated by orthographic transformation of 3D point clouds acquired using Intel REALSENSE DEPTH CAMERA D435i. A faster R-CNN object detector was applied to the ortho-image to detect surgical steel instruments. Since the ortho-image of the proposed method contains dimensional information, the area value of the region containing the surgical steel instrument can be easily calculated, and the surgical steel instrument can be identified without image scale correction.