MARKERLESS AR DISPLAY OF HAND-WRITTEN NOTES USING 3-D DISTRIBUTION OF NATURAL FEATURE POINTS

Abstract

 In recent years, the use of tablet terminals has spread in many construction fieldworks. In this research, we focus on cameras and hand-written input functions standardized on such tablet terminals. This paper proposes a system that associates hand-written notes with AR (Augmented Reality) representation to enable smooth transmission and sharing of information on site. The operator's hand-written notes on the site are stored and automatically pop up in an AR expression when the mobile terminal captures the same scene with its camera. Conventional markerless AR systems using natural feature points have limitations in the observation angle because the reference points of image features are distributed on a plane. The proposed method prepares the reference points of natural features in 3D space using SfM (Structure from Motion). This paper reports the improved performance for AR display in viewing angle and wider varieties of objects' shapes. We also validated the proposed system's effectivity by the experiments using actual different kinds of pillar-shaped items for AR display hand-written notes, assuming concrete structures' inspection work.