This research presents an interactive 3D modeling system from point cloud of architectural physical model which includes non-convex polygons. A physical model, computer graphics and virtual reality is acknowledged as an effective visualization method, but the creation of them requires a lot of works and costs. 3D Laser Scanner (3DLS) enables works and costs decreased. However, there are some problems such as existence of too many points and lacks, and so on. Therefore, the system “Poly-Opt2012” was developed to create digital 3D model from an architectural physical model. In conclusion, the proposed method was evaluated feasible and effective.