Abstract
We describe geometrical correspondences between projector pixels and camera pixels for uncalibrated projector-camera systems by introducing light transports, which have direct reflection, indirect reflection, and multipath reflection from unknown spatial structure. Since brute-force scan illuminates the objects using the light yielded from each projector pixel in order, the number of images captured by the camera grows exponentially with the number of pixels used for projector illumination in order to measure the full light transports. Accordingly, we encode projector pixels by coded illumination with multiple layers and emit coded patterns on each layer for unknown 3D objects. We obtain approximately light transports that have direct and indirect reflections by decoding the observed images. In experiments, the proposed method shows its effectiveness of acquiring light transports, and it yields excellent projection mapping on unknown 3D objects.