We propose a ultra-high-speed CMOS image sensor based on the multi-aperture structure. Every aperture is operated with an independent shutter pattern and accumulates temporally-multiplexed signals in pixel. After that, temporally-resolved ultra-high-speed images are reproduced by solving an inverse problem using the given shutter patterns and a captured multi-aperture image. The time resolution is defined only by on-stage charge transfer time and the clock skew between the apertures. Therefore, we believe that the proposed method realizes the fastest frame rate.
