Digital holography (DH) has been used to measure aspherical micro lenses. By numerical reconstruction of the recorded digital hologram, the amplitude and phase information can be reconstructed numerically with high resolution. However, the field of view (FOV) in digital holography is limited by the size of sensor chip and the illumination beam divergence. Hence for micro-lenses DH works quite well. However for larger lenses, a single shot is not adequate to cover the whole field of view. To overcome this, stitching of images is usually done. Sequential stitching of images/holograms is tedious due to the enormous data that is needed. In this paper, we demonstrate a novel stitching algorithm which can reduce the large data processing and provide a stitched image with high quality and resolution. The proposal is validated using a DH system based on a modified Twyman-Green configuration. The holograms are recorded automatically using a motorized X-Y stage.