Shape memory polymer (SMP) is soft and its configuration can be easily changed into a desired configuration at temperatures above the glass-transition temperature (T_g), and the configuration can be fixed by cooling to temperatures below Tg. In addition, the original configuration can be recovered by heating to temperatures above T_g. Moreover, although the large deformation under temperatures below T_g generates residual strain after unloading, this residual strain can be also removed by heating to temperatures above T_g. The present authors proposed a micromechanical model to duplicate the shape fixation and recovery behavior. In this paper, the micromechanical model was extended to describe the latter shape recovery behavior of the residual strain by adding two springs, one dash pot, and one latch elements. It was confirmed from the experiment that the residual strain by deformation below T_g can recover by heating SMP, and that the proposed micromechanical model could capture thermomechanical behavior of the recoverable residual strain of SMP.