For tracking objects, the various template matching methods are usually used. However, those cannot completely cope with apparent changes of a target object in images. On the other hand, to discriminate multiple objects in still images, the label assignment based on the MAP estimation using object's features is convenient, In this study, we propose a method which enables to track multiple objects stably without explicit tracking by extending the above MAP assignment in the temporal direction.