We have developed a view-based visual tracking system to cope with change of the appearance of the template in 3D environment using affine transformed templates. We have extended the system to stereo vision for hand over action between human and robot. The system estimates 3D pose of a target object while performing 2D tracking of different parts of the object in the stereo images.
