The purpose of this study was to develop the object tracking system keeping the human movement or trajectory of ball in tennis using image processing. In this study, a dynamic field such as the human movement or trajectory of ball in tennis was extracted using the background subtraction, especially MOG model by mixed normal distribution which was strong in the fluctuation of the background and a change of the brightness by the break in the weather. As a result of having adapted itself to this algorithm, human (player) and the ball which were a change domain could be extracted.