In this paper, we propose the lip shape recognition system for voice recognition for small sized robot. In noisy environment, it sometimes fails to recognize human voice. So, we developed the lip shape recognition system for subsystem of voice recognition aimed to improve the rate of recognition. We achieved the lip shape recognition using small vision system and got the good experimental results about that.