In Japan, some railway accidents happened recently which indicated that certain measures are required against driver abnormality for prevent these kind of accident anymore. This paper describes the detection method, which we thought over, of driver's unusual maneuver like hold out the driving handle. And describes the test result of detection concerning driver's behavior with the Infrared Laser Ranging Sensor system and some high performance sensors on a railway full-scale simulator.