Experts and amateurs have been reported to exhibit different gaze patterns on visual search. We examined how daily driving experience which does not involve extensive training to be an expert modifies gaze patterns on visual search. Using scenery images while driving a vehicle in which several hazardous situations were embedded, we instructed both participants having a few years of experience and having no experience in driving a vehicle to find as many hazardous situations as they could. We measured their gaze patterns by using an eye tracking device while they observed the images. We found longer saccades, reduced time to first fixation, and fewer fixations on the objects for the experienced participants than for the inexperienced participants, whereas dwell time and individual fixation duration did not differ significantly. Thus, these results suggest that we acquire effective visual search ability by using memory structures called “templates” that have been accumulated through our daily experience.