Color information is an important means for information transmission. In general, color scheme is determined as an ordinary people can distinguish the difference of color. In such cases, the color vison defect person may not be able to distinguish the colors. In the conventional method of re-color scheme, it has a problem that the change of impression of the color scheme is large. In this paper, we propose a method to re-color scheme with small change from the original color scheme. The proposed method uses luminosity and color confusion line to change color. As a result, we achieve the re-color scheme that maintains the impression of color scheme.