This study explores the differences between women and men in the relationships of perceptions of post-disaster living conditions. The research area in this study is Kirime area of Inami Town, Wakayama, Japan. To illustrate the relationship between residents’ anxiety about living conditions in the early recovery phase and demand for measures to respond to the problems, a questionnaire survey was conducted on residents in the research area. Results indicated that the main factor of the perception of post-disaster living conditions in women group is mental stress, while the main factor in men group is physical health.