Abstract
Natsume is a writing assistance tool for learners of Japanese as a foreign language that uses genre-diverse corpora to assist co-occurrence writing tailored to the writer's target genre and register of writing. In this paper, we present results of an evaluation study of Natsume in the context of advanced learners' academic report writing that aims to measure the effect of the tool on co-occurrence usage. Results from the evaluation, which compares subjects' reports written with and without Natsume with respect to each co-occurrence's meaning, syntax and register, indicate improvements across all evaluated categories.