A Study on Evocation of Context by Manipulatable Presentation of Vocal Recordings and Screenshots of the Operation to Resume Suspended Work

Abstract

To resume a work after it has been passed several days or weeks, much thinking about the work is often forgotten. “Thinking about the work” can be replaced a ‘context,’ that is the background or situation regarding the work. It is important to reconstruct the ‘context’ when we come back to the suspended task. The system proposed in this study focuses first on soliloquies that are uttered while working alone. Most of the soliloquies during the work act to organize or confirm what they are thinking. It is expected that the record of soliloquies will play a role as a note of the work. The recorded audio is presented in the form of text boxes. We will facilitate viewing, such as highlighting keywords according to the importance of the word. Second, we consider acquiring screenshots as history of the operation of the PC to record operation and viewing. We focused on the operation history because the operated part could be a record of user’s thinking. In addition, we will also consider user manipulation of text boxes, such as reordering. We conducted the preliminary experiment for the next experiment. We tested two kinds of the tasks; preparing a material to introduce an academic English paper and coding as the working task. We recorded voices and screen shots simultaneously. We classified the voices converted in texts and examined the result to prepare for the following experiments.