There are many Multi-Agent Simulation systems that are intending easy to use. When we will evaluate modeling usability now, it is difficult to evaluate quantitatively from operating time, because there are variability in tasks caused by thinking time on construction of models. So we designed to evaluate usability from “the total time”, “the thinking time” and “the operating time”.
In this study we calculate “the remain time” by subtract operating time from total task executing time. The remain time is including the meta thinking time, that is, decision of the method and cognition of the task goal. And we compared the total time, operating time and the remain time, with a satisfaction rate of modeling.
We applied this method to 3 simulation systems to evaluate quantitative usability. Then there confirmed that a significant difference between 3 systems with the total time, however, there are only non significant differences between 3 systems with the remain time. This study shows that there is correlation between the remain time and the satisfaction rate. And estimated when using the remain time, It can be possible to evaluate quantitatively about tasks with much thinking time.
View full abstract