Verification of Functional Consistency on Extended UI

Abstract

In recent years, multimodal interfaces have been attracting attention as they are increasingly being incorporated into off-the-shelf user interfaces (UIs) as extended UIs. However, conflicts in the operation of multiple interfaces can cause system behavior that is contrary to human expectations, but since there is no unified design idea between extended UIs and the system. It is difficult in conventional research to identify behaviors that cause conflicts. In this paper, we propose a method to detect system inconsistencies caused by the combination of a basic UI and an extended UI using model checking, which is a formal method. In the proposed method, a model representing human cognitive activity and a model representing system behavior are integrated via UI as a state transition model to create a model for inspection. We use model checking to identify whether system inconsistencies occur on this integrated model. By analyzing the process by which this behavior occurs based on the results of model checking, we can identify the cause. The case study evaluated an example of operating an air conditioner with a basic UI and an extended UI of remote controls.