Host: The Japanese Society for Artificial Intelligence
Name : The 37th Annual Conference of the Japanese Society for Artificial Intelligence
Number : 37
Location : [in Japanese]
Date : June 06, 2023 - June 09, 2023
Agents in the household simulator named VirtualHome can interact with the environment based on action scripts that describe a sequence of instructions. Each instruction consists of an action and an object used by the action. There is a dataset containing activity labels, activity descriptions, and action scripts that correspond to each activity description built through crowdsourcing. However, the construction cost is high, and there is an issue that action scripts that cannot be executed in VirtualHome are included in the dataset. Since actions that can be performed on VirtualHome have preconditions for execution, the list of actions generated by existing methods often cannot be executed on VirtualHome. To solve the issues, we propose a method to generate action scripts from descriptions of daily life activities by natural language processing technologies and home environment knowledge. In addition, we evaluated the proposed method using the above dataset.