Assembly Guidance using Mixed Reality

抄録

Assembling items are tasks that people often encounter in modern days. Whether is for building a DIY PC or setting up furniture, these kinds of work are not easy. Sometimes, people need better instructions to do it correctly. We propose a new approach to solving this problem. By using the see-through type MR HMD, we made a set of intuitive 3D instructions other than texts for better understanding while offering a Hands-Free experience. Furthermore, this system can recognize the items during assembling, which provides functions such as monitoring job progress or active help of avoiding mistake.