Abstract
In order to perform IVR safely and accurately, individual patient medical images obtained preoperatively are indispensable. However, even if the image data is reconstructed in 3D on a 2D display, it shows a pseudo-3D effect due to shading, transparency, and reflection of light based on X, Y, and Z information. We have developed a system that supports accurate, safe, and reliable IVR by superimposing medical image data of individual patients in virtual and real space and presenting them in 3D space like a hologram, applying virtual reality (VR), augmented reality (AR), and mixed reality (MR), together termed extended reality (XR) technology.
Image-assisted IVR using XR and the metaverse is a natural and intuitive method of image support with a high degree of freedom, allowing the patient to experience the depth and positional relationship of organs and pathological conditions that cannot be obtained with a flat display, and to share the experience while moving their own hands. It is thought that the ability to spatially observe and confirm the anatomy and pathology of individual patients and the procedure in advance will help the practitioner feel more comfortable with the procedure, and contribute to time reduction and accident prevention.
