MR-MEET: Mixed Reality collaborative interface for HMD and handheld users

Abstract

Mixed Reality (MR) collaborative interface allows remote collaboration between an HMD (Head Mounted Display) user in Virtual Reality (VR) and a non-HMD user in Augmented Reality (AR). Both users to have a meeting with each other despite the distance between one another. It enables users to interact in a virtual environment that can replace the traditional way of physical meeting by using appropriate collaborative tools. However, the problem arises when the user is far apart from each other and needs an effective way or tools to collaborate. This paper discusses about a collaborative tool and proposed a prototype called MR-Meet as a collaborative MR interface. MR-Meet has been designed with a tool that can aid both users from different settings to work together. It provides the designing stage to actualize MR collaborative interface with two basic tools such as sticky notes and a whiteboard to help distant people between HMD and handheld users from different locations can be available in one shared environment. To study the user's behavior and experience when they perform collaborative tasks using the two basic collaborative tools. This paper aims to invoke the collaborative tools in MR-Meet meeting space. It describes the users from two different settings, VR user wears HMD and AR user wears handheld device. The methodology describes the interaction of HMD by using a ray pointer while Non-HMD was using a handheld device to utilize its touch-based interaction.