Summoning method using freehand interaction for occluded object selection in handheld augmented reality.

Abstract

Ray-casting is often used for object manipulation that intersects with the ray that uses the intersection between rays extending from the user and a virtual object. In Augmented Reality (AR), ray-casting has been triggered by a single touch event on the screen using smartphone or handheld device. Object selection in AR implemented in a simple single touch experience, which should be easily understandable for users. However, to select or hover the distant object or occluded object becoming one of the issues need to be solved in handheld AR. Besides, to work with real hand gesture for handheld AR may be challenging. Therefore, the ray intersection will be one of the advantages to manipulate virtual object in AR when works with bare hand or freehand gesture. As aiming a ray out of one's hand towards out of reach item is a very abstract interaction, summoning method has been proposed to confirm the object selection. In handheld AR, summoning method has not been explored, this paper aims to explore the summoning method with raycasting in handheld AR using real hand gesture. It also compares the implementation of summoning using touch-based, the conventional method in handheld AR.