Fingertips interaction method in handheld augmented reality for 3D manipulation

Abstract

Augmented Reality (AR) technology enhanced real world environment with virtual information either in two-dimensional (2D) or three-dimensional (3D) format. AR requires the interactive techniques to be as intuitive as possible for the user to accept. The issues to be addressed are the tracking inaccuracy and occlusion problems. Therefore, a prototype that enables fingertip manipulation method in handheld AR interface is developed. This paper explains user ability to interact directly with the virtual 3D object and manipulate it using fingertip-based gestures in handheld AR. It is used to perform 3D object manipulation for users to naturally interact and manipulate the virtual 3D objects. The paper describes the development phase, AR application with fingertip-based manipulation method to manipulate 3D object. Gesture tracking device is attached to handheld device to track the user's natural hand interaction. The result presents in this research is a new prototype to Ancient Malacca AR application with fingertip-based manipulation method for handheld AR interface.