Augmented reality using gesture and speech accelerates user interaction.

Abstract

A user interaction technique is needed to manipulate the Augmented Reality (AR) content to make AR deliver realism. However, these problems persist, especially when they involve natural user interaction such as real hands and speech. Speech might be the most crucial part, especially in detecting the user’s voice. The user’s voice usually contains noises that come from the surroundings and every people produces different kinds of voice vibrations. Different genders also produce different voice vibrations. Robust real hand gestures are required to ensure the AR can accelerate the natural user interface. By providing users with more than one way to interact with AR, it tends to produce an efficient way of interaction. This chapter discusses the approach involves three main phases. In the first phase, study the interaction metaphor using gesture and speech in AR. After that, the second phase is carried out to perform a test application for the gesture and speech interaction. This chapter presents an appropriate interaction method that accelerates user interaction, it describes the implementation of gesture and speech interaction to the next level to see how AR could accelerate user interaction.