Universiti Teknologi Malaysia Institutional Repository

Malay sign language gesture recognition system

Tan, Tian Swee and Shaikh Salleh, Sheikh Hussain and Ariff, Ahmad Kamarul and Chee, Ming Ting and Siew, Kean Seng and Leong, Seng Huat (2007) Malay sign language gesture recognition system. In: Intelligent and Advanced Systems, 2007. ICIAS 2007. International Conference, 25-28 Nov 2007, Kuala Lumpur, Malaysia.

[img] PDF
Restricted to Repository staff only

488Kb

Official URL: http://dx.doi.org/10.1109/ICIAS.2007.4658532

Abstract

This paper describes hardware design and sensors setting and configuration for Malay Sign Language Gesture Recognition systems. A set of sensors consists of accelerometers and flexure sensors has been setup to capture the movement or gesture of shoulder, elbow, wrist, palm and fingers. This project is based on the need of developing an electronic device that can translate the sign language into speech (sound) in order to enable communication to take place between the mute and deaf community with the common public. Hence, the main objective of this project is to develop a system that can convert the sign language into speech so that deaf people are able to communicate efficiently with normal people. This Human-Computer Interaction system is able to recognize 25 common words signing in Bahasa Isyarat Malaysia (BIM) by using the Hidden Markov Models (HMM) method. Both hands are involved to perform the BIM with all the sensors connect wirelessly to a PC with a Bluetooth module. This project aims to capture the hand gestures which involve multiple axis of movement. Altogether 24 sensors have been setup in different hand locations to capture hand and wrist movement in different directions.

Item Type:Conference or Workshop Item (Paper)
Uncontrolled Keywords:HMM, sign language recognition, speech synthesis
Subjects:T Technology > TK Electrical engineering. Electronics Nuclear engineering
Divisions:Electrical Engineering
ID Code:7629
Deposited By: Norhafizah Hussin
Deposited On:12 Jan 2009 09:05
Last Modified:01 Jun 2010 15:54

Repository Staff Only: item control page