Logo image
Australian sign language recognition
Journal article   Peer reviewed

Australian sign language recognition

E-J Holden, G. Lee and R. Owens
Machine Vision and Applications, Vol.16(5), pp.312-320
2005
url
Link to Published Version *Subscription may be requiredView

Abstract

This paper presents an automatic Australian sign language (Auslan) recognition system, which tracks multiple target objects (the face and hands) throughout an image sequence and extracts features for the recognition of sign phrases. Tracking is performed using correspondences of simple geometrical features between the target objects within the current and the previous frames. In signing, the face and a hand of a signer often overlap, thus the system needs to segment these for the purpose of feature extraction. Our system deals with the occlusion of the face and a hand by detecting the contour of the foreground moving object using a combination of motion cues and the snake algorithm. To represent signs, features that are invariant to scaling, 2D rotations and signing speed are used for recognition. The features represent the relative geometrical positioning and shapes of the target objects, as well as their directions of motion. These are used to recognise Auslan phrases using Hidden Markov Models. Experiments were conducted using 163 test sign phrases with varying grammatical formations. Using a known grammar, the system achieved over 97% recognition rate on a sentence level and 99% success rate at a word level.

Details

UN Sustainable Development Goals (SDGs)

This output has contributed to the advancement of the following goals:

#11 Sustainable Cities and Communities

Source: InCites

Metrics

InCites Highlights

These are selected metrics from InCites Benchmarking & Analytics tool, related to this output

Collaboration types
Domestic collaboration
Citation topics
4 Electrical Engineering, Electronics & Computer Science
4.116 Robotics
4.116.1097 Gesture Recognition
Web Of Science research areas
Computer Science, Artificial Intelligence
Computer Science, Cybernetics
Engineering, Electrical & Electronic
ESI research areas
Engineering
Logo image