Journal article
Detection of tongue protrusion gestures from videos
IEICE TRANSACTIONS on Information and Systems, Vol.E94-D(8), pp.1671-1682
2011
Abstract
We propose a system that, using video information, segments the mouth region from a face image and then detects the protrusion of the tongue from inside the oral cavity. Initially, under the assumption that the mouth is closed, we detect both mouth corners. We use a set of specifically oriented Gabor filters for enhancing horizontal features corresponding to the shadow existing between the upper and lower lips. After applying the Hough line detector, the extremes of the line that was found are regarded as the mouth corners. Detection rate for mouth corner localization is 85.33%. These points are then input to a mouth appearance model which fits a mouth contour to the image. By segmenting its bounding box we obtain a mouth template. Next, considering the symmetric nature of the mouth, we divide the template into right and left halves. Thus, our system makes use of three templates. We track the mouth in the following frames using normalized correlation for mouth template matching. Changes happening in the mouth region are directly described by the correlation value, i.e., the appearance of the tongue in the surface of the mouth will cause a decrease in the correlation coefficient through time. These coefficients are used for detecting the tongue protrusion. The right and left tongue protrusion positions will be detected by analyzing similarity changes between the right and left half-mouth templates and the currently tracked ones. Detection rates under the default parameters of our system are 90.20% for the tongue protrusion regardless of the position, and 84.78% for the right and left tongue protrusion positions. Our results demonstrate the feasibility of real-time tongue protrusion detection in vision-based systems and motivates further investigating the usage of this new modality in human-computer communication.
Details
- Title
- Detection of tongue protrusion gestures from videos
- Authors/Creators
- L.R. Sapaico (Author/Creator)H. Laga (Author/Creator)M. Nakajima (Author/Creator)
- Publication Details
- IEICE TRANSACTIONS on Information and Systems, Vol.E94-D(8), pp.1671-1682
- Publisher
- Institute of Electronics, Information and Communication Engineers
- Number of pages
- 12
- Identifiers
- 991005543675307891
- Copyright
- (c) 2011 by IEICE
- Murdoch Affiliation
- Murdoch University
- Language
- English
- Resource Type
- Journal article
Metrics
227 File views/ downloads
67 Record Views
InCites Highlights
These are selected metrics from InCites Benchmarking & Analytics tool, related to this output
- Collaboration types
- Domestic collaboration
- International collaboration
- Citation topics
- 4 Electrical Engineering, Electronics & Computer Science
- 4.17 Computer Vision & Graphics
- 4.17.118 Face Recognition
- Web Of Science research areas
- Computer Science, Information Systems
- Computer Science, Software Engineering
- ESI research areas
- Computer Science