Logo image
Audio-visual biometric recognition via joint sparse representations
Conference paper

Audio-visual biometric recognition via joint sparse representations

R. Primorac, R. Togneri, M. Bennamoun and F. Sohel
2016 23rd International Conference on Pattern Recognition (ICPR), pp.3031-3035
Institute of Electrical and Electronics Engineers Inc.
2016 23rd International Conference on Pattern Recognition (ICPR) (04/12/2016–08/12/2016)
2016
url
Link to Published Version *Subscription may be requiredView

Abstract

In this paper we present a novel audio-visual (AV) person identification system based on joint sparse representation. Video features used were vectorized raw pixel values, while i-vectors were used as the audio features. Classification is performed by solving the joint sparsity optimization problem, and fusion is carried out by using the quality (confidence) assigned to each matcher. Our experimental results on the challenging MOBIO database using 100 subjects show that the system based on joint sparse representation outperforms the system based on separate sparse representations for each modality. Furthermore, we show that our newly introduced quality measure improves the system's performance, when compared to conventionally used quality measures for sparse representation - based systems.

Details

Metrics

37 Record Views
Logo image