Logo image
Multi-Task learning for acoustic event detection using event and frame position information
Journal article   Peer reviewed

Multi-Task learning for acoustic event detection using event and frame position information

X. Xia, R. Togneri, F. Sohel, Y. Zhao and D. Huang
IEEE Transactions on Multimedia, Vol.22(3), pp.569-578
2020
url
Link to Published Version *Subscription may be requiredView

Abstract

Acoustic event detection deals with the acoustic signals to determine the sound type and to estimate the audio event boundaries. Multi-label classification based approaches are commonly used to detect the frame wise event types with a median filter applied to determine the happening acoustic events. However, the multi-label classifiers are trained only on the acoustic event types ignoring the frame position within the audio events. To deal with this, this paper proposes to construct a joint learning based multi-task system. The first task performs the acoustic event type detection and the second task is to predict the frame position information. By sharing representations between the two tasks, we can enable the acoustic models to generalize better than the original classifier by averaging respective noise patterns to be implicitly regularized. Experimental results on the monophonic UPC-TALP and the polyphonic TUT Sound Event datasets demonstrate the superior performance of the joint learning method by achieving lower error rate and higher F-score compared to the baseline AED system.

Details

Metrics

InCites Highlights

These are selected metrics from InCites Benchmarking & Analytics tool, related to this output

Collaboration types
Domestic collaboration
Citation topics
4 Electrical Engineering, Electronics & Computer Science
4.174 Digital Signal Processing
4.174.152 Speech Recognition
Web Of Science research areas
Computer Science, Information Systems
Computer Science, Software Engineering
Telecommunications
ESI research areas
Computer Science
Logo image