Journal article
Reinforced memory network for question answering
Neural Information Processing, Vol.10635, pp.482-490
2017
Abstract
Deep learning techniques have shown to perform well in Question Answering (QA) tasks. We present a framework that combines Memory Network (MN) and Reinforcement Learning (Q-learning) to perform QA, termed Reinforced MN (R-MN). We investigate the proposed framework by the use of Long Short Term Memory Network (LSTM) and Dynamic Memory Network (DMN). We call them Reinforced LSTM (R-LSTM) and Reinforced DMN (R-DMN), respectively. The input text sequence and question are passed to both MN and Q-Learning. The output of the MN is then fed to Q-Learning as a second input for refinement. The R-MN is trained end-to-end. We evaluated R-MNs on the bAbI 1 K QA dataset for all of the 20 tasks. We achieve superior performance when compared to conventional method of RL, LSTM and the state of the art technique, DMN. Using only half of the training data, both R-LSTM and R-DMN achieved all of the bAbI tasks with high accuracies. The experimental results demonstrated that the proposed framework of combining MN and Q-learning enhances the QA tasks while using less training data.
Details
- Title
- Reinforced memory network for question answering
- Authors/Creators
- A. Nugaliyadde (Author/Creator) - Murdoch UniversityK.W. Wong (Author/Creator) - Murdoch UniversityF. Sohel (Author/Creator) - Murdoch UniversityH. Xie (Author/Creator) - Murdoch University
- Publication Details
- Neural Information Processing, Vol.10635, pp.482-490
- Publisher
- Springer Verlag
- Identifiers
- 991005540297207891
- Copyright
- © 2017 Springer International Publishing AG
- Murdoch Affiliation
- School of Engineering and Information Technology
- Language
- English
- Resource Type
- Journal article
Metrics
98 Record Views