Logo image
Evaluation of response quality for heterogeneous question answering systems
Conference paper   Open access

Evaluation of response quality for heterogeneous question answering systems

W. Wong, S. Sahib and O.S. Goh
The 2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI'05), pp.610-613
IEEE
IEEE/WIC/ACM International Conference on Web Intelligence, WI 2005 (Compiegne Cedex, France, 19/09/2005–22/09/2005)
2005
pdf
evaluation_of_response_quality.pdfDownloadView
Published (Version of Record) Open Access
url
Link to Published Version *Subscription may be requiredView

Abstract

The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the challenges in evaluating systems of different nature, this research presents a black-box approach using a classification scheme and scoring mechanism to assess and rank three example systems.

Details

Metrics

107 File views/ downloads
79 Record Views
Logo image