Summary
International Technical Conference on Circuits/Systems, Computers and Communications
2008
Session Number:E5
Session:
Number:E5-2
Automatic Evaluation of Question Answering System based on BE Method
Akiko Yamamoto, Junichi Fukumoto,
pp.-
Publication Date:2008/7/7
Online ISSN:2188-5079
Summary:
In this paper, we describe automatic evaluation method for question answering in natural language. This method is based on BEs (Basic Elements) originally proposed by Hovy et. al. for automatic evaluation of document summaries. We applied BE method for evaluation of question answering with comparison between BEs of system answer and BEs of correct answers. According to the experiments using QAC4 test set, we have proved that BE method has some correlation with human evaluation.