Presentation 1999/7/22
Evaluation of Summarization Methods based on Information Retrieval Task
Hajime MOCHIZUKI, Manabu OKUMURA,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) As a new direction of evaluation method for summarization systems, task-based evaluation scheme has been adopted. It evaluates the performance of a summarization system in a given task, such as information retrieval and news analysis. This paper makes a comparison among ten different summarization systems based on the task of information retrieval. To evaluate system performance, subjects' speed and accuracy are measured in judging the relevance of texts. In order to establish a good evaluation methodology, we analyze which factors can affect evaluation results, and describe the problems that arised from the experimental design. Furthermore, we also present that our proposed summarization method can produce effective summaries' for information retrieval task.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) automatic text summarization / task-based evaluation / information retrieval
Paper # NLC99-11
Date of Issue

Conference Information
Committee NLC
Conference Date 1999/7/22(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Natural Language Understanding and Models of Communication (NLC)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Evaluation of Summarization Methods based on Information Retrieval Task
Sub Title (in English)
Keyword(1) automatic text summarization
Keyword(2) task-based evaluation
Keyword(3) information retrieval
1st Author's Name Hajime MOCHIZUKI
1st Author's Affiliation School of Information Science, Japan Advanced Institute of Science and Technology()
2nd Author's Name Manabu OKUMURA
2nd Author's Affiliation School of Information Science, Japan Advanced Institute of Science and Technology
Date 1999/7/22
Paper # NLC99-11
Volume (vol) vol.99
Number (no) 227
Page pp.pp.-
#Pages 8
Date of Issue