| Presentation | 1999/7/22 Evaluation of Summarization Methods based on Information Retrieval Task Hajime MOCHIZUKI, Manabu OKUMURA, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | As a new direction of evaluation method for summarization systems, task-based evaluation scheme has been adopted. It evaluates the performance of a summarization system in a given task, such as information retrieval and news analysis. This paper makes a comparison among ten different summarization systems based on the task of information retrieval. To evaluate system performance, subjects' speed and accuracy are measured in judging the relevance of texts. In order to establish a good evaluation methodology, we analyze which factors can affect evaluation results, and describe the problems that arised from the experimental design. Furthermore, we also present that our proposed summarization method can produce effective summaries' for information retrieval task. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | automatic text summarization / task-based evaluation / information retrieval |
| Paper # | NLC99-11 |
| Date of Issue |
| Conference Information | |
| Committee | NLC |
|---|---|
| Conference Date | 1999/7/22(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Natural Language Understanding and Models of Communication (NLC) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Evaluation of Summarization Methods based on Information Retrieval Task |
| Sub Title (in English) | |
| Keyword(1) | automatic text summarization |
| Keyword(2) | task-based evaluation |
| Keyword(3) | information retrieval |
| 1st Author's Name | Hajime MOCHIZUKI |
| 1st Author's Affiliation | School of Information Science, Japan Advanced Institute of Science and Technology() |
| 2nd Author's Name | Manabu OKUMURA |
| 2nd Author's Affiliation | School of Information Science, Japan Advanced Institute of Science and Technology |
| Date | 1999/7/22 |
| Paper # | NLC99-11 |
| Volume (vol) | vol.99 |
| Number (no) | 227 |
| Page | pp.pp.- |
| #Pages | 8 |
| Date of Issue | |