| Presentation | 2003/10/30 An Automatic Evaluation Method of Machine-generated Extracts(Natural Language Understanding and Models of Communication) Hideto Kazawa, Thomas Arrigan, Tsutomu Hirao, Eisaku Maeda, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Recently in the automatic summarization community, there have been many research initiatives in which machine-generated summaries are compared using the same documents. In most of these initiatives, the summaries are evaluated by humans and thus it is difficult to compare these results with new methods once the evaluation was finished. In this paper, we propose a new automatic evaluation method which combines the information from the human-created summaries and the machine-generated summaries evaluated in the past (pooling data). The experimental results show that out method is better than existing evaluation methods and the pooling data improves the performance significantly. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | automatic summarization / extract / automatic evaluation / pooling data / overlap measure |
| Paper # | NLC2003-29 |
| Date of Issue |
| Conference Information | |
| Committee | NLC |
|---|---|
| Conference Date | 2003/10/30(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Natural Language Understanding and Models of Communication (NLC) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | An Automatic Evaluation Method of Machine-generated Extracts(Natural Language Understanding and Models of Communication) |
| Sub Title (in English) | |
| Keyword(1) | automatic summarization |
| Keyword(2) | extract |
| Keyword(3) | automatic evaluation |
| Keyword(4) | pooling data |
| Keyword(5) | overlap measure |
| 1st Author's Name | Hideto Kazawa |
| 1st Author's Affiliation | NTT Communication Science Laboratories() |
| 2nd Author's Name | Thomas Arrigan |
| 2nd Author's Affiliation | NTT Communication Science Laboratories |
| 3rd Author's Name | Tsutomu Hirao |
| 3rd Author's Affiliation | NTT Communication Science Laboratories |
| 4th Author's Name | Eisaku Maeda |
| 4th Author's Affiliation | NTT Communication Science Laboratories |
| Date | 2003/10/30 |
| Paper # | NLC2003-29 |
| Volume (vol) | vol.103 |
| Number (no) | 407 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |