| Presentation | 2011-06-24 An analysis of factors contributing to the naturalness of machine translation outputs Yuka KURODA, Hirokazu SUZUKI, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | While a variety of methods has been proposed to evaluate machine translation quality, automated metrics, especially BLEU and NIST, are now widely used because of their low cost and objectivity. These automated metrics have been shown to correlate with human judgements when applied to languages that are linguistically similar, such as Indo-European languages, but not in case of language pairs that share less similarities, like Japanese and English, or Japanese and Chinese. Meanwhile, manual evaluation has also been done to measure the adequacy and fluency of translations. While these metrics are useful for comparing the performance of MT engines, we believe they fail to capture the naturalness of translations, which is one of the most important factors of translation quality. With this background, we conducted a survey using questionnaires on the impression of MT outputs and analyzed the results to examine what makes translations natural. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Machine translation / Evaluation / Translation quality / questionnaire |
| Paper # | TL2011-6 |
| Date of Issue |
| Conference Information | |
| Committee | TL |
|---|---|
| Conference Date | 2011/6/17(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Thought and Language (TL) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | An analysis of factors contributing to the naturalness of machine translation outputs |
| Sub Title (in English) | |
| Keyword(1) | Machine translation |
| Keyword(2) | Evaluation |
| Keyword(3) | Translation quality |
| Keyword(4) | questionnaire |
| 1st Author's Name | Yuka KURODA |
| 1st Author's Affiliation | Corporate Research & Development Center, Toshiba Corporation Knowledge Media Laboratory() |
| 2nd Author's Name | Hirokazu SUZUKI |
| 2nd Author's Affiliation | Corporate Research & Development Center, Toshiba Corporation Knowledge Media Laboratory |
| Date | 2011-06-24 |
| Paper # | TL2011-6 |
| Volume (vol) | vol.111 |
| Number (no) | 98 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |