| Presentation | 2018-12-12 Proposing an Unsupervised Approach to Evaluate Essays Using IDF on Reference Data Masayuki Ohno, Koichi Takeuchi, Kota Motojin, Yuya Obata, Masahiro Taguchi, Yoshihiko Inada, Masaya Iizuka, Tatsuhiko Abo, Hitoshi Ueda, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In this paper, we describe an on-going study of developing anautomatic essay-scoring system in Japanese. Essay scoring systems havealready been developed and used mainly in English, while not manyprevious studies have been done on Japanese essay evaluations. Mostof the methods and systems of automatic essay evaluation need notsmall number of previously human-graded essays for calibrating theparameter of regression functions or parameter of machine learning. The previous studies show the high performance for essay evaluationtask, however, it must be not easy to assume large graded essays in, for example, actual tests or entrance examinations. Thus, we take aapproach to evaluate Japanese essays without previously human-gradedessays but with assuming reference data related to essay questions. The proposed method is a simple one, that is, evaluating the essayswith co-occurrences with the reference data in their words ormorphemes. In the method technical terms would be given high scoresusing neologd dictionary and idf values. Experimental results show that the proposed method works well in ourdeveloping Japanese mock trial writing tests. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | automatic scoring of essays / human annotation, supporting system of essay evaluation / idf / neologd |
| Paper # | NLC2018-33 |
| Date of Issue | 2018-12-04 (NLC) |
| Conference Information | |
| Committee | NLC / IPSJ-NL / SP / IPSJ-SLP |
|---|---|
| Conference Date | 2018/12/10(3days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Waseda Univ. Nishiwaseda Campus |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | The 5th Natural Language Processing Symposium & The 20th Spoken Language Symposium |
| Chair | Takeshi Sakaki(Hottolink) / / Yoichi Yamashita(Ritsumeikan Univ.) |
| Vice Chair | Mitsuo Yoshida(Toyohashi Univ. of Tech.) / Kazutaka Shimada(Kyushu Inst. of Tech.) / / Akinobu Ri(Nagoya Inst. of Tech.) |
| Secretary | Mitsuo Yoshida(Ryukoku Univ.) / Kazutaka Shimada(NTT) / / Akinobu Ri(Kyoto Univ.) / (Meijo Univ.) |
| Assistant | Takeshi Kobayakawa(NHK) / Hiroki Sakaji(Univ. of Tokyo) / / Tomoki Koriyama(Tokyo Inst. of Tech.) / Satoshi Kobashikawa(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Natural Language Understanding and Models of Communication / Special Interest Group on Natural Language / Technical Committee on Speech / Special Interest Group on Spoken Language Processing |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Proposing an Unsupervised Approach to Evaluate Essays Using IDF on Reference Data |
| Sub Title (in English) | |
| Keyword(1) | automatic scoring of essays |
| Keyword(2) | human annotation, supporting system of essay evaluation |
| Keyword(3) | idf |
| Keyword(4) | neologd |
| Keyword(5) | |
| 1st Author's Name | Masayuki Ohno |
| 1st Author's Affiliation | Okayama University(Okayama Univ.) |
| 2nd Author's Name | Koichi Takeuchi |
| 2nd Author's Affiliation | Okayama University(Okayama Univ.) |
| 3rd Author's Name | Kota Motojin |
| 3rd Author's Affiliation | Okayama University(Okayama Univ.) |
| 4th Author's Name | Yuya Obata |
| 4th Author's Affiliation | Okayama University(Okayama Univ.) |
| 5th Author's Name | Masahiro Taguchi |
| 5th Author's Affiliation | Okayama University(Okayama Univ.) |
| 6th Author's Name | Yoshihiko Inada |
| 6th Author's Affiliation | Okayama University(Okayama Univ.) |
| 7th Author's Name | Masaya Iizuka |
| 7th Author's Affiliation | Okayama University(Okayama Univ.) |
| 8th Author's Name | Tatsuhiko Abo |
| 8th Author's Affiliation | Okayama University(Okayama Univ.) |
| 9th Author's Name | Hitoshi Ueda |
| 9th Author's Affiliation | Okayama University(Okayama Univ.) |
| Date | 2018-12-12 |
| Paper # | NLC2018-33 |
| Volume (vol) | vol.118 |
| Number (no) | NLC-355 |
| Page | pp.pp.103-108(NLC), |
| #Pages | 6 |
| Date of Issue | 2018-12-04 (NLC) |