Presentation 2017-09-08
A Study of Extracting Related Documents for Essay Evaluation Modules
Kota Motojin, Koichi Takeuchi, Masayuki Ohno, Masahiro Taguchi, Yoshihiko Inada, Masaya Iiduka, Tatsuhiko Abo, Hitoshi Ueda,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) We are developing an automatic Japanese essay-scoring system that is composed of 4 evaluation criteria, comprehensiveness, logical consistency, validity, spelling and grammar. In this paper, we discuss the most powerful approach to extract documents of Wikipedia that relates to the reference texts of the target essay theme for validity evaluation. The reason for using Wikipedia documents for evaluating validity of students’ essays is that we assume that validity can be evaluated by the expanded discussions in Wikipedia documents that relates to the essay theme. Experimental results show that the skip-gram based word vector is the best approach to extract relating documents to reference texts among several keyword-based evaluation approaches.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Automatic scoring of answers of essay-writing tests / Word vector / Skip-gram / Wikipedia
Paper # NLC2017-24
Date of Issue 2017-08-31 (NLC)

Conference Information
Committee NLC
Conference Date 2017/9/7(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Seikei University
Topics (in Japanese) (See Japanese page)
Topics (in English) The Eleventh Text Analytics Symposium
Chair Hiroshi Kanayama(IBM)
Vice Chair Takeshi Sakaki(Hottolink) / Kazutaka Shimada(Kyushu Inst. of Tech.)
Secretary Takeshi Sakaki(Ryukoku Univ.) / Kazutaka Shimada(NTT)
Assistant Mitsuo Yoshida(Toyohashi Univ. of Tech.) / Takeshi Kobayakawa(NICT)

Paper Information
Registration To Technical Committee on Natural Language Understanding and Models of Communication
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) A Study of Extracting Related Documents for Essay Evaluation Modules
Sub Title (in English)
Keyword(1) Automatic scoring of answers of essay-writing tests
Keyword(2) Word vector
Keyword(3) Skip-gram
Keyword(4) Wikipedia
1st Author's Name Kota Motojin
1st Author's Affiliation Okayama University(Okayama Univ)
2nd Author's Name Koichi Takeuchi
2nd Author's Affiliation Okayama University(Okayama Univ)
3rd Author's Name Masayuki Ohno
3rd Author's Affiliation Okayama University(Okayama Univ)
4th Author's Name Masahiro Taguchi
4th Author's Affiliation Okayama University(Okayama Univ)
5th Author's Name Yoshihiko Inada
5th Author's Affiliation Okayama University(Okayama Univ)
6th Author's Name Masaya Iiduka
6th Author's Affiliation Okayama University(Okayama Univ)
7th Author's Name Tatsuhiko Abo
7th Author's Affiliation Okayama University(Okayama Univ)
8th Author's Name Hitoshi Ueda
8th Author's Affiliation Okayama University(Okayama Univ)
Date 2017-09-08
Paper # NLC2017-24
Volume (vol) vol.117
Number (no) NLC-207
Page pp.pp.47-51(NLC),
#Pages 5
Date of Issue 2017-08-31 (NLC)