| Presentation | 2017-11-24 Phased Learning for Distributed Word Representations Considering Synonym Chiaki Yonekura, Masafumi Hagiwara, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In natural language processing, distributed word representation is one of the representation methods for treating words with machines. In this paper, we propose a model improved on the learning phase of word2vec which is a popular model of distributed word representations learning. Our proposed model is devised based on cognitive scientific knowledge. Firstly, based on Curriculum Learning, the model trains from frequently occurring words in order and gradually expands the learning vocabulary. Furthermore, when extending the vocabulary we give synonym information to unknown words by using Paraphrase Database (PPDB). As a result of the experiments, step-by-step learning of our model reduced learning time while improving the accuracy, and the accuracy can be further improved by considering synonym. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Distributed Representation / word2vec / Neural Network / Curriculum Learning / PPDB |
| Paper # | NC2017-28 |
| Date of Issue | 2017-11-17 (NC) |
| Conference Information | |
| Committee | MBE / NC |
|---|---|
| Conference Date | 2017/11/24(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Tohoku University |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | BCI/BMI, generall |
| Chair | Kazuki Nakajima(Univ. of Toyama) / Masafumi Hagiwara(Keio Univ.) |
| Vice Chair | Masaki Kyoso(TCU) / Yutaka Hirata(Chubu Univ.) |
| Secretary | Masaki Kyoso(Toyama Pref. Univ.) / Yutaka Hirata(Kindai Univ.) |
| Assistant | Kim Juhyon(Univ. of Toyama) / Takumi Kobayashi(YNU) / Yoshihisa Shinozawa(Keio Univ.) / Keiichiro Inagaki(Chubu Univ.) |
| Paper Information | |
| Registration To | Technical Committee on ME and Bio Cybernetics / Technical Committee on Neurocomputing |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Phased Learning for Distributed Word Representations Considering Synonym |
| Sub Title (in English) | |
| Keyword(1) | Distributed Representation |
| Keyword(2) | word2vec |
| Keyword(3) | Neural Network |
| Keyword(4) | Curriculum Learning |
| Keyword(5) | PPDB |
| 1st Author's Name | Chiaki Yonekura |
| 1st Author's Affiliation | Keio University(Keio Univ.) |
| 2nd Author's Name | Masafumi Hagiwara |
| 2nd Author's Affiliation | Keio University(Keio Univ.) |
| Date | 2017-11-24 |
| Paper # | NC2017-28 |
| Volume (vol) | vol.117 |
| Number (no) | NC-325 |
| Page | pp.pp.7-12(NC), |
| #Pages | 6 |
| Date of Issue | 2017-11-17 (NC) |