| Presentation | 2019-09-28 A comparison of Japanese pretrained BERT models Naoki Shibayama, Rui Cao, Jing Bai, Wen Ma, Hiroyuki Shinnou, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | BERT is useful pre-training method for neural languages. There are pre-trained models for English which was used in a paper of BERT. Now, There are 3 Japanese pre-trained models which uses SentencePiece, Juman++ with BPE, or MeCab with NEologd to separate input texts by lexical. In this paper, we compared these 3 models with a sentiment analysis task as a subject. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | machine learning / BERT / pre-trained model / natural language processing |
| Paper # | NLC2019-24 |
| Date of Issue | 2019-09-20 (NLC) |
| Conference Information | |
| Committee | NLC / IPSJ-DC |
|---|---|
| Conference Date | 2019/9/27(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Future Corporation |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | The Thirteenth Text Analytics Symposium |
| Chair | Takeshi Sakaki(Hottolink) / Ryoji Akimoto(Toppan Printing) |
| Vice Chair | Mitsuo Yoshida(Toyohashi Univ. of Tech.) / Kazutaka Shimada(Kyushu Inst. of Tech.) |
| Secretary | Mitsuo Yoshida(Ryukoku Univ.) / Kazutaka Shimada(NTT) / (Future Univ. Hakodate) |
| Assistant | Takeshi Kobayakawa(NHK) / Hiroki Sakaji(Univ. of Tokyo) |
| Paper Information | |
| Registration To | Technical Committee on Natural Language Understanding and Models of Communication / Special Interest Group on Document Communication |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A comparison of Japanese pretrained BERT models |
| Sub Title (in English) | |
| Keyword(1) | machine learning |
| Keyword(2) | BERT |
| Keyword(3) | pre-trained model |
| Keyword(4) | natural language processing |
| 1st Author's Name | Naoki Shibayama |
| 1st Author's Affiliation | Ibaraki University(Ibaraki Univ.) |
| 2nd Author's Name | Rui Cao |
| 2nd Author's Affiliation | Ibaraki University(Ibaraki Univ.) |
| 3rd Author's Name | Jing Bai |
| 3rd Author's Affiliation | Ibaraki University(Ibaraki Univ.) |
| 4th Author's Name | Wen Ma |
| 4th Author's Affiliation | Ibaraki University(Ibaraki Univ.) |
| 5th Author's Name | Hiroyuki Shinnou |
| 5th Author's Affiliation | Ibaraki University(Ibaraki Univ.) |
| Date | 2019-09-28 |
| Paper # | NLC2019-24 |
| Volume (vol) | vol.119 |
| Number (no) | NLC-212 |
| Page | pp.pp.89-92(NLC), |
| #Pages | 4 |
| Date of Issue | 2019-09-20 (NLC) |