| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2020-09-10 15:50 chiVe: Towards Industrial-strength Japanese Word Vector Resources -- Constructing and Improving Embedding with Tokenizer "Sudachi" and Ultra-large-scale Web-based Corpus "NWJC" -- Sorami Hisamoto, Takashi Yamamura, Akihiro Katsuta, Yuto Takebayashi, Kazuma Takaoka, Yoshitaka Uchida (WAP), Teruaki Oka, Masayuki Asahara (NINJAL)  NLC2020-9 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | Pretrained word embeddings (word vectors, distributed representations) are fundamental and important components for recent neural network based natural language processing. However, there are not many resources available for Japanese language that is useful for the practical purpose. “chiVe” is our attempt to construct useful word embedding resource, using morphological analyzer “Sudachi” that provides multi-granular tokenization results, and 10 billion words scale corpus “NWJC”. We made this resource publicly available under Apache 2.0 license that allows commercial usage ( https://github.com/WorksApplications/chiVe ). In this article, we describe the overview of the project, and introduce our ongoing work to further improve the resources which includes handling Out-of-Vocabulary words, utilizing the synonym resources, and adapting to specific domains. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Distributed Representation / Morphological Analysis / Out-of-Vocabulary / Synonym / Domain Adaptation / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 120, no. 166, NLC2020-9, pp. 40-45, Sept. 2020. | |
| Paper # | NLC2020-9 | |
| Date of Issue | 2020-09-03 (NLC) | |
| ISSN | Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | NLC2020-9 |
|
| Conference Information | |
| Committee | NLC |
| Conference Date | 2020-09-10 - 2020-09-10 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | The Sixteenth Text Analytics Symposium |
| Paper Information | |
| Registration To | NLC |
| Conference Code | 2020-09-NLC |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | chiVe: Towards Industrial-strength Japanese Word Vector Resources |
| Sub Title (in English) | Constructing and Improving Embedding with Tokenizer "Sudachi" and Ultra-large-scale Web-based Corpus "NWJC" |
| Keyword(1) | Distributed Representation |
| Keyword(2) | Morphological Analysis |
| Keyword(3) | Out-of-Vocabulary |
| Keyword(4) | Synonym |
| Keyword(5) | Domain Adaptation |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Sorami Hisamoto |
| 1st Author's Affiliation | Works Applications (WAP) |
| 2nd Author's Name | Takashi Yamamura |
| 2nd Author's Affiliation | Works Applications (WAP) |
| 3rd Author's Name | Akihiro Katsuta |
| 3rd Author's Affiliation | Works Applications (WAP) |
| 4th Author's Name | Yuto Takebayashi |
| 4th Author's Affiliation | Works Applications (WAP) |
| 5th Author's Name | Kazuma Takaoka |
| 5th Author's Affiliation | Works Applications (WAP) |
| 6th Author's Name | Yoshitaka Uchida |
| 6th Author's Affiliation | Works Applications (WAP) |
| 7th Author's Name | Teruaki Oka |
| 7th Author's Affiliation | National Institute for Japanese Language and Linguistics (NINJAL) |
| 8th Author's Name | Masayuki Asahara |
| 8th Author's Affiliation | National Institute for Japanese Language and Linguistics (NINJAL) |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | 1 |
| Date Time | 2020-09-10 15:50:00 |
| Presentation Time | 25 |
| Registration for | NLC |
| Paper # | IEICE-NLC2020-9 |
| Volume (vol) | IEICE-120 |
| Number (no) | no.166 |
| Page | pp.40-45 |
| #Pages | IEICE-6 |
| Date of Issue | IEICE-NLC-2020-09-03 |
[Return to Top Page]