| Presentation | 2018-03-20 [Poster Presentation] Do prosodic manual annotations matter for Japanese speech synthesis systems with WaveNet vocoder? Hieu-Thi Luong, Xin Wang, Junichi Yamagishi, Nobuyuki Nishizawa, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | We investigated the impact of noisy linguistics features on the performance of a Japanese neural net- work based speech synthesis system using a WaveNet vocoder. This investigation compared the ideal system using manually corrected linguistic features in training and test sets against a few other systems using corrupted linguistic features. Both subjective and objective results demonstrate that corrupted linguistic features, especially those in the test set, affected the system’s performance significantly in a statistical sense due to mismatched conditions between training and test sets. Interestingly, while an utterance-level Turing test shows that listeners had a difficult time to differentiate synthetic speech from natural speech, it further indicates that adding noise to the linguistic features in the training set partially can reduce the mismatched effect, regularize the model and help the system perform better when the test set linguistic features are noisy. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | speech synthesisdeep neural networkJapanese prosodyWaveNet |
| Paper # | EA2017-140,SIP2017-149,SP2017-123 |
| Date of Issue | 2018-03-12 (EA, SIP, SP) |
| Conference Information | |
| Committee | SIP / EA / SP / MI |
|---|---|
| Conference Date | 2018/3/19(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Speech, Engineering/Electro Acoustics, Signal Processing, and Related Topics [SIP, EA, SP]/ Medical Image Engineering, Analysis, Recognition, etc. [MI] |
| Chair | Masahiro Okuda(Univ. of Kitakyushu) / Suehiro Shimauchi(NTT) / Yoichi Yamashita(Ritsumeikan Univ.) / Kensaku Mori(Nagoya Univ.) |
| Vice Chair | Shogo Muramatsu(Niigata Univ.) / Naoyuki Aikawa(TUS) / Mitsunori Mizumachi(Kyutech) / Hiroki Mori(Utsunomiya Univ.) / Yoshiki Kawata(Tokushima Univ.) / Yuichi Kimura(Kinki Univ.) |
| Secretary | Shogo Muramatsu(Chiba Inst. of Tech.) / Naoyuki Aikawa(Takushoku Univ.) / Mitsunori Mizumachi(Akita Pref. Univ.) / Hiroki Mori(Shizuoka Inst. of Science and Tech.) / Yoshiki Kawata(Shizuoka Univ.) / Yuichi Kimura(Meijo Univ.) |
| Assistant | Masayoshi Nakamoto(Hiroshima Univ.ひろ) / TREVINO Jorge(Tohoku Univ.) / Nobutaka Ito(NTT) / Kei Hashimoto(Nagoya Inst. of Tech.) / Satoshi Kobashikawa(NTT) / Ryo Haraguchi(Univ. of Hyogo) / Yasushi Hirano(Yamaguchi Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Signal Processing / Technical Committee on Engineering Acoustics / Technical Committee on Speech / Technical Committee on Medical Imaging |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | [Poster Presentation] Do prosodic manual annotations matter for Japanese speech synthesis systems with WaveNet vocoder? |
| Sub Title (in English) | |
| Keyword(1) | speech synthesisdeep neural networkJapanese prosodyWaveNet |
| 1st Author's Name | Hieu-Thi Luong |
| 1st Author's Affiliation | National Institute of Informatics(NII) |
| 2nd Author's Name | Xin Wang |
| 2nd Author's Affiliation | National Institute of Informatics(NII) |
| 3rd Author's Name | Junichi Yamagishi |
| 3rd Author's Affiliation | National Institute of Informatics(NII) |
| 4th Author's Name | Nobuyuki Nishizawa |
| 4th Author's Affiliation | KDDI Research, Inc.(KDDI Research) |
| Date | 2018-03-20 |
| Paper # | EA2017-140,SIP2017-149,SP2017-123 |
| Volume (vol) | vol.117 |
| Number (no) | EA-515,SIP-516,SP-517 |
| Page | pp.pp.215-220(EA), pp.215-220(SIP), pp.215-220(SP), |
| #Pages | 6 |
| Date of Issue | 2018-03-12 (EA, SIP, SP) |