| Presentation | 2018-03-20 [Poster Presentation] Development of NU Voice Conversion System 2018 Patrick Lumban Tobing, Yi-Chiao Wu, Tomoki Hayashi, Kazuhiro Kobayashi, Tomoki Toda, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | This paper presents NU (Nagoya University) voice conversion (VC) system for the HUB task of VoiceConversion Challenge 2018 (VCC 2018). The design of the NU VC system can basically be separated intotwo modules consisting of a speech parameters conversion module and a waveform processing module. Inthe speech parameters conversion module, deep learning framework is deployed in estimating spectral parameters of a target speaker given those of a source speaker. Specifically, the deep neural network (DNN) and deep mixture density network (DMDN) are used as the deep model structure. In the waveform processing module, given the estimated spectral parameters and linearly transformed F0 parameters, the converted waveform is generated by using a WaveNet-based vocoder system. To use the WaveNet-based vocoder, there are several generation flows based on analysis-synthesis framework to obtain the speech parameters set, on which a system selection process is performed to select the best one in an utterance-wise manner. The results of VCC 2018 ranked the NU VC system in the 2nd place with an overall of 3.48 mean opinion score (MOS) for speech quality and 83% accuracy for speaker similarity. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | voice conversion / deep learning models / WaveNet vocoder / waveform modeling |
| Paper # | EA2017-138,SIP2017-147,SP2017-121 |
| Date of Issue | 2018-03-12 (EA, SIP, SP) |
| Conference Information | |
| Committee | SIP / EA / SP / MI |
|---|---|
| Conference Date | 2018/3/19(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Speech, Engineering/Electro Acoustics, Signal Processing, and Related Topics [SIP, EA, SP]/ Medical Image Engineering, Analysis, Recognition, etc. [MI] |
| Chair | Masahiro Okuda(Univ. of Kitakyushu) / Suehiro Shimauchi(NTT) / Yoichi Yamashita(Ritsumeikan Univ.) / Kensaku Mori(Nagoya Univ.) |
| Vice Chair | Shogo Muramatsu(Niigata Univ.) / Naoyuki Aikawa(TUS) / Mitsunori Mizumachi(Kyutech) / Hiroki Mori(Utsunomiya Univ.) / Yoshiki Kawata(Tokushima Univ.) / Yuichi Kimura(Kinki Univ.) |
| Secretary | Shogo Muramatsu(Chiba Inst. of Tech.) / Naoyuki Aikawa(Takushoku Univ.) / Mitsunori Mizumachi(Akita Pref. Univ.) / Hiroki Mori(Shizuoka Inst. of Science and Tech.) / Yoshiki Kawata(Shizuoka Univ.) / Yuichi Kimura(Meijo Univ.) |
| Assistant | Masayoshi Nakamoto(Hiroshima Univ.ひろ) / TREVINO Jorge(Tohoku Univ.) / Nobutaka Ito(NTT) / Kei Hashimoto(Nagoya Inst. of Tech.) / Satoshi Kobashikawa(NTT) / Ryo Haraguchi(Univ. of Hyogo) / Yasushi Hirano(Yamaguchi Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Signal Processing / Technical Committee on Engineering Acoustics / Technical Committee on Speech / Technical Committee on Medical Imaging |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | [Poster Presentation] Development of NU Voice Conversion System 2018 |
| Sub Title (in English) | |
| Keyword(1) | voice conversion |
| Keyword(2) | deep learning models |
| Keyword(3) | WaveNet vocoder |
| Keyword(4) | waveform modeling |
| 1st Author's Name | Patrick Lumban Tobing |
| 1st Author's Affiliation | Nagoya University(Nagoya Univ.) |
| 2nd Author's Name | Yi-Chiao Wu |
| 2nd Author's Affiliation | Nagoya University(Nagoya Univ.) |
| 3rd Author's Name | Tomoki Hayashi |
| 3rd Author's Affiliation | Nagoya University(Nagoya Univ.) |
| 4th Author's Name | Kazuhiro Kobayashi |
| 4th Author's Affiliation | Nagoya University(Nagoya Univ.) |
| 5th Author's Name | Tomoki Toda |
| 5th Author's Affiliation | Nagoya University/JST PRESTO(Nagoya Univ./JST PRESTO) |
| Date | 2018-03-20 |
| Paper # | EA2017-138,SIP2017-147,SP2017-121 |
| Volume (vol) | vol.117 |
| Number (no) | EA-515,SIP-516,SP-517 |
| Page | pp.pp.203-208(EA), pp.203-208(SIP), pp.203-208(SP), |
| #Pages | 6 |
| Date of Issue | 2018-03-12 (EA, SIP, SP) |