| Presentation | 2014-12-16 Multimodal Voice Conversion using Weighted Features in Noisy Environments Kenta MASAKA, Ryo AIHARA, Tetsuya TAKIGUCHI, Yasuo ARIKI, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Voice conversion is a technique for converting specific information in speech while maintaining the other information, such as linguistic information. This technique has been applied to various tasks, for example, there are speaker conversion, emotion conversion and speaking assistance, etc. The GMM-based method is conventional VC method and widely used. In noisy environments, the GMM-based method cannot convert the speech well, because this method cannot model the noisy signal well. Therefore, we have been researched about a noise-robust VC method using Non Negative Matrix Factorization (NMF). In this paper, we propose a multimodal VC method that improves the noise robustness of our previous exemplar-based VC method. Furthermore, we introduce the combination weight between audio and visual features and formulate a new cost function in order to estimate the audio-visual exemplars. By using the joint audio-visual features as source features, the VC performance is improved compared to a previous audio-input exemplar-based VC method. The effectiveness of this method was confirmed by comparing it with that of the conventional audio input NMF-based method and the conventional GMM-based method. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | voice conversion / multimodal / image features / non-negative matrix factorization / noisy environments |
| Paper # | SP2014-116 |
| Date of Issue |
| Conference Information | |
| Committee | SP |
|---|---|
| Conference Date | 2014/12/8(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Speech (SP) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Multimodal Voice Conversion using Weighted Features in Noisy Environments |
| Sub Title (in English) | |
| Keyword(1) | voice conversion |
| Keyword(2) | multimodal |
| Keyword(3) | image features |
| Keyword(4) | non-negative matrix factorization |
| Keyword(5) | noisy environments |
| 1st Author's Name | Kenta MASAKA |
| 1st Author's Affiliation | Graduate School of System Informatics, Kobe University() |
| 2nd Author's Name | Ryo AIHARA |
| 2nd Author's Affiliation | Graduate School of System Informatics, Kobe University |
| 3rd Author's Name | Tetsuya TAKIGUCHI |
| 3rd Author's Affiliation | Organization of Advanced Science and Technology, Kobe University |
| 4th Author's Name | Yasuo ARIKI |
| 4th Author's Affiliation | Organization of Advanced Science and Technology, Kobe University |
| Date | 2014-12-16 |
| Paper # | SP2014-116 |
| Volume (vol) | vol.114 |
| Number (no) | 365 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |