| Presentation | 2015-06-18 Non-Audible Murmur Enhancement Method using Air- and Body-Conductive Microphones in Noisy Environments and its Evaluation Yusuke Tajiri, Kou Tanaka, Tomoki Toda, Graham Neubig, Sakriani Sakti, Satoshi Nakamura, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | As one of the silent speech interfaces, Non-Audible Murmur (NAM) microphone which can detect an extremely soft whispered voice has been developed. Although NAM is a promising medium for silent speech communication, its intelligibility and naturalness are significantly degraded by acoustic changes caused by body-conductive recording. To address this issue, several enhancement methods based on statistical voice conversion techniques have been proposed, and their effectiveness has been confirmed in quiet environments. However, it can be expected that NAM will be used not only in quiet, but also in noisy environments, and it is thus necessary to develop enhancement methods that will also work in these cases. In this report, we propose a framework for NAM enhancement using the NAM microphone and an air-conductive microphone. Experimental results demonstrate that the proposed framework is capable of significantly improving enhancement performance in noisy environments by considering not only the effect of noise contamination but also speaking style changes caused by the noise. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | silent speech communication / Non-Audible Murmur / statistical voice conversion / air- and body-conducted speech signal / Lombard effect |
| Paper # | PRMU2015-42,SP2015-11,WIT2015-11 |
| Date of Issue | 2015-06-11 (PRMU, SP, WIT) |
| Conference Information | |
| Committee | WIT / SP / ASJ-H / PRMU |
|---|---|
| Conference Date | 2015/6/18(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Kiyohiko Nunokawa(Tokyo International Univ.) / Kazunori Mano(Shibaura Inst. of Tech.) / Masato Akagi(北陸先端大) / Eisaku Maeda(NTT) |
| Vice Chair | Chikamune Wada(Kyushu Inst. of Tech.) / Norihide Kitaoka(Tokushima Univ.) / Shigeto Furukawa(NTT) / Shuji Senda(NEC) / Seiichi Uchida(Kyushu Univ.) |
| Secretary | Chikamune Wada(Nagoya Inst. of Tech.) / Norihide Kitaoka(AIST) / Shigeto Furukawa(Tsukuba Univ. of Tech.) / Shuji Senda(Tokyo City Univ.) / Seiichi Uchida(Kobe Univ.) |
| Assistant | Tomohiro Amemiya(NTT) / Takeaki Shionome(Tsukuba Univ. of Tech.) / Manabi Miyagi(Tsukuba Univ. of Tech.) / Takashi Nose(Tohoku Univ.) / Taichi Asami(NTT) / / Kazuaki Kondo(Kyoto Univ.) / Akisato Kimura(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Well-being Information Technology / Technical Committee on Speech / * / Technical Committee on Pattern Recognition and Media Understanding |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Non-Audible Murmur Enhancement Method using Air- and Body-Conductive Microphones in Noisy Environments and its Evaluation |
| Sub Title (in English) | |
| Keyword(1) | silent speech communication |
| Keyword(2) | Non-Audible Murmur |
| Keyword(3) | statistical voice conversion |
| Keyword(4) | air- and body-conducted speech signal |
| Keyword(5) | Lombard effect |
| 1st Author's Name | Yusuke Tajiri |
| 1st Author's Affiliation | Nara Institute of Science and Technology(NAIST) |
| 2nd Author's Name | Kou Tanaka |
| 2nd Author's Affiliation | Nara Institute of Science and Technology(NAIST) |
| 3rd Author's Name | Tomoki Toda |
| 3rd Author's Affiliation | Nara Institute of Science and Technology(NAIST) |
| 4th Author's Name | Graham Neubig |
| 4th Author's Affiliation | Nara Institute of Science and Technology(NAIST) |
| 5th Author's Name | Sakriani Sakti |
| 5th Author's Affiliation | Nara Institute of Science and Technology(NAIST) |
| 6th Author's Name | Satoshi Nakamura |
| 6th Author's Affiliation | Nara Institute of Science and Technology(NAIST) |
| Date | 2015-06-18 |
| Paper # | PRMU2015-42,SP2015-11,WIT2015-11 |
| Volume (vol) | vol.115 |
| Number (no) | PRMU-98,SP-99,WIT-100 |
| Page | pp.pp.59-64(PRMU), pp.59-64(SP), pp.59-64(WIT), |
| #Pages | 6 |
| Date of Issue | 2015-06-11 (PRMU, SP, WIT) |