| Presentation | 2009-10-30 Nasal sound generation and pitch control for the real-time hand to speech system A. KUNIKOSHI, Y. QIAO, N. MINEMATSU, K. HIROSE, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | When individuals with speaking disabilities, dysarthrics, try to communicate using speech, they often have to use speech synthesizers which require them to type word symbols or sound symbols. This input method often makes realtime operations difficult and dysarthric users fail to control the flow of conversation. In this study, we are developing a new and novel speech synthesizer where not symbol inputs but hand motions are used to generate speech. In recent years, statistical voice conversion techniques have been proposed based on space mapping between given parallel data sequences. By applying these methods, a hand space and a vowel space is mapped and a converter from hand motions to vowel transitions is developed. It has been reported that the proposed method is effective enough to generate Japanese five vowels. In this paper, we discuss expansion of this system to consonant generation and pitch control. For the former, two methods are examined: waveform concatenation and space mapping for consonant sounds are discussed. For the latter, pitch control is realized using posture of the arm measured by a magnetic sensor. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Dysarthria / speech production / hand motions / media conversion / arrangement of gestures and vowels |
| Paper # | SP2009-56,WIT2009-62 |
| Date of Issue |
| Conference Information | |
| Committee | WIT |
|---|---|
| Conference Date | 2009/10/22(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Well-being Information Technology(WIT) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Nasal sound generation and pitch control for the real-time hand to speech system |
| Sub Title (in English) | |
| Keyword(1) | Dysarthria |
| Keyword(2) | speech production |
| Keyword(3) | hand motions |
| Keyword(4) | media conversion |
| Keyword(5) | arrangement of gestures and vowels |
| 1st Author's Name | A. KUNIKOSHI |
| 1st Author's Affiliation | Grad. School of Eng., The Univ. of Tokyo() |
| 2nd Author's Name | Y. QIAO |
| 2nd Author's Affiliation | Grad. School of Info. Sci. and Tech., The Univ. of Tokyo |
| 3rd Author's Name | N. MINEMATSU |
| 3rd Author's Affiliation | Grad. School of Info. Sci. and Tech., The Univ. of Tokyo |
| 4th Author's Name | K. HIROSE |
| 4th Author's Affiliation | Grad. School of Info. Sci. and Tech., The Univ. of Tokyo |
| Date | 2009-10-30 |
| Paper # | SP2009-56,WIT2009-62 |
| Volume (vol) | vol.109 |
| Number (no) | 260 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |