| Presentation | 2000/12/14 An Adaptive Integration Method Based on Product HMM for Bi-modal Speech Recognition Kenichi KUMATANI, Satoshi NAKAMURA, Kiyohiro SHIKANO, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In recent years, there has been higher demands for Automatic Speech recognition system operated robustly in the various noisy environments. Therefore, many researchers have interest in the bimodal speech recognition by using not only the audio but also the visual information extracted from the sequence of the speaker's lip images. To realize the bimodal speech recognition, it is important to integrate effectively the audio and visual information. In integrating them, "(1) Synchronization of the audio and visual information, (2) Adaptability of the system, adjusting to changes in environment" are important issues. In the problem of (1), each feature of the speech and lip movement has the time lag, and has the correlation. For such the problem, we introduce the integration method using HMM composition. In (2), we have examined that the stream weight can be adaptively estimated by GPD algorithm. The evaluation experiment shows that the proposed method improves recognition accuracy of noisy speech. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Bi-modal speech recognition / HMM / Stream weight / MCE / GPD algorithm |
| Paper # | NLC2000-38,SP2000-86 |
| Date of Issue |
| Conference Information | |
| Committee | NLC |
|---|---|
| Conference Date | 2000/12/14(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Natural Language Understanding and Models of Communication (NLC) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | An Adaptive Integration Method Based on Product HMM for Bi-modal Speech Recognition |
| Sub Title (in English) | |
| Keyword(1) | Bi-modal speech recognition |
| Keyword(2) | HMM |
| Keyword(3) | Stream weight |
| Keyword(4) | MCE |
| Keyword(5) | GPD algorithm |
| 1st Author's Name | Kenichi KUMATANI |
| 1st Author's Affiliation | ATR Spoken Language Translation Research Laboratory : Nara Institute of Science and Technology() |
| 2nd Author's Name | Satoshi NAKAMURA |
| 2nd Author's Affiliation | ATR Spoken Language Translation Research Laboratory |
| 3rd Author's Name | Kiyohiro SHIKANO |
| 3rd Author's Affiliation | Nara Institute of Science and Technology |
| Date | 2000/12/14 |
| Paper # | NLC2000-38,SP2000-86 |
| Volume (vol) | vol.100 |
| Number (no) | 520 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |