| Presentation | 2012-03-29 Effect of Utterance Picture by Editing Mouth Movements on Speech Cognition Hiroyuki Endou, Daisaku Hayashi, Kaname Mochizuki, Hitoshi Ohnishi, Naoto Nakamura, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Hearing and vision are affecting each other, visual information may contribute to auditory information when we recognize a speech. This study examined the contribution of visual information of speaker's face to speech cognition. In the first experiment, we analyzed the changes of eye movements of the experimental participants during speech cognition. Results of this experiment showed that accuracy of repeat has improved by visual information and that participants tended to look at speaker's mouth when noise was added to voice. Next, we experimented the contribution of the movement of the mouth to speech cognition. For this experiment, we constructed a system to change movement amount of certain parts of the face picture and made materials by this system. However, this system had to attach markers for edit to speaker's face. In this experiment, participants tended to look at a marker. Then, we improved this system for which markers are not required, and experimented again using this system. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Audio-visual integration / Speech cognition / Image processing / Gaze tracking |
| Paper # | PRMU2011-257,HIP2011-85 |
| Date of Issue |
| Conference Information | |
| Committee | HIP |
|---|---|
| Conference Date | 2012/3/22(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Human Information Processing (HIP) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Effect of Utterance Picture by Editing Mouth Movements on Speech Cognition |
| Sub Title (in English) | |
| Keyword(1) | Audio-visual integration |
| Keyword(2) | Speech cognition |
| Keyword(3) | Image processing |
| Keyword(4) | Gaze tracking |
| 1st Author's Name | Hiroyuki Endou |
| 1st Author's Affiliation | Chiba Institute of Technology() |
| 2nd Author's Name | Daisaku Hayashi |
| 2nd Author's Affiliation | Chiba Institute of Technology |
| 3rd Author's Name | Kaname Mochizuki |
| 3rd Author's Affiliation | Teikyo University |
| 4th Author's Name | Hitoshi Ohnishi |
| 4th Author's Affiliation | The Open University of Japan |
| 5th Author's Name | Naoto Nakamura |
| 5th Author's Affiliation | Chiba Institute of Technology |
| Date | 2012-03-29 |
| Paper # | PRMU2011-257,HIP2011-85 |
| Volume (vol) | vol.111 |
| Number (no) | 500 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |