| Presentation | 1997/11/20 Speech Perception from Face and Voice : Audiovisual interaction Kaoru Sekiyama, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The McGurk effect (McGurk & MacDonald, 1976) is an audiovisual illusion which demonstrates that visual articulatory information is integrated with auditory information during speech perception. This paper describes what kind of cues visible speech conveys and how visual information is integrated with auditory information depending on one's native language (or culture), proficiency of a second language, and talkers' characteristics. Compared with native speakers of American English, native speakers of Japanese and Chinese were less susceptible to the McGurk effect, indicating a manner of processing of heavy weighting on auditory information. Examining the data of the Chinese subjects who were residing in Japan, the McGurk effect got stronger as the subjects lived in Japan longer, suggesting that acquisition of a second language promotes the use of visual cues. The last experiment examined which of auditory and visual speech information is a more determining factor of the size of the McGurk effect. By cross-dubbing faces and voices of two talkers, one hard to induce the McGurk effect and the other easy, it was suggested that auditory information is more determining. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | audiovisual speech perception / the McGurk effect / multimodal integration |
| Paper # | HIP97-21 |
| Date of Issue |
| Conference Information | |
| Committee | HIP |
|---|---|
| Conference Date | 1997/11/20(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Human Information Processing (HIP) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Speech Perception from Face and Voice : Audiovisual interaction |
| Sub Title (in English) | |
| Keyword(1) | audiovisual speech perception |
| Keyword(2) | the McGurk effect |
| Keyword(3) | multimodal integration |
| 1st Author's Name | Kaoru Sekiyama |
| 1st Author's Affiliation | Department of Psychology Kanazawa University() |
| Date | 1997/11/20 |
| Paper # | HIP97-21 |
| Volume (vol) | vol.97 |
| Number (no) | 388 |
| Page | pp.pp.- |
| #Pages | 8 |
| Date of Issue | |