Presentation 2007/11/29
Detection/tolerance thresholds of audio-visual asynchrony between time-expanded speech and talker's moving face in spoken word recognition
Shun NUMAHATA, Shuichi SAKAMOTO, Akihiro TANAKA, Atsushi IMAI, Tohru TAKAGI, Yo-iti SUZUKI,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Speech-rate conversion techniques are useful to support speech recognition, especially for aged person. However, if only the speech-rate is converted, there arises asynchrony between the auditory and visual information. In this study, we investigated the effect of detection/tolerance thresholds of audio-visual asynchrony between time-expanded speech and talker's moving face in spoken word recognition. In the experiment, words were presented under following two conditions : (1) asynchrony by time-expanded speech and (2) simple timing shift. The results showed that detection/tolerance thresholds were greater in asynchrony condition than that in timing shift. Moreover the effect of these thresholds to word recognition decreased while shortening the length of word.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) speech-rate conversion / time-expanded speech / talker's moving face / asynchrony perception / detection threshold / tolerance threshold
Paper # HIP2007-139
Date of Issue

Conference Information
Committee HIP
Conference Date 2007/11/29(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Human Information Processing (HIP)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Detection/tolerance thresholds of audio-visual asynchrony between time-expanded speech and talker's moving face in spoken word recognition
Sub Title (in English)
Keyword(1) speech-rate conversion
Keyword(2) time-expanded speech
Keyword(3) talker's moving face
Keyword(4) asynchrony perception
Keyword(5) detection threshold
Keyword(6) tolerance threshold
1st Author's Name Shun NUMAHATA
1st Author's Affiliation Research Institute of Electrical Communication and Graduate School of Information Sciences()
2nd Author's Name Shuichi SAKAMOTO
2nd Author's Affiliation Research Institute of Electrical Communication and Graduate School of Information Sciences
3rd Author's Name Akihiro TANAKA
3rd Author's Affiliation Department of Psychology, University of Tokyo
4th Author's Name Atsushi IMAI
4th Author's Affiliation NHK Science and Technical Research Laboratories
5th Author's Name Tohru TAKAGI
5th Author's Affiliation NHK Science and Technical Research Laboratories
6th Author's Name Yo-iti SUZUKI
6th Author's Affiliation Research Institute of Electrical Communication and Graduate School of Information Sciences
Date 2007/11/29
Paper # HIP2007-139
Volume (vol) vol.107
Number (no) 369
Page pp.pp.-
#Pages 6
Date of Issue