Presentation 2018-03-13
Effect of video-to-audio synchronization in real-time speech rate converted conversations
Kazuki Osanai, Hiroko Tokunaga, Naoki Mukawa, Hiroto Saito,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Speech rate conversion (SRC) is a technology that converts playback speed of speeches while maintaining their vocal pitches. As an application of SRC, we develop visual-mediated SRC conversation system for supporting aurally impaired. In our previous studies, we have assumed that real-time video transmission is useful to share current situations of participants in conversation,even though voice and video are asynchronously conveyed. However, in the system speaker gaze information addressing next speaker may be erroneously recognized by hearers. In this study, we implemented a video conversation system that synchronizes video with SRC voice, then, performed experimental 3-party conversations. From the video recorded conversations we measured response latency and discuss the effects of video-to-audio synchronized conversations.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) speech rate conversion / audio-video synchronization / speaker's addressing / three party conversations
Paper # HCS2017-105
Date of Issue 2018-03-06 (HCS)

Conference Information
Committee HCS
Conference Date 2018/3/13(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Research Institute of Electrical Communication, Tohoku University
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Yukiko Nakano(Seikei Univ.)
Vice Chair Nobuyuki Watanabe(Kanazawa Inst. of Tech.) / Tomoo Inoue(Univ. of Tsukuba)
Secretary Nobuyuki Watanabe(Ritsumeikan Univ.) / Tomoo Inoue(Osaka Electro-Comm. Univ.)
Assistant Kazuki Takashima(Tohoku Univ.) / Ken Fujiwara(Osaka Univ. of Economic) / Kazunori Terada(Gifu Univ.) / Atsushi Kimura(Nihon Univ.)

Paper Information
Registration To Technical Committee on Human Communication Science
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Effect of video-to-audio synchronization in real-time speech rate converted conversations
Sub Title (in English)
Keyword(1) speech rate conversion
Keyword(2) audio-video synchronization
Keyword(3) speaker's addressing
Keyword(4) three party conversations
1st Author's Name Kazuki Osanai
1st Author's Affiliation Tokyo Denki University(Tokyo Denki Univ.)
2nd Author's Name Hiroko Tokunaga
2nd Author's Affiliation Tokyo Denki University(Tokyo Denki Univ.)
3rd Author's Name Naoki Mukawa
3rd Author's Affiliation Tokyo Denki University(Tokyo Denki Univ.)
4th Author's Name Hiroto Saito
4th Author's Affiliation Tokyo Denki University(Tokyo Denki Univ.)
Date 2018-03-13
Paper # HCS2017-105
Volume (vol) vol.117
Number (no) HCS-509
Page pp.pp.71-76(HCS),
#Pages 6
Date of Issue 2018-03-06 (HCS)