Presentation 2022-10-06
Optimal Nodding Exaggeration Factor\in a Real-Time Conversation Entrainment System
Taichi Kubota, Monica Perusquia-Hernandez, Naoya Isoyama, Hideaki Uchiyama, Kiyoshi Kiyokawa,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In this study, we aim to realize a system that exaggerates the speaker's nodding in non-face-to-face communication to trigger the speaker's entrainment. As a first step, we investigate the exaggeration factor that strengthens entrainment in our proposed real-time nodding exaggeration system. This system can exaggerate the pitch angle of nodding by a specified magnification factor while reflecting speaker-specific facial features and facial expression changes in real time, just like a general video conferencing system. We conducted dialogue experiments with nine pairs of participants in three conditions: 1.0x, 1.4x, and 2.0x exaggeration factors. The evaluation was conducted by synchronous analysis of nodding, a questionnaire, and a post-hoc interview. The results showed that the standard deviation of the phase difference, which indicates the degree of synchronization, tended to be smaller at an exaggeration factor of 1.0 and 1.4, compared to 2.0. No participant noticed that the nodding was exaggerated. This suggests that the system may promote entrainment without making the speaker aware of the difference.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) conversation support / nodding / synchronization / pause in conversation
Paper # MVE2022-23
Date of Issue 2022-09-29 (MVE)

Conference Information
Committee MVE / VRSJ-SIG-MR / IPSJ-EC / HI-SIG-DeMO / VRSJ-SIG-CS
Conference Date 2022/10/6(2days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Kiyoshi Kiyokawa(NAIST)
Vice Chair Sumaru Niida(KDDI Research)
Secretary Sumaru Niida(NAIST) / (DNP) / (Univ. of ToKyo) / (NTT)
Assistant Hidehiko Shishido(Univ. of Tsukuba) / Atsushi Nakazawa(Kyoto Univ.) / Naoya Tojo(KDDI Research) / Naoki Hagiyama(NTT)

Paper Information
Registration To Technical Committee on Media Experience and Virtual Environment / SIG-MR / Special Interest Group on Entertainment Computing / Special Interest Group on De-vice Media Oriented UI / SIG-CS
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Optimal Nodding Exaggeration Factor\in a Real-Time Conversation Entrainment System
Sub Title (in English)
Keyword(1) conversation support
Keyword(2) nodding
Keyword(3) synchronization
Keyword(4) pause in conversation
1st Author's Name Taichi Kubota
1st Author's Affiliation Nara Institute of Science and Technology(NAIST)
2nd Author's Name Monica Perusquia-Hernandez
2nd Author's Affiliation Nara Institute of Science and Technology(NAIST)
3rd Author's Name Naoya Isoyama
3rd Author's Affiliation Nara Institute of Science and Technology(NAIST)
4th Author's Name Hideaki Uchiyama
4th Author's Affiliation Nara Institute of Science and Technology(NAIST)
5th Author's Name Kiyoshi Kiyokawa
5th Author's Affiliation Nara Institute of Science and Technology(NAIST)
Date 2022-10-06
Paper # MVE2022-23
Volume (vol) vol.122
Number (no) MVE-200
Page pp.pp.30-35(MVE),
#Pages 6
Date of Issue 2022-09-29 (MVE)