Presentation 2020-02-16
Estimation of the communication mood using facial expressions during conversation.
Hiroyuki Umemura, Tomomi Fujimura,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In the present study, we measured facial expressions during conversations had by two participants and investigated the relationship among expressed facial movement and feelings and mood during the conversation. In the experiment, two participants had three conversations; first one was freewheeling conversation, and in rests, either of participants mainly told a story about a topic. During the conversations, facial expression was measured by Kinect. After three conversations, participants watched videos of the conversations and evaluated the feelings for divided periods of conversation, which was divided into periods of every 30 sec. On the other hand, smile scores calculated from measured facial expression were given to these periods. Correlations between the feelings and smile scores suggested that occurrence of smile during conversation was different between male and female especially when the mood of conversation includes strain.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Conversation / facial expression recognition / empathy / communication
Paper # HIP2019-90
Date of Issue 2020-02-08 (HIP)

Conference Information
Committee HIP / ASJ-H
Conference Date 2020/2/15(2days)
Place (in Japanese) (See Japanese page)
Place (in English) IT Souzou-kan Bldg. (Naha)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Miyuki Kamachi(Kogakuin Univ.) / 小澤 賢司(山梨大)
Vice Chair Shuichi Sakamoto(Tohoku Univ.) / Yuji Wada(Ritsumeikan Univ.) / 鵜木 祐史(北陸先端大)
Secretary Shuichi Sakamoto(NICT) / Yuji Wada(NTT) / 鵜木 祐史(Nagoya Univ.)
Assistant Atsushi Wada(NICT) / Hidetoshi Kanaya(Ritsumeikan Univ.) / Yuki Yamada(Kyushu Univ.)

Paper Information
Registration To Technical Committee on Human Information Processing / Auditory Research Meeting
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Estimation of the communication mood using facial expressions during conversation.
Sub Title (in English)
Keyword(1) Conversation
Keyword(2) facial expression recognition
Keyword(3) empathy
Keyword(4) communication
1st Author's Name Hiroyuki Umemura
1st Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
2nd Author's Name Tomomi Fujimura
2nd Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
Date 2020-02-16
Paper # HIP2019-90
Volume (vol) vol.119
Number (no) HIP-414
Page pp.pp.67-71(HIP),
#Pages 5
Date of Issue 2020-02-08 (HIP)