Presentation 2022-08-26
Analysis of Relationships among Body Movement, Eye Information, and Physiological Indices in Emotion Expressions during Video Watching
Hayate Yamada, Fumiya Kobayashi, Souta Fujiwara, Saizo Aoyagi, Michiya Yamamoto,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) With the recent progress of human sensing and AI technologies, many studies on recognition and estimation of human internal states, such as emotion recognition from facial expression or emotion estimation from physiological indices such as heart rate, have been conducted. We have proposed original methods on emotion estimation using body movement based on Lavan Movement Analysis, and that using eye region information, and demonstrated the effectiveness of them. In this study, we analyzed relationships among body movement, eye region information, and physiological indices such as RRI, LF/HF and pupil diameter in emotional expression. First, we performed an experiment to measure various data in video watching task to evoke emotions in natural setting. Then, using the data, we calculated feature values and performed emotion estimation using machine learning and analyzed feature importances. As a result, we made clear the importance of Space and Weight of Lavan Movement Analysis, and the distance between eyebrows.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) emotion estimation / Lavan Movement Analysis / eye region information / physiological indices
Paper # HCS2022-36
Date of Issue 2022-08-19 (HCS)

Conference Information
Committee HCS
Conference Date 2022/8/26(2days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Tomoko Kanda(Osaka Inst. of Tech.)
Vice Chair Yugo Hayashi(Ritsumeikan Univ.) / Masashi Komori(Osaka Electro-Comm. Univ.)
Secretary Yugo Hayashi(Nihon Univ.) / Masashi Komori(Kanagawa Univ.)
Assistant HUANG HUNGHSUAN(Univ. of Fukuchiyama) / Jun Ichikawa(Shizuoka Univ.) / Kazuki Takashima(Tohoku Univ.) / Hiroto Saito(Tokyo Denki Univ.) / Ryo Ishii(NTT) / Yoshimasa Ohmoto(Shizuoka Univ.)

Paper Information
Registration To Technical Committee on Human Communication Science
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Analysis of Relationships among Body Movement, Eye Information, and Physiological Indices in Emotion Expressions during Video Watching
Sub Title (in English)
Keyword(1) emotion estimation
Keyword(2) Lavan Movement Analysis
Keyword(3) eye region information
Keyword(4) physiological indices
1st Author's Name Hayate Yamada
1st Author's Affiliation Kwansei Gakuin University(Kwansei Gakuin Univ.)
2nd Author's Name Fumiya Kobayashi
2nd Author's Affiliation Kwansei Gakuin University(Kwansei Gakuin Univ.)
3rd Author's Name Souta Fujiwara
3rd Author's Affiliation Kwansei Gakuin University(Kwansei Gakuin Univ.)
4th Author's Name Saizo Aoyagi
4th Author's Affiliation Komazawa University(Komazawa Univ.)
5th Author's Name Michiya Yamamoto
5th Author's Affiliation Kwansei Gakuin University(Kwansei Gakuin Univ.)
Date 2022-08-26
Paper # HCS2022-36
Volume (vol) vol.122
Number (no) HCS-166
Page pp.pp.3-8(HCS),
#Pages 6
Date of Issue 2022-08-19 (HCS)