Presentation 2011-09-23
Model for Estimating Empathy/Antipathy from Facial Expressions and Gaze in Group Meetings and Its Evaluation
Shiro KUMANO, Kazuhiro OTSUKA, Dan MIKAMI, Junji YAMATO,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) This paper presents a novel research framework for understanding interpersonal emotion which is aroused, transmitted, and shared between people through their interactions. We focus on empathy and antipathy, which are the key elements in building interpersonal relationship and consensus. Research on peoples' emotion faces significant issues since the ground truth is ambiguous. While the traditional viewpoint assumes the presence of a unique ground truth, our approach considers that the inherent uncertainty is in fact essential. Accordingly, we introduce a viewpoint that objectively identifies a fact by a collection of external observations. Also, in communication, other important viewpoint is how emotion is conveyed from people to other people and interpreted by them, rather than what it really is. From these viewpoints, we consider empathy/antipathy between a pair with external interpretations, mathematically model the relationship between them and participants' nonverbal behaviors, especially facial expressions and gaze, and try to reveal the fact by making, evaluating and refining the model. Specifically, by regarding the interpretations as a probability distribution, we formulate a inference problem of estimating it as a posterior probability distribution given by these nonverbal behaviors. We finally propose an evaluation method to assess the model by comparing the estimated distributions with the distributions of observers' interpretations. This paper describes the proposed framework with initial experiments, and discusses its potential.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) conversation / emotion / empathy / antipathy / external interpretation / distribution / facial expression
Paper # HCS2011-52
Date of Issue

Conference Information
Committee HCS
Conference Date 2011/9/16(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Human Communication Science (HCS)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Model for Estimating Empathy/Antipathy from Facial Expressions and Gaze in Group Meetings and Its Evaluation
Sub Title (in English)
Keyword(1) conversation
Keyword(2) emotion
Keyword(3) empathy
Keyword(4) antipathy
Keyword(5) external interpretation
Keyword(6) distribution
Keyword(7) facial expression
1st Author's Name Shiro KUMANO
1st Author's Affiliation NTT Communication Science Laboratories()
2nd Author's Name Kazuhiro OTSUKA
2nd Author's Affiliation NTT Communication Science Laboratories
3rd Author's Name Dan MIKAMI
3rd Author's Affiliation NTT Communication Science Laboratories
4th Author's Name Junji YAMATO
4th Author's Affiliation NTT Communication Science Laboratories
Date 2011-09-23
Paper # HCS2011-52
Volume (vol) vol.111
Number (no) 214
Page pp.pp.-
#Pages 6
Date of Issue