Presentation 2005-10-28
Recognition of Facial Expression Playing a Role of Dialogue Control
Kei NAKAJIMA, Shinya FUJIE, Yosuke MATSUSAKA, Tetsunori KOBAYASHI,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) If the system can recognize the user's mental status from his facial expression in the user-system conversation, the system can utilize it for the adequate control of conversation. In this paper, we investigate the facial actions which can be utilized for conversation control, and propose a recognition algorithm for them. From observing conversations between a robot and a user, we can see that the user often shows three facial expressions : "smile", "grimace", and "eyes wide open". These expressions can be used as a sign of misunderstandings and a measure of mental pleasantness of the users. It is also shown that these expressions appear particularly in the mouth, cheek, middle of forehead, eyes and eyebrows. Experimental results of extracting these facial parts and recognizing these facial expressions, 85% accuracy was achieved.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) facial expresion recognition / spoken dialogue / dialogue robot
Paper # PRMU2005-94
Date of Issue

Conference Information
Committee PRMU
Conference Date 2005/10/21(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Pattern Recognition and Media Understanding (PRMU)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Recognition of Facial Expression Playing a Role of Dialogue Control
Sub Title (in English)
Keyword(1) facial expresion recognition
Keyword(2) spoken dialogue
Keyword(3) dialogue robot
1st Author's Name Kei NAKAJIMA
1st Author's Affiliation Faculty of Engineering, Waseda University()
2nd Author's Name Shinya FUJIE
2nd Author's Affiliation Faculty of Engineering, Waseda University
3rd Author's Name Yosuke MATSUSAKA
3rd Author's Affiliation Faculty of Engineering, Waseda University
4th Author's Name Tetsunori KOBAYASHI
4th Author's Affiliation Faculty of Engineering, Waseda University
Date 2005-10-28
Paper # PRMU2005-94
Volume (vol) vol.105
Number (no) 375
Page pp.pp.-
#Pages 6
Date of Issue