Presentation 2003/11/14
Research of dialog type communication based on facial image processing
Natsuko Nishi, Mutsumi Watanabe,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) The authors are developing a vision-based intension transfer technique by recognizing user's face expressions and movements, to help free and convenient communications with aged or disabled persons who find difficulties in talking, discriminating small character prints and operating keyboards by hands and fingers. In this paper, we report a prototype system, where layered daily conversations are successively selected by recognizing the transition in shape of user's mouth part using camera image sequences settled in front of the user. A method which automatically recognizes these four patterns by analyzing the intensity histogram data around the mouth part region is newly developed. The confirmation of a selection on the way is executed by detecting the open and shut movements of mouth though the temporal change in intensity histogram data. Experimental results of mouth part shape pattern recognition by twenty-five persons have shown the effectiveness of the method.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Human Interface / Multi-modal Conversation / Mouth Part Pattern Recognition / Intensity Histogram Analysis / Computer Vision
Paper # PRMU2003-160,HIP2003-66
Date of Issue

Conference Information
Committee HIP
Conference Date 2003/11/14(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Human Information Processing (HIP)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Research of dialog type communication based on facial image processing
Sub Title (in English)
Keyword(1) Human Interface
Keyword(2) Multi-modal Conversation
Keyword(3) Mouth Part Pattern Recognition
Keyword(4) Intensity Histogram Analysis
Keyword(5) Computer Vision
1st Author's Name Natsuko Nishi
1st Author's Affiliation Graduate School of Science and Engineering, Kagoshima University()
2nd Author's Name Mutsumi Watanabe
2nd Author's Affiliation Graduate School of Science and Engineering, Kagoshima University
Date 2003/11/14
Paper # PRMU2003-160,HIP2003-66
Volume (vol) vol.103
Number (no) 455
Page pp.pp.-
#Pages 6
Date of Issue