Presentation 2012-02-09
Toward Effect of Difference of Facial Region on Lipreading Performance
Daisuke IKEDA, Kouichi KATSURADA, Yurie IRIBE, Tsuneo NITA,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Lipreading is the technique to recognize speaker's utterances from the motion with changing shape of the mouth. Although most of previous approaches to lipreading focus on the limited region of the mouth, utterances of some phonemes often accompany with the motion of surrounding areas together with the mouth movement. In this paper, we have compared four regions: (A) entire face region, (B) the region that the eyes and the nose are removed from the entire face region, (C) mouth and adjacent region, and (D) mouth region. Experimental results of word recognition and vowel/consonant recognition show that most of vowel recognition using the region (B) results in the highest performance, while different regions output the best performance on consonant recognition.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Lipreading / Facial Region / Active Appearance Models / Viseme
Paper # PRMU2011-190,SP2011-105
Date of Issue

Conference Information
Committee SP
Conference Date 2012/2/2(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Speech (SP)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Toward Effect of Difference of Facial Region on Lipreading Performance
Sub Title (in English)
Keyword(1) Lipreading
Keyword(2) Facial Region
Keyword(3) Active Appearance Models
Keyword(4) Viseme
1st Author's Name Daisuke IKEDA
1st Author's Affiliation Graduate School of Eng., Toyohashi Univ. of Tech.()
2nd Author's Name Kouichi KATSURADA
2nd Author's Affiliation Graduate School of Eng., Toyohashi Univ. of Tech.
3rd Author's Name Yurie IRIBE
3rd Author's Affiliation Graduate School of Eng., Toyohashi Univ. of Tech.
4th Author's Name Tsuneo NITA
4th Author's Affiliation Graduate School of Eng., Toyohashi Univ. of Tech.
Date 2012-02-09
Paper # PRMU2011-190,SP2011-105
Volume (vol) vol.111
Number (no) 431
Page pp.pp.-
#Pages 6
Date of Issue