Presentation 2008-09-06
Efficient Lip Reading Method to Various Languages using Multiple Lip Regions
Takeshi SAITOH, Kazutoshi MORISHITA, Ryosuke KONISHI,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) The traditional researches targeted at only one language, and there is no research to refer the language and recognition method. Moreover, a lot of model-based methods use only an external lip or intraoral region, and tooth or tongue region is not reflected to the feature. This paper describes analysis of efficient lip reading method for various languages. First, we applies Active Appearance Model, and simultaneously extracts the external and internal lip contour. Then, the tooth and intraoral regions are detected. Various features from five regions are fed to the recognition process. We set four languages to be the recognition target, and recorded twenty words per each language. As the result, proposed trajectory feature based on three shape features, the area and aspect ratio of internal lip region, and area of intraoral region, was obtained the highest recognition rates of 93.6%, compared with the traditional methods and other regions.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) lip reading / word recognition / Japanese / Chinese / Mongolian / Nepalese
Paper # PRMU2008-76,HIP2008-76
Date of Issue

Conference Information
Committee PRMU
Conference Date 2008/8/29(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Pattern Recognition and Media Understanding (PRMU)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Efficient Lip Reading Method to Various Languages using Multiple Lip Regions
Sub Title (in English)
Keyword(1) lip reading
Keyword(2) word recognition
Keyword(3) Japanese
Keyword(4) Chinese
Keyword(5) Mongolian
Keyword(6) Nepalese
1st Author's Name Takeshi SAITOH
1st Author's Affiliation Tottori University()
2nd Author's Name Kazutoshi MORISHITA
2nd Author's Affiliation Tottori University
3rd Author's Name Ryosuke KONISHI
3rd Author's Affiliation Tottori University
Date 2008-09-06
Paper # PRMU2008-76,HIP2008-76
Volume (vol) vol.108
Number (no) 198
Page pp.pp.-
#Pages 6
Date of Issue