Presentation 2009/10/24
Human Computer Interaction by Means of Video-based Tongue Protrusion Detection
Luis Ricardo SAPAICO, Hamid LAGA, Masayuki NAKAJIMA,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) We propose a human-computer communication method based on tongue protrusion. We consider that the normal place of the tongue is inside the oral cavity. Therefore, the appearance of the tongue on the surface of the mouth will communicate the intention of the user to generate an event. This appearance will be detected by our system, by analyzing the changes occurring in the video signal coming from a regular web camera. Three templates are used: a mouth template; and, a left-half mouth sub-template and a right-half mouth sub-template, which were obtained by dividing the mouth template by half. We use the Normalized Correlation Coefficient (NCC) for tracking the mouth region at each frame, and also for comparing the similarity between the new tracked mouth and the original template. When the NCC falls behind a threshold, we assume that the change in the mouth is caused by the tongue protrusion. Then, we analyze both the Left and Right templates NCCs, and we use this similarity measure for detecting whether the tongue was protruded to the left or right side of the mouth. Subsequently, having a positive detection will generate a simple task in the computer. Experiments show that the system is adaptable to different users by being calibrated according to the user's physical characteristics, and that the communication method is easy to learn and perform.
Keyword(in Japanese) (See Japanese page)
Keyword(in English)
Paper # HCS2009-62
Date of Issue

Conference Information
Committee HCS
Conference Date 2009/10/24(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Vice Chair

Paper Information
Registration To Human Communication Science (HCS)
Language ENG
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Human Computer Interaction by Means of Video-based Tongue Protrusion Detection
Sub Title (in English)
1st Author's Name Luis Ricardo SAPAICO
1st Author's Affiliation Tokyo Institute of Technology()
2nd Author's Name Hamid LAGA
2nd Author's Affiliation Tokyo Institute of Technology
3rd Author's Name Masayuki NAKAJIMA
3rd Author's Affiliation Tokyo Institute of Technology
Date 2009/10/24
Paper # HCS2009-62
Volume (vol) vol.109
Number (no) 264
Page pp.pp.-
#Pages 6
Date of Issue