| Presentation | 2009/10/24 Human Computer Interaction by Means of Video-based Tongue Protrusion Detection Luis Ricardo SAPAICO, Hamid LAGA, Masayuki NAKAJIMA, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | We propose a human-computer communication method based on tongue protrusion. We consider that the normal place of the tongue is inside the oral cavity. Therefore, the appearance of the tongue on the surface of the mouth will communicate the intention of the user to generate an event. This appearance will be detected by our system, by analyzing the changes occurring in the video signal coming from a regular web camera. Three templates are used: a mouth template; and, a left-half mouth sub-template and a right-half mouth sub-template, which were obtained by dividing the mouth template by half. We use the Normalized Correlation Coefficient (NCC) for tracking the mouth region at each frame, and also for comparing the similarity between the new tracked mouth and the original template. When the NCC falls behind a threshold, we assume that the change in the mouth is caused by the tongue protrusion. Then, we analyze both the Left and Right templates NCCs, and we use this similarity measure for detecting whether the tongue was protruded to the left or right side of the mouth. Subsequently, having a positive detection will generate a simple task in the computer. Experiments show that the system is adaptable to different users by being calibrated according to the user's physical characteristics, and that the communication method is easy to learn and perform. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | |
| Paper # | HCS2009-62 |
| Date of Issue |
| Conference Information | |
| Committee | HCS |
|---|---|
| Conference Date | 2009/10/24(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Human Communication Science (HCS) |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Human Computer Interaction by Means of Video-based Tongue Protrusion Detection |
| Sub Title (in English) | |
| Keyword(1) | |
| 1st Author's Name | Luis Ricardo SAPAICO |
| 1st Author's Affiliation | Tokyo Institute of Technology() |
| 2nd Author's Name | Hamid LAGA |
| 2nd Author's Affiliation | Tokyo Institute of Technology |
| 3rd Author's Name | Masayuki NAKAJIMA |
| 3rd Author's Affiliation | Tokyo Institute of Technology |
| Date | 2009/10/24 |
| Paper # | HCS2009-62 |
| Volume (vol) | vol.109 |
| Number (no) | 264 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |