| Presentation | 2001/3/15 AUTOMATIC FACE TRACKING AND MODEL MATCH-MOVE PROCESSING IN VIDEO SEQUENCE USING 3D PERSONAL FACE MODEL Takafumi Misawa, Kazumasa Murai, Satoshi Nakamura, Shigeo Morishima, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Videophone with automatic voice translation are expected to be widely used in the near future, which may race the problem without lip-synchronized speaking face image translation. In this paper, we propose a method to track motion of the face from the video image, that is one of the key technologies for speaking image translation. Almost all the old tracking algorithms aim to detect feature points of the face. However, these algorithms had problems, such as blurring of a feature point between frames and occlusion of the hidden feature point by rotation of the head, and so on. we propose a method which detects movement and rotation of the head given the 3D shape of the face, by template matching using a 3D personal face wire-frame model. The evaluation experiments are carried out with the measured reference data of the head. The proposed method achieves 0.28 angle error in average. This result confirms effectiveness of the proposed method. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Image translation / 3D personal model / Template matching / Automatic face tracking |
| Paper # | MVE2000-112 |
| Date of Issue |
| Conference Information | |
| Committee | MVE |
|---|---|
| Conference Date | 2001/3/15(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Media Experience and Virtual Environment (MVE) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | AUTOMATIC FACE TRACKING AND MODEL MATCH-MOVE PROCESSING IN VIDEO SEQUENCE USING 3D PERSONAL FACE MODEL |
| Sub Title (in English) | |
| Keyword(1) | Image translation |
| Keyword(2) | 3D personal model |
| Keyword(3) | Template matching |
| Keyword(4) | Automatic face tracking |
| 1st Author's Name | Takafumi Misawa |
| 1st Author's Affiliation | Faculty of Engineering, Seikei University:ATR, Spoken Language Translation Research Laboratories() |
| 2nd Author's Name | Kazumasa Murai |
| 2nd Author's Affiliation | ATR, Spoken Language Translation Research Laboratories |
| 3rd Author's Name | Satoshi Nakamura |
| 3rd Author's Affiliation | ATR, Spoken Language Translation Research Laboratories |
| 4th Author's Name | Shigeo Morishima |
| 4th Author's Affiliation | Faculty of Engineering, Seikei University |
| Date | 2001/3/15 |
| Paper # | MVE2000-112 |
| Volume (vol) | vol.100 |
| Number (no) | 716 |
| Page | pp.pp.- |
| #Pages | 8 |
| Date of Issue | |