| Presentation | 2001/7/11 Automatic Synthesis of Facial Expression in Speech Naruhiro KIMURA, Shozo SATO, Taizo UMEZAKI, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In this paper, we proposed a facial expression synthesis method in speech using the Kohonen neural network(KNN) and investigate quantitatively synchronization of generated facial expression series with real speech sounds. The basis of this method is to utilize facial expression series in speech of vowel to vowel generated from the still images in speech of 5 vowels and non-speech by KNN. In synchronization with speech sound, the stabile section and the changing section of facial expression are detected by the power of speech, and a fixed facial expression image is allocated in the stabile section and facial expression series is placed with the same time interval in the changing section. In the evaluation experiment, two different synchronizing methods are compared. As this result, it is confirmed that the proposed method can represent more real face expression than the other method. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Kohonen neural network model / facial expression / facial expression series in speech of vowel / synchronization with speech sound |
| Paper # | IE2001-19,PRMU2001-39,MVE2001-18 |
| Date of Issue |
| Conference Information | |
| Committee | MVE |
|---|---|
| Conference Date | 2001/7/11(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Media Experience and Virtual Environment (MVE) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Automatic Synthesis of Facial Expression in Speech |
| Sub Title (in English) | |
| Keyword(1) | Kohonen neural network model |
| Keyword(2) | facial expression |
| Keyword(3) | facial expression series in speech of vowel |
| Keyword(4) | synchronization with speech sound |
| 1st Author's Name | Naruhiro KIMURA |
| 1st Author's Affiliation | Faculty of Engineering, Chubu University() |
| 2nd Author's Name | Shozo SATO |
| 2nd Author's Affiliation | Business and Engineering Research Center, Nihon Fukushi University |
| 3rd Author's Name | Taizo UMEZAKI |
| 3rd Author's Affiliation | Faculty of Engineering, Chubu University |
| Date | 2001/7/11 |
| Paper # | IE2001-19,PRMU2001-39,MVE2001-18 |
| Volume (vol) | vol.101 |
| Number (no) | 204 |
| Page | pp.pp.- |
| #Pages | 8 |
| Date of Issue | |