| Presentation | 2004/11/11 An evaluation of multimodal impression by presenting an emotional voice and an expression face simultaneously Yousuke HIRUMSA, Yoshihiro ADACHI, Shigeo MORISIMA, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | An emotion information is essential in human-human communication. An emotion in speech and that in face are transimitted to others without inconsistency in natural conversation scene. In a life-like agent system. because of immaturity of emotion synthesis technique, a natural synthetic emotional voice and a very realistic emotional facial expression cannot always be realized. So sometimes an impression of emotion becomes unnatural or weak. In this paper, several combination of stimuli between natural emotional voice, synthetic emotional voice and video cantured emotional face are presented to subjects and which modality is more influential in each emotion condition is estimated. In experiment, hearing test for natural voice and synthetic voice is given and then emotional labeling to speech stimuli is performed. Then video captured emotional facial expression is presented without audio and subjective categorization of emotion is performed. And finally, multimodal evaluation is done with several combination of audio and video including inconsistent emotion pair sometimes. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Life-like Agent / Emotion Speech / Emotion Face Image / Speech Conversion / Intonation Conversion / Audio Visual Effect |
| Paper # | HCS2004-23 |
| Date of Issue |
| Conference Information | |
| Committee | HCS |
|---|---|
| Conference Date | 2004/11/11(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Human Communication Science (HCS) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | An evaluation of multimodal impression by presenting an emotional voice and an expression face simultaneously |
| Sub Title (in English) | |
| Keyword(1) | Life-like Agent |
| Keyword(2) | Emotion Speech |
| Keyword(3) | Emotion Face Image |
| Keyword(4) | Speech Conversion |
| Keyword(5) | Intonation Conversion |
| Keyword(6) | Audio Visual Effect |
| 1st Author's Name | Yousuke HIRUMSA |
| 1st Author's Affiliation | Science & Engineering, Waseda University() |
| 2nd Author's Name | Yoshihiro ADACHI |
| 2nd Author's Affiliation | Faculty of Engineering, Seikei University |
| 3rd Author's Name | Shigeo MORISIMA |
| 3rd Author's Affiliation | Science & Engineering, Waseda University |
| Date | 2004/11/11 |
| Paper # | HCS2004-23 |
| Volume (vol) | vol.104 |
| Number (no) | 445 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |