Presentation 2001/5/11
Generating Character Gesture from Learning the Relation Between Sound and Real Gesture
Masanobu Yamamoto, Masato Hoshi, Ko Shimoyama, Tatsuya Ikarashi,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) This paper proposes a novel approach for a sound-driven gesture animation. In speech, singing a song and listening music, a human body produces natural gesture. We make a computer learn a mapping from the sound to the gesture. The gesture is measured from image sequence as a set of angles at joints of the human body. Since the obtained gesture and the corresponding sound are time-varing signals, we can solve the sound-to-gesture mapping by techniques for the system identification. According to an input sound, the mapping can produce a natural gesture of an animation character.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Voice / Sound / Motion capture / Human pose / Learning / Generating gesture
Paper # PRMU2001-12
Date of Issue

Conference Information
Committee PRMU
Conference Date 2001/5/11(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Pattern Recognition and Media Understanding (PRMU)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Generating Character Gesture from Learning the Relation Between Sound and Real Gesture
Sub Title (in English)
Keyword(1) Voice
Keyword(2) Sound
Keyword(3) Motion capture
Keyword(4) Human pose
Keyword(5) Learning
Keyword(6) Generating gesture
1st Author's Name Masanobu Yamamoto
1st Author's Affiliation Department of Information Engineering, Niigata University()
2nd Author's Name Masato Hoshi
2nd Author's Affiliation Department of Information Engineering, Niigata University
3rd Author's Name Ko Shimoyama
3rd Author's Affiliation Department of Information Engineering, Niigata University
4th Author's Name Tatsuya Ikarashi
4th Author's Affiliation Department of Information Engineering, Niigata University
Date 2001/5/11
Paper # PRMU2001-12
Volume (vol) vol.101
Number (no) 58
Page pp.pp.-
#Pages 6
Date of Issue