Presentation 2017-06-22
Toward Description of Gaits by Onomatopoeia Based on the Relationship between Phoneme and Body-Parts Movement
Hirotaka Kato, Takatsugu Hirayama, Yasutomo Kawanishi, Keisuke Doman, Ichiro Ide, Daisuke Deguchi, Hiroshi Murase,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Gaits are expressed by various onomatopoeias according to their appearance. It is said that onomatopoeia has sound-symbolism and its phoneme is strongly related to its impression. Thus, if the "phonetic-space" based on sound-symbolism can be corresponded with feature-space of gaits, subtle difference of gaits could be expressed as difference in phoneme. Since previous studies imply the relative body-parts movement is associated to the imagination of onomatopoeias when we look at gaits, in this report, we propose a method to convert the relative body-parts movements to onomatopoeias using a deep learning based regression model. Through experiments, we confirmed the effectiveness of the proposed method, and discussed the potential of description of an arbitrary gait by onomatopoeia.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Onomatopoeia / gait / phoneme / body-parts / sound-symbolism
Paper # PRMU2017-25,SP2017-1
Date of Issue 2017-06-15 (PRMU, SP)

Conference Information
Committee PRMU / SP
Conference Date 2017/6/22(2days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Shinichi Sato(NII) / Yoichi Yamashita(Ritsumeikan Univ.)
Vice Chair Hironobu Fujiyoshi(Chubu Univ.) / Yoshihisa Ijiri(Omron) / Hiroki Mori(Utsunomiya Univ.)
Secretary Hironobu Fujiyoshi(AIST) / Yoshihisa Ijiri(NAIST) / Hiroki Mori(Shizuoka Univ.)
Assistant Masato Ishii(NEC) / Yusuke Sugano(Osaka Univ.) / Kei Hashimoto(Nagoya Inst. of Tech.) / Satoshi Kobashikawa(NTT)

Paper Information
Registration To Technical Committee on Pattern Recognition and Media Understanding / Technical Committee on Speech
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Toward Description of Gaits by Onomatopoeia Based on the Relationship between Phoneme and Body-Parts Movement
Sub Title (in English)
Keyword(1) Onomatopoeia
Keyword(2) gait
Keyword(3) phoneme
Keyword(4) body-parts
Keyword(5) sound-symbolism
1st Author's Name Hirotaka Kato
1st Author's Affiliation Nagoya University(Nagoya Univ.)
2nd Author's Name Takatsugu Hirayama
2nd Author's Affiliation Nagoya University(Nagoya Univ.)
3rd Author's Name Yasutomo Kawanishi
3rd Author's Affiliation Nagoya University(Nagoya Univ.)
4th Author's Name Keisuke Doman
4th Author's Affiliation Chukyo University(Chukyo Univ.)
5th Author's Name Ichiro Ide
5th Author's Affiliation Nagoya University(Nagoya Univ.)
6th Author's Name Daisuke Deguchi
6th Author's Affiliation Nagoya University(Nagoya Univ.)
7th Author's Name Hiroshi Murase
7th Author's Affiliation Nagoya University(Nagoya Univ.)
Date 2017-06-22
Paper # PRMU2017-25,SP2017-1
Volume (vol) vol.117
Number (no) PRMU-105,SP-106
Page pp.pp.1-6(PRMU), pp.1-6(SP),
#Pages 6
Date of Issue 2017-06-15 (PRMU, SP)