Presentation 2014-06-14
Automatic Generation of Metaphoric Gesture for a Human-like Embodied Agent and its Application to Learning Materials
Naoya SHIOIRI, Toshiki HANAWA, Dai HASEGAWA, Shinichi SHIRAKAWA, Hiroshi SAKUTA, Kouzou OHARA,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) We develop metaphoric gesture generation mechanism and investigate the effects of metaphoric gesture performed by Pedagogical Conversational Agent (PCA) in a educational system. To automatically generate the gesture, we used a prediction model created by a machine learning technique based on multi-modal data extracted from lecture videos. We also developed an online education material performed by PCA by using HTML+WebGL. The effects of the metaphoric gesture were tested in one-way factorial between-subject design (manually created gestures vs. automatically created gesture vs. no gesture). Prom the results of 45 participants, we observed that both the manually and automatically created gestures reinforced learners' focus on visual and graphical understanding of the material, and confirmed that their visual and graphical understanding can be improved.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Human-like Embodied Agent / Gesture / Automatic Generation / Learning Effect
Paper # ET2014-17
Date of Issue

Conference Information
Committee ET
Conference Date 2014/6/7(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Educational Technology (ET)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Automatic Generation of Metaphoric Gesture for a Human-like Embodied Agent and its Application to Learning Materials
Sub Title (in English)
Keyword(1) Human-like Embodied Agent
Keyword(2) Gesture
Keyword(3) Automatic Generation
Keyword(4) Learning Effect
1st Author's Name Naoya SHIOIRI
1st Author's Affiliation Graduate School of Science and Engineering, Aoyama Gakuin University()
2nd Author's Name Toshiki HANAWA
2nd Author's Affiliation College of Science and Engineering, Aoyama Gakuin University
3rd Author's Name Dai HASEGAWA
3rd Author's Affiliation College of Science and Engineering, Aoyama Gakuin University
4th Author's Name Shinichi SHIRAKAWA
4th Author's Affiliation College of Science and Engineering, Aoyama Gakuin University
5th Author's Name Hiroshi SAKUTA
5th Author's Affiliation College of Science and Engineering, Aoyama Gakuin University
6th Author's Name Kouzou OHARA
6th Author's Affiliation College of Science and Engineering, Aoyama Gakuin University
Date 2014-06-14
Paper # ET2014-17
Volume (vol) vol.114
Number (no) 82
Page pp.pp.-
#Pages 6
Date of Issue