Presentation 2008/3/15
Multimodal Recollection and Association for the Conversation Robot
Tomoaki NAKAMURA, Takeshi YASUI, Takayuki NAGAI,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) It is thought that one of the differences for the thought process in conversation between robots and humans originates in the point that humans use perceptual information, which is associated with words, and associative recall. In this report, a conversation robot using multimodal sensory information from a camera, microphones and so on is studied. The proposed dialogue system is based on perceptually-grounded concepts, which are generated with multimodal information, and the multimodal recollection and association in order to mimic the human though processes. The multimodal recollection and association mechanism is affected by the attention mechanism and internal states of the robot. Since the robot has its own embodiment, it can take a physical action as a part of conversation. This fact is very important not only because the robot can gain additional haptic information but also it adds greater variety to the communication. The proposed system is implemented on a robot platform and the behavior of the robot is explained with some conversation examples to validate the proposed mechanism.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Conversation / robot / multimodality / remember / association
Paper # HIP2007-160
Date of Issue

Conference Information
Committee HIP
Conference Date 2008/3/15(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Human Information Processing (HIP)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Multimodal Recollection and Association for the Conversation Robot
Sub Title (in English)
Keyword(1) Conversation
Keyword(2) robot
Keyword(3) multimodality
Keyword(4) remember
Keyword(5) association
1st Author's Name Tomoaki NAKAMURA
1st Author's Affiliation Dept. of Electronic Engineering, The University of Electro-Communications()
2nd Author's Name Takeshi YASUI
2nd Author's Affiliation Dept. of Electronic Engineering, The University of Electro-Communications
3rd Author's Name Takayuki NAGAI
3rd Author's Affiliation Dept. of Electronic Engineering, The University of Electro-Communications
Date 2008/3/15
Paper # HIP2007-160
Volume (vol) vol.107
Number (no) 553
Page pp.pp.-
#Pages 6
Date of Issue