Presentation 2006/3/15
Finding the Correspondence of Audio-Visual Events by Object Manipulation
Kento NISHIBORI, Yoshinori TAKEUCHI, Tetsuya MATSUMOTO, Hiroaki KUDO, Noboru OHNISHI,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) We propose a method for finding the correspondence of audio-visual events by manipulating a object. The method uses general rules of the grouping rules in Gestalt psychology,: i.e. "simultaneity" and "similarity" of sound onsets and movement direction changes in images with motor command signal. We conducted an experiment in which a robot shaked an object by its hand under a noisy environment and observed resulting sounds and movements by a microphone and a camera, respectively. As a result, the proposed method succeeded in the sound relating to the robot manipulation.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Sensor fusion / Sensor and motor integration / Active observation / Simultaneity
Paper # HIP2005-155
Date of Issue

Conference Information
Committee HIP
Conference Date 2006/3/15(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Human Information Processing (HIP)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Finding the Correspondence of Audio-Visual Events by Object Manipulation
Sub Title (in English)
Keyword(1) Sensor fusion
Keyword(2) Sensor and motor integration
Keyword(3) Active observation
Keyword(4) Simultaneity
1st Author's Name Kento NISHIBORI
1st Author's Affiliation Graduate School of Information Science, Nagoya University()
2nd Author's Name Yoshinori TAKEUCHI
2nd Author's Affiliation Graduate School of Information Science, Nagoya University:Bio-Mimetic Control Research Center
3rd Author's Name Tetsuya MATSUMOTO
3rd Author's Affiliation Graduate School of Information Science, Nagoya University
4th Author's Name Hiroaki KUDO
4th Author's Affiliation Graduate School of Information Science, Nagoya University
5th Author's Name Noboru OHNISHI
5th Author's Affiliation Graduate School of Information Science, Nagoya University
Date 2006/3/15
Paper # HIP2005-155
Volume (vol) vol.105
Number (no) 682
Page pp.pp.-
#Pages 6
Date of Issue