| Presentation | 2003/3/11 Selection of Attention Point for a Human-like Robot in Interaction with Users Bin CHEN, Mitsuhiko MEGURO, Mitsuhide KANEKO, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | For the higher flexibility in user-robot-interaction, it is necessary for a human-like robot to shift attention between the visual saliency region and the sound source that has been attended by its auditory perception. The selection of visual attention point cued by audio signal is useful for the robot to analyze the scene while users are interacting with it. For this purpose, an approach to direct visual attention toward a specific object based on the calculation of saliency map is proposed here. Firstly, a likelihood map representing sound source location is obtained by combination of multichannel audio signals and depth map in the scene. Since sometimes there is ambiguity in this localization according to the audio signals, the likelihood map is moreover combined with skin-color feature in the image because sound source localization is usally influenced by visual attention. Secondly, visual features arc binded to generate a saliency map to direct visual attention toward an object cued by auditory attention. Finally, an experiment is described to show that the proposed method can direct the robot to shift visual attention, which is close to the behavior of human being. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Multimodal interface / Selection of attention point / Auditory attention / Sound source localization / Visual attention, Motion |
| Paper # | HCS2002-56 |
| Date of Issue |
| Conference Information | |
| Committee | HCS |
|---|---|
| Conference Date | 2003/3/11(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Human Communication Science (HCS) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Selection of Attention Point for a Human-like Robot in Interaction with Users |
| Sub Title (in English) | |
| Keyword(1) | Multimodal interface |
| Keyword(2) | Selection of attention point |
| Keyword(3) | Auditory attention |
| Keyword(4) | Sound source localization |
| Keyword(5) | Visual attention, Motion |
| 1st Author's Name | Bin CHEN |
| 1st Author's Affiliation | Department of Electoric Engineering, The University of Eletro-Communications() |
| 2nd Author's Name | Mitsuhiko MEGURO |
| 2nd Author's Affiliation | Department of Electoric Engineering, The University of Eletro-Communications |
| 3rd Author's Name | Mitsuhide KANEKO |
| 3rd Author's Affiliation | Department of Electoric Engineering, The University of Eletro-Communications |
| Date | 2003/3/11 |
| Paper # | HCS2002-56 |
| Volume (vol) | vol.102 |
| Number (no) | 734 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |