Presentation 2011-08-27
Info-concierge: Multi-modal Interaction System using Mind Probing
Takatsugu HIRAYAMA, Yasuyuki SUMI, Tatsuya KAWAHARA, Takashi MATSUYAMA,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) To fill the widened gap between the exploding information world and individual human knowledge, we have investigated a multi-modal interaction strategy called Mind Probing so that the system proactively acts on the user and then estimates his/her internal state by analyzing the reaction. We have also developed a system Info-concierge which can probe latent interest of the user and make him/her aware of it, and proactively provide sensible information. The system incorporates the core techniques of Mind Probing using speech and gaze recognition. In this paper, we present the interaction flow, the core techniques, and the field trial of Info-concierge.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Gaze tracking / Speech recognition / Interest estimation / Recommendation / Awareness
Paper # HCS2011-37
Date of Issue

Conference Information
Committee HCS
Conference Date 2011/8/19(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Human Communication Science (HCS)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Info-concierge: Multi-modal Interaction System using Mind Probing
Sub Title (in English)
Keyword(1) Gaze tracking
Keyword(2) Speech recognition
Keyword(3) Interest estimation
Keyword(4) Recommendation
Keyword(5) Awareness
1st Author's Name Takatsugu HIRAYAMA
1st Author's Affiliation Grad. School of Information Science, Nagoya University()
2nd Author's Name Yasuyuki SUMI
2nd Author's Affiliation Hakodate Future University
3rd Author's Name Tatsuya KAWAHARA
3rd Author's Affiliation Grad. School of Informatics, Kyoto University
4th Author's Name Takashi MATSUYAMA
4th Author's Affiliation Grad. School of Informatics, Kyoto University
Date 2011-08-27
Paper # HCS2011-37
Volume (vol) vol.111
Number (no) 190
Page pp.pp.-
#Pages 6
Date of Issue