Presentation 1995/10/19
ATR's Multimodal Interpreting Telecommunications : Implementation of Multimodal User Interface
Kyung-ho Loken-Kim, Suguru Mizunashi, Tsuyoshi Morimoto,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In a multimodal system, because visual objects are present, users have the option of incorporating them into their communication through some form of deictic gesturing. In person to person speech, deictic gestures eliminate the need for a lengthy definite description and simplify the dialogues. It has been hypothesized therefore that they will have a favorable influence upon spoken language interpreting systems because they will reduce the speech recognition workload. Gestures are, however, in many cases, ambiguous, incomplete, and sometimes impossible to understand without verbal and contextual information. In our previous study, we classified deictic gestures used in a map-based direction finding task, and reported how verbal and gestural behaviors are interrelated. We also introduced the architecture of a prototype multimodal user interface system which was developed based on our findings. In this paper, we introduce an improved version of the multimodal user interface system.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) multimodal interaction / spoken language interpretation
Paper # SP95-64
Date of Issue

Conference Information
Committee SP
Conference Date 1995/10/19(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Speech (SP)
Language ENG
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) ATR's Multimodal Interpreting Telecommunications : Implementation of Multimodal User Interface
Sub Title (in English)
Keyword(1) multimodal interaction
Keyword(2) spoken language interpretation
1st Author's Name Kyung-ho Loken-Kim
1st Author's Affiliation ATR Interpreting Telecommunications Research Laboratories()
2nd Author's Name Suguru Mizunashi
2nd Author's Affiliation ATR Interpreting Telecommunications Research Laboratories
3rd Author's Name Tsuyoshi Morimoto
3rd Author's Affiliation ATR Interpreting Telecommunications Research Laboratories
Date 1995/10/19
Paper # SP95-64
Volume (vol) vol.95
Number (no) 318
Page pp.pp.-
#Pages 8
Date of Issue