| Presentation | 1995/10/16 FUSING MULTIMODAL INPUTS Loken-Kim Kyung-ho, Suguru Mizunashi, Mutsuko Tomokiyo, Laurel Fais, Tsuyoshi Morimoto, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The study reported here is an attempt to understand human verbal-gestural behavior in a multimodal bilingual setting. Specific issues addressed are: 1) What kind of deictic gestures people use in a machine-mediated condition, and how these differ from those used in a human-mediated condition, 2) How significant the use of gestures is in each condition, 3) How verbal and gestural behaviors are interrelated, and 4) What the implications of our findings are for a multimodal spoken language interpretation system. In this paper, we attempt to answer these questions, and introduce the architecture of a prototype multimodal user interface system. This system takes spoken language and deictic gestures and produces a combined semantic representation of the inputs. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | |
| Paper # | IE95-62 |
| Date of Issue |
| Conference Information | |
| Committee | IE |
|---|---|
| Conference Date | 1995/10/16(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Image Engineering (IE) |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | FUSING MULTIMODAL INPUTS |
| Sub Title (in English) | |
| Keyword(1) | |
| 1st Author's Name | Loken-Kim Kyung-ho |
| 1st Author's Affiliation | ATR Interpreting Telecommunications Research Laboratories() |
| 2nd Author's Name | Suguru Mizunashi |
| 2nd Author's Affiliation | ATR Interpreting Telecommunications Research Laboratories |
| 3rd Author's Name | Mutsuko Tomokiyo |
| 3rd Author's Affiliation | ATR Interpreting Telecommunications Research Laboratories |
| 4th Author's Name | Laurel Fais |
| 4th Author's Affiliation | ATR Interpreting Telecommunications Research Laboratories |
| 5th Author's Name | Tsuyoshi Morimoto |
| 5th Author's Affiliation | ATR Interpreting Telecommunications Research Laboratories |
| Date | 1995/10/16 |
| Paper # | IE95-62 |
| Volume (vol) | vol.95 |
| Number (no) | 292 |
| Page | pp.pp.- |
| #Pages | 9 |
| Date of Issue | |