| Presentation | 1998/3/13 A Study on Method of Gesture Generation for Multimodal Dialogue System Yuji ISHIBASHI, Tsuneo KAGAWA, Tsutomu ENDO, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | We are now developing a problem solving and knowledge acquisition system based on co-reference between drill texts and dialogue with a teacher, focusing on first grade mathematics. The system offers multiple input and output channels such as natural language, gestures, and graphics. This paper discusses a method of generating gestures in cooperation with utterance generation. A gesture in this case means pointing of objects on the drill text or drawing pictures. It is represented by the movement of a pen, and is displayed as 2-D graphical data. First, the architecture of the dialogue-based problem solving system is summarized. Then the pointer sequence and gesture command are defined in order to describe the structure and meaning of gesture. Next, the extraction procedures of commands and pointer sequence are presented. Lastly, results of the simulation are shown. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | multimodal dialogue / natural language generation / gesture generation / problem solving / user interface |
| Paper # | |
| Date of Issue |
| Conference Information | |
| Committee | NLC |
|---|---|
| Conference Date | 1998/3/13(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Natural Language Understanding and Models of Communication (NLC) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A Study on Method of Gesture Generation for Multimodal Dialogue System |
| Sub Title (in English) | |
| Keyword(1) | multimodal dialogue |
| Keyword(2) | natural language generation |
| Keyword(3) | gesture generation |
| Keyword(4) | problem solving |
| Keyword(5) | user interface |
| 1st Author's Name | Yuji ISHIBASHI |
| 1st Author's Affiliation | Department of Computer Science and Intelligent Systems Faculty of Engineering, Oita University() |
| 2nd Author's Name | Tsuneo KAGAWA |
| 2nd Author's Affiliation | Department of Computer Science and Intelligent Systems Faculty of Engineering, Oita University |
| 3rd Author's Name | Tsutomu ENDO |
| 3rd Author's Affiliation | Department of Computer Science and Intelligent Systems Faculty of Engineering, Oita University |
| Date | 1998/3/13 |
| Paper # | |
| Volume (vol) | vol.97 |
| Number (no) | 594 |
| Page | pp.pp.- |
| #Pages | 8 |
| Date of Issue | |