| Presentation | 2001/5/11 A Method of Pen Motion Generation for Multimodal Dialogue System Tsuneo KAGAWA, Tsutomu ENDO, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | We are now developing a problem solving system based on co-reference between drill texts and dialogue with a teacher, focusing on first grade mathematics. The system offers multiple input and output channels such as natural language, gestures, and graphics. This paper discusses a method of generating pen motions in cooperation with utterance generation. A gesture in this case means pointing of objects on the drill text or drawing pictures. It is represented by the movement of a pen, and is displayed as 3-D graphical data. We present Pen Motion Frame for a meaning description of gesture. First, the architecture of our system is summarized. Then the pointer sequence and gesture frame are defined in order to describe the structure and meaning of gesture. Lastly, results of the simulation are shown. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | multimodal dialogue / natural language generation / gesture generation / problem solving / user interface |
| Paper # | TL2001-2 |
| Date of Issue |
| Conference Information | |
| Committee | TL |
|---|---|
| Conference Date | 2001/5/11(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Thought and Language (TL) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A Method of Pen Motion Generation for Multimodal Dialogue System |
| Sub Title (in English) | |
| Keyword(1) | multimodal dialogue |
| Keyword(2) | natural language generation |
| Keyword(3) | gesture generation |
| Keyword(4) | problem solving |
| Keyword(5) | user interface |
| 1st Author's Name | Tsuneo KAGAWA |
| 1st Author's Affiliation | Faculty of Engineering, Oita University() |
| 2nd Author's Name | Tsutomu ENDO |
| 2nd Author's Affiliation | Faculty of Computer Science and Systems Engineering, Kyushu Institute of Technology |
| Date | 2001/5/11 |
| Paper # | TL2001-2 |
| Volume (vol) | vol.101 |
| Number (no) | 61 |
| Page | pp.pp.- |
| #Pages | 8 |
| Date of Issue | |