| Presentation | 1996/9/27 A Method of Gesture Analysis using Linguistic Information Tsuneo KAGAWA, Yumi WATANABE, Tsutomu ENDO, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Recognizing gesture is one of the most important technology to develop a multi-modal communication system. In this paper, a method of gesture analysis in a dialogue-based problem solving system is proposed. The system can communicate with a teacher to solve ploblems in a first grade mathematical drill text. It must recognize gesture of the teacher to associate picture models in the system with words in the teacher's utterance. First, the architecture of the system is shown. Then, gesture analysis and description in our sub-system in which mouse is used as a pointing device are described. Next the correspondence between gesture analysis and dialogue processing as well as the interpreting procedure of the gesture are presented. Lastly, a result of the simulation is shown. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | dialogue / natural language understanding / gesture analysis / multi-modal communication |
| Paper # | TL96-5 |
| Date of Issue |
| Conference Information | |
| Committee | TL |
|---|---|
| Conference Date | 1996/9/27(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Thought and Language (TL) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A Method of Gesture Analysis using Linguistic Information |
| Sub Title (in English) | |
| Keyword(1) | dialogue |
| Keyword(2) | natural language understanding |
| Keyword(3) | gesture analysis |
| Keyword(4) | multi-modal communication |
| 1st Author's Name | Tsuneo KAGAWA |
| 1st Author's Affiliation | Department of Computer Science and Intelligent Systems, Oita University() |
| 2nd Author's Name | Yumi WATANABE |
| 2nd Author's Affiliation | Department of Computer Science and Intelligent Systems, Oita University |
| 3rd Author's Name | Tsutomu ENDO |
| 3rd Author's Affiliation | Department of Computer Science and Intelligent Systems, Oita University |
| Date | 1996/9/27 |
| Paper # | TL96-5 |
| Volume (vol) | vol.96 |
| Number (no) | 271 |
| Page | pp.pp.- |
| #Pages | 10 |
| Date of Issue | |