| Presentation | 1995/10/19 Dialogue Processing in Problem Solving and Knowledge Acquisition - Cooperation with Figure Operation Tsuneo KAGAWA, Hidehiro OHKI, Tsutomu ENDO, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | A dialogue plays an important role in learning how to so1ve a problem and forming a concept. We are now developing a prototype system which tries to so1ve problems of first grade mathematics while it has a dialogue with a teacher. Only natural language is used as communication modality. People frequently supplement natural language comunication with simultanious coordinated pointing gestures and drawing. In this paper, we discuss multimodal communication in problem so1ving and knowledge acquisition process. First, the problem so1ving system is summarized, and an example of multimodal dialogue is given, focusing on referent resolution in mathematical problems. Next, a method of combining natural language with pointing gestures and drawing on visual aids is proposed. Finally, an algorithm of interpreting the gestures and drawings in cooperation with natural language utterances is presented. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | multimodal dialogue / knowledge acquisition / problem solving / natural language procesing / picture recognition |
| Paper # | NLC95-36,PRU95-141 |
| Date of Issue |
| Conference Information | |
| Committee | NLC |
|---|---|
| Conference Date | 1995/10/19(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Natural Language Understanding and Models of Communication (NLC) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Dialogue Processing in Problem Solving and Knowledge Acquisition - Cooperation with Figure Operation |
| Sub Title (in English) | |
| Keyword(1) | multimodal dialogue |
| Keyword(2) | knowledge acquisition |
| Keyword(3) | problem solving |
| Keyword(4) | natural language procesing |
| Keyword(5) | picture recognition |
| 1st Author's Name | Tsuneo KAGAWA |
| 1st Author's Affiliation | Department of Computer Science and Intelligent Systems, Oita University() |
| 2nd Author's Name | Hidehiro OHKI |
| 2nd Author's Affiliation | Department of Computer Science and Intelligent Systems, Oita University |
| 3rd Author's Name | Tsutomu ENDO |
| 3rd Author's Affiliation | Department of Computer Science and Intelligent Systems, Oita University |
| Date | 1995/10/19 |
| Paper # | NLC95-36,PRU95-141 |
| Volume (vol) | vol.95 |
| Number (no) | 320 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |