| Presentation | 2009-02-20 A Study on Integration of Demonstrative Words with Gestures for Remote Captioning Ayaka ITO, Yoshinori TAKEUCHI, Noboru OHNISHI, Shigeyoshi Iizuka, Shinya NAKAJIMA, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Remote transcription is one of the communication support methods for hearing impaired students in a lecture. A transcriber watches the lecture as captured by camera and microphone at a remote place and transcribes what an instructor says using a PC. The transcription is then shown on a display screen in the classroom. A transcriber sometimes misses a pointing object when the instructor utters a demonstrative word. In this situation, he/she is not able to assign the demonstrative word with the pointing object. To solve this problem, we are developing a system to assign the demonstrative words with the pointing objects, which are automatically extracted from the behavior of the instructor. In this paper, we propose a method to detect demonstrative words by using speech recognition technology and to integrate the demonstrative words with gestures. We have conducted experiments by using recorded audio-visual signals from a real lecture. Experimental results show that the recall ratio can be achieved about 91% and the relevance ratio about 71%. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Remote Captioning / Demonstrative Words Extraction / Gestures Extraction / Integration |
| Paper # | WIT2008-57 |
| Date of Issue |
| Conference Information | |
| Committee | WIT |
|---|---|
| Conference Date | 2009/2/13(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Well-being Information Technology(WIT) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A Study on Integration of Demonstrative Words with Gestures for Remote Captioning |
| Sub Title (in English) | |
| Keyword(1) | Remote Captioning |
| Keyword(2) | Demonstrative Words Extraction |
| Keyword(3) | Gestures Extraction |
| Keyword(4) | Integration |
| 1st Author's Name | Ayaka ITO |
| 1st Author's Affiliation | Graduate School of Information Science, Nagoya University() |
| 2nd Author's Name | Yoshinori TAKEUCHI |
| 2nd Author's Affiliation | Graduate School of Information Science, Nagoya University |
| 3rd Author's Name | Noboru OHNISHI |
| 3rd Author's Affiliation | Graduate School of Information Science, Nagoya University |
| 4th Author's Name | Shigeyoshi Iizuka |
| 4th Author's Affiliation | NTT Network Service Systems Laboratories |
| 5th Author's Name | Shinya NAKAJIMA |
| 5th Author's Affiliation | School of Science and Engineering, Kokushikan University |
| Date | 2009-02-20 |
| Paper # | WIT2008-57 |
| Volume (vol) | vol.108 |
| Number (no) | 435 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |