| Presentation | 2002/10/24 A study on education tools with an animated talking agent for the hearing impaired Tomoko KITAMURA, Takayuki ARAI, Pamela Connors, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | An education tool with an animated talking agent named Baldi, that has been developed at CSLU (Center for Spoken Language Understanding at the Oregon Graduate Institute) is used at Tucker-Maxon (Portland, Oregon), a school for deaf children using oral language. Tutors like the CSLU Toolkit have not been used in Japan. In order to create a Japanese language animated agent, we have tried to map visemes of Mexican Spanish phonemes to the corresponding visemes of the Japanese phonemes. In this report, we proposed the ways in which these resources can be used effectively in Japan. We focused on the following areas: (1) We can obtain not only audible information but also visible information from an animated talking agent; (2) By combining an animated talking agent, speech synthesis, speech recognition, and images, we can make any kind of tutor with the CSLU Toolkit. The result of the examination showed that the CSLU Toolkit could be effective for training pronunciation, speech reading, and the acquisition of vocabulary in Japan if there were a Japanese voice, text to speech system, speech recognition and facial animation in Japanese within the CSLU Toolkit. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | animation / hearing impaired / speech reading / training of pronunciation |
| Paper # | WIT2002-53 |
| Date of Issue |
| Conference Information | |
| Committee | WIT |
|---|---|
| Conference Date | 2002/10/24(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Well-being Information Technology(WIT) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A study on education tools with an animated talking agent for the hearing impaired |
| Sub Title (in English) | |
| Keyword(1) | animation |
| Keyword(2) | hearing impaired |
| Keyword(3) | speech reading |
| Keyword(4) | training of pronunciation |
| 1st Author's Name | Tomoko KITAMURA |
| 1st Author's Affiliation | Department of Electrical and Electronics Eng., Sophia University() |
| 2nd Author's Name | Takayuki ARAI |
| 2nd Author's Affiliation | Department of Electrical and Electronics Eng., Sophia University |
| 3rd Author's Name | Pamela Connors |
| 3rd Author's Affiliation | Tucker-Maxon Oral School |
| Date | 2002/10/24 |
| Paper # | WIT2002-53 |
| Volume (vol) | vol.102 |
| Number (no) | 420 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |