| Presentation | 2019-10-27 Mouth shape recognition for patient with intractable neurological diseases Yuya Nakamura, Takeshi Saitoh, Kazuyuki Itoh, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Patients with intractable neuropathy may use a mouth-shape character-based communication as an alternative to communication when speech, writing, and PC are not available. Mouth-shape character-based communication requires not only a speaker but also a supporter, however it may be difficult to read the mouth shape due to the skill of the supporter. Communication support system that automatically recognize the mouth shape of a speaker is expected. In this study, our aim is to develop the whole support system, and this paper works on mouth shape recognition of five Japanese vowels. We introduce motion-based features by optical flow in addition to the geometric features used in previous studies. We collect speech scenes of patients with intractable neurological diseases and apply the proposed method to verify their recognition accuracy. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Mouth shape recognition / patient with intractable neurological diseases / optical flow |
| Paper # | SP2019-33,WIT2019-32 |
| Date of Issue | 2019-10-19 (SP, WIT) |
| Conference Information | |
| Committee | WIT / SP |
|---|---|
| Conference Date | 2019/10/26(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Daiichi Institute of Technology |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Daisuke Wakatsuki(Tsukuba Univ. of Tech.) / Hisashi Kawai(NICT) |
| Vice Chair | Shinji Sakou(Nagoya Inst. of Tech.) / Akinobu Ri(Nagoya Inst. of Tech.) |
| Secretary | Shinji Sakou(Saitama Industrial Tech. Center) / Akinobu Ri(Teikyo Univ.) |
| Assistant | Manabi Miyagi(Tsukuba Univ. of Tech.) / Minako Hosono(AIST) / Aki Sugano(Nagoya Univ.) / Tomoki Koriyama(Tokyo Inst. of Tech.) / Yusuke Ijima(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Well-being Information Technology / Technical Committee on Speech |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Mouth shape recognition for patient with intractable neurological diseases |
| Sub Title (in English) | |
| Keyword(1) | Mouth shape recognition |
| Keyword(2) | patient with intractable neurological diseases |
| Keyword(3) | optical flow |
| 1st Author's Name | Yuya Nakamura |
| 1st Author's Affiliation | Kyushu Institute of Technology(Kyutech) |
| 2nd Author's Name | Takeshi Saitoh |
| 2nd Author's Affiliation | Kyushu Institute of Technology(Kyutech) |
| 3rd Author's Name | Kazuyuki Itoh |
| 3rd Author's Affiliation | National Rehabilitation Center for Persons with Disabilities(NRCPD) |
| Date | 2019-10-27 |
| Paper # | SP2019-33,WIT2019-32 |
| Volume (vol) | vol.119 |
| Number (no) | SP-250,WIT-251 |
| Page | pp.pp.93-98(SP), pp.93-98(WIT), |
| #Pages | 6 |
| Date of Issue | 2019-10-19 (SP, WIT) |