Presentation | 2023-10-14 Non-contact eye-switch using eye movement based on pupil center detection Ploywow Nhuthep, Ryuto Tamai, Takeshi Saitoh, Kazuyuki Itoh, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | Our aim is to develop an eye switch that uses eye movements as a means of supporting communication in ALS patients. In previous research, we developed a eyeglasses-type switch using a contact-type wearable camera. However, there remained the issue of putting a burden on users when wearing the device. Therefore, in this research, we will develop a non-contact eye-switch that uses a stationary infrared camera and an infrared LED. The difference in internal processing from previous studies is that the captured image is an eye image in the previous study, whereas in this study it is a facial image that shows the user's entire face. Therefore, we introduce a process to extract the eye ROI by applying face and facial landmark detection in the image processing section. When we collected data from six healthy subjects and conducted a quantitative evaluation, we found that although the accuracy was lower than in previous studies, it was still accurate enough for practical use. Furthermore, we implemented a real-time system and confirmed its operation. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | ALS patient / eye-switch / pupil center point detection / eye contour points detection / CNN |
Paper # | SP2023-27,WIT2023-18 |
Date of Issue | 2023-10-07 (SP, WIT) |
Conference Information | |
Committee | WIT / SP / IPSJ-SLP |
---|---|
Conference Date | 2023/10/14(1days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | Kyushu Institute of Technology |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | Speech and Well-being Information Technology, etc. |
Chair | Takeaki Shionome(Teikyo Univ.) / Tomoki Toda(Nagoya Univ.) / Tomoki Toda(Nagoya Univ.) |
Vice Chair | Shinji Sakou(Nagoya Inst. of Tech.) |
Secretary | Shinji Sakou(AIST) / (Univ. of Toyama) / (Tsukuba Univ. of Tech.) |
Assistant | Tsubasa Uchida(NHK) / Teppei Miura(National Inst. of Techn. Toyota College) / Ryo Aihara(Mitsubishi Electric) / Daisuke Saito(Univ. of Tokyo) |
Paper Information | |
Registration To | Technical Committee on Well-being Information Technology / Technical Committee on Speech / Special Interest Group on Spoken Language Processing |
---|---|
Language | JPN |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | Non-contact eye-switch using eye movement based on pupil center detection |
Sub Title (in English) | |
Keyword(1) | ALS patient |
Keyword(2) | eye-switch |
Keyword(3) | pupil center point detection |
Keyword(4) | eye contour points detection |
Keyword(5) | CNN |
1st Author's Name | Ploywow Nhuthep |
1st Author's Affiliation | Kyushu Institute of Technology(Kyutech) |
2nd Author's Name | Ryuto Tamai |
2nd Author's Affiliation | Kyushu Institute of Technology(Kyutech) |
3rd Author's Name | Takeshi Saitoh |
3rd Author's Affiliation | Kyushu Institute of Technology(Kyutech) |
4th Author's Name | Kazuyuki Itoh |
4th Author's Affiliation | National Rehabilitation Center for Persons with Disabilities(NRCPD) |
Date | 2023-10-14 |
Paper # | SP2023-27,WIT2023-18 |
Volume (vol) | vol.123 |
Number (no) | SP-212,WIT-213 |
Page | pp.pp.1-5(SP), pp.1-5(WIT), |
#Pages | 5 |
Date of Issue | 2023-10-07 (SP, WIT) |