Presentation 2023-10-14
Non-contact eye-switch using eye movement based on pupil center detection
Ploywow Nhuthep, Ryuto Tamai, Takeshi Saitoh, Kazuyuki Itoh,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Our aim is to develop an eye switch that uses eye movements as a means of supporting communication in ALS patients. In previous research, we developed a eyeglasses-type switch using a contact-type wearable camera. However, there remained the issue of putting a burden on users when wearing the device. Therefore, in this research, we will develop a non-contact eye-switch that uses a stationary infrared camera and an infrared LED. The difference in internal processing from previous studies is that the captured image is an eye image in the previous study, whereas in this study it is a facial image that shows the user's entire face. Therefore, we introduce a process to extract the eye ROI by applying face and facial landmark detection in the image processing section. When we collected data from six healthy subjects and conducted a quantitative evaluation, we found that although the accuracy was lower than in previous studies, it was still accurate enough for practical use. Furthermore, we implemented a real-time system and confirmed its operation.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) ALS patient / eye-switch / pupil center point detection / eye contour points detection / CNN
Paper # SP2023-27,WIT2023-18
Date of Issue 2023-10-07 (SP, WIT)

Conference Information
Committee WIT / SP / IPSJ-SLP
Conference Date 2023/10/14(1days)
Place (in Japanese) (See Japanese page)
Place (in English) Kyushu Institute of Technology
Topics (in Japanese) (See Japanese page)
Topics (in English) Speech and Well-being Information Technology, etc.
Chair Takeaki Shionome(Teikyo Univ.) / Tomoki Toda(Nagoya Univ.) / Tomoki Toda(Nagoya Univ.)
Vice Chair Shinji Sakou(Nagoya Inst. of Tech.)
Secretary Shinji Sakou(AIST) / (Univ. of Toyama) / (Tsukuba Univ. of Tech.)
Assistant Tsubasa Uchida(NHK) / Teppei Miura(National Inst. of Techn. Toyota College) / Ryo Aihara(Mitsubishi Electric) / Daisuke Saito(Univ. of Tokyo)

Paper Information
Registration To Technical Committee on Well-being Information Technology / Technical Committee on Speech / Special Interest Group on Spoken Language Processing
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Non-contact eye-switch using eye movement based on pupil center detection
Sub Title (in English)
Keyword(1) ALS patient
Keyword(2) eye-switch
Keyword(3) pupil center point detection
Keyword(4) eye contour points detection
Keyword(5) CNN
1st Author's Name Ploywow Nhuthep
1st Author's Affiliation Kyushu Institute of Technology(Kyutech)
2nd Author's Name Ryuto Tamai
2nd Author's Affiliation Kyushu Institute of Technology(Kyutech)
3rd Author's Name Takeshi Saitoh
3rd Author's Affiliation Kyushu Institute of Technology(Kyutech)
4th Author's Name Kazuyuki Itoh
4th Author's Affiliation National Rehabilitation Center for Persons with Disabilities(NRCPD)
Date 2023-10-14
Paper # SP2023-27,WIT2023-18
Volume (vol) vol.123
Number (no) SP-212,WIT-213
Page pp.pp.1-5(SP), pp.1-5(WIT),
#Pages 5
Date of Issue 2023-10-07 (SP, WIT)