Presentation 2018-03-09
Continuous Finger Spelling Recognition Using Kinect Based on Linguistic Information
Kosuke Kazama, Yasuo Horiuchi, Shimomoto Masayoshi, Shingo Kuroiwa,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In this paper, we will discuss a finger spelling recognition based on linguistic information, Generally, a finger spelling is performed successively as a word. Therefore, it is necessary to recognize the finger spelling continuously. We have previously proposed continuous recognition of finger spelling. This method to recognize movement of arm by HMM, and recognize finger spelling by SVM which trained finger spelling for corresponding movement of arm. However, if it fails to recognize movement of arm by HMM, the finger spelling recognition fails. Therefore, we proposed a method to recognize a finger spelling word using linguistic information based on a word dictionary by independently recognition of movement of arm and recognition of hand shape, that can recognize correct finger spelling, even if it fails to recognize movement of arm by HMM. As a result of the recognition experiment, we obtained recognition rate of 98.9% for speaker closed condition and 93.5% for speaker open condition when recognition word vocabulary was restricted.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Finger Spelling Recognition / HMM / SVM / Kinect
Paper # WIT2017-74
Date of Issue 2018-03-02 (WIT)

Conference Information
Committee WIT / IPSJ-AAC
Conference Date 2018/3/9(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Tsukuba University of Technology
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Chikamune Wada(Kyushu Inst. of Tech.) / 馬場 晃(首都大学東京)
Vice Chair Daisuke Wakatsuki(Tsukuba Univ. of Tech.)
Secretary Daisuke Wakatsuki(Nagoya Inst. of Tech.) / (AIST)
Assistant Takeaki Shionome(*) / Manabi Miyagi(Tsukuba Univ. of Tech.) / Takashi Handa(Saitama Industrial Technology Center)

Paper Information
Registration To Technical Committee on Well-being Information Technology / Special Interest Group on Assistive & Accessible Computin
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Continuous Finger Spelling Recognition Using Kinect Based on Linguistic Information
Sub Title (in English)
Keyword(1) Finger Spelling Recognition
Keyword(2) HMM
Keyword(3) SVM
Keyword(4) Kinect
1st Author's Name Kosuke Kazama
1st Author's Affiliation Chiba University(Chiba Univ.)
2nd Author's Name Yasuo Horiuchi
2nd Author's Affiliation Chiba University(Chiba Univ.)
3rd Author's Name Shimomoto Masayoshi
3rd Author's Affiliation Mizuho Information & Research Institute(Mizuho IR)
4th Author's Name Shingo Kuroiwa
4th Author's Affiliation Chiba University(Chiba Univ.)
Date 2018-03-09
Paper # WIT2017-74
Volume (vol) vol.117
Number (no) WIT-502
Page pp.pp.83-88(WIT),
#Pages 6
Date of Issue 2018-03-02 (WIT)