Presentation | 2018-03-09 Continuous Finger Spelling Recognition Using Kinect Based on Linguistic Information Kosuke Kazama, Yasuo Horiuchi, Shimomoto Masayoshi, Shingo Kuroiwa, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | In this paper, we will discuss a finger spelling recognition based on linguistic information, Generally, a finger spelling is performed successively as a word. Therefore, it is necessary to recognize the finger spelling continuously. We have previously proposed continuous recognition of finger spelling. This method to recognize movement of arm by HMM, and recognize finger spelling by SVM which trained finger spelling for corresponding movement of arm. However, if it fails to recognize movement of arm by HMM, the finger spelling recognition fails. Therefore, we proposed a method to recognize a finger spelling word using linguistic information based on a word dictionary by independently recognition of movement of arm and recognition of hand shape, that can recognize correct finger spelling, even if it fails to recognize movement of arm by HMM. As a result of the recognition experiment, we obtained recognition rate of 98.9% for speaker closed condition and 93.5% for speaker open condition when recognition word vocabulary was restricted. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | Finger Spelling Recognition / HMM / SVM / Kinect |
Paper # | WIT2017-74 |
Date of Issue | 2018-03-02 (WIT) |
Conference Information | |
Committee | WIT / IPSJ-AAC |
---|---|
Conference Date | 2018/3/9(2days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | Tsukuba University of Technology |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | |
Chair | Chikamune Wada(Kyushu Inst. of Tech.) / 馬場 晃(首都大学東京) |
Vice Chair | Daisuke Wakatsuki(Tsukuba Univ. of Tech.) |
Secretary | Daisuke Wakatsuki(Nagoya Inst. of Tech.) / (AIST) |
Assistant | Takeaki Shionome(*) / Manabi Miyagi(Tsukuba Univ. of Tech.) / Takashi Handa(Saitama Industrial Technology Center) |
Paper Information | |
Registration To | Technical Committee on Well-being Information Technology / Special Interest Group on Assistive & Accessible Computin |
---|---|
Language | JPN |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | Continuous Finger Spelling Recognition Using Kinect Based on Linguistic Information |
Sub Title (in English) | |
Keyword(1) | Finger Spelling Recognition |
Keyword(2) | HMM |
Keyword(3) | SVM |
Keyword(4) | Kinect |
1st Author's Name | Kosuke Kazama |
1st Author's Affiliation | Chiba University(Chiba Univ.) |
2nd Author's Name | Yasuo Horiuchi |
2nd Author's Affiliation | Chiba University(Chiba Univ.) |
3rd Author's Name | Shimomoto Masayoshi |
3rd Author's Affiliation | Mizuho Information & Research Institute(Mizuho IR) |
4th Author's Name | Shingo Kuroiwa |
4th Author's Affiliation | Chiba University(Chiba Univ.) |
Date | 2018-03-09 |
Paper # | WIT2017-74 |
Volume (vol) | vol.117 |
Number (no) | WIT-502 |
Page | pp.pp.83-88(WIT), |
#Pages | 6 |
Date of Issue | 2018-03-02 (WIT) |