| Presentation | 2012-02-10 HMM Sign Language Recognition Using Kinect and Particle Filter Yosuke NISHIMURA, Daisuke IMAMURA, Yasuo HORIUCHI, Kazuhiko KAWAMOTO, Takahiro SHINOZAKI, Shingo KUROIWA, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In this paper, we will introduce a sign language recognition method using Kinect which is a motion sensing input device by Microsoft. Kinect has a RGB camera and a depth sensor and therefore we can easily get 3D images of signers' motion. The positions of arms are detected from both the color image data and the depth data of each pixel using Particle Filter Algorithm. Then, sign sentences are recognized using Hidden Markov Model. In our method, the recognition rate was 86.0%, while the recognition rate in the previous study using video image only was 76.2%. On the other hand, the recognition rate using attached motion capturing sensors was 86.8% and was approximately the same as our method. These results show that our method is useful for the practical applications, since our method uses only Kinect which is not expensive and no device is attached to the signer's hand. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Sign Language Recognition / Particle Filter / Hidden Markov Model / Kinect |
| Paper # | PRMU2011-223,SP2011-138 |
| Date of Issue |
| Conference Information | |
| Committee | SP |
|---|---|
| Conference Date | 2012/2/2(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Speech (SP) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | HMM Sign Language Recognition Using Kinect and Particle Filter |
| Sub Title (in English) | |
| Keyword(1) | Sign Language Recognition |
| Keyword(2) | Particle Filter |
| Keyword(3) | Hidden Markov Model |
| Keyword(4) | Kinect |
| 1st Author's Name | Yosuke NISHIMURA |
| 1st Author's Affiliation | Chiba University() |
| 2nd Author's Name | Daisuke IMAMURA |
| 2nd Author's Affiliation | Chiba University |
| 3rd Author's Name | Yasuo HORIUCHI |
| 3rd Author's Affiliation | Chiba University |
| 4th Author's Name | Kazuhiko KAWAMOTO |
| 4th Author's Affiliation | Chiba University |
| 5th Author's Name | Takahiro SHINOZAKI |
| 5th Author's Affiliation | Chiba University |
| 6th Author's Name | Shingo KUROIWA |
| 6th Author's Affiliation | Chiba University |
| Date | 2012-02-10 |
| Paper # | PRMU2011-223,SP2011-138 |
| Volume (vol) | vol.111 |
| Number (no) | 431 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |