| Presentation | 2007-10-26 Garbage Model Formulation for Sign Language Spotting with Conditional Random Fields(Internationa Session 7) Hee-Deok Yang, Seong-Whan Lee, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Automatic recognition and spotting of sign language from continuous signing present a number of challenges. The signs appear within a continuous gesture stream, interspersed with transitional movements between sign (communicative) and non-sign (non-communicative) movements. Many previous sign spotting methods employed a fixed threshold that best discriminates signs and non-sign movements. However, it is difficult to select one fixed threshold that works well for all signs. In this paper, a novel method for designing a garbage model in conditional random field (CRF) that perform an adaptive threshold for distinguishing between sign and non-sign movements by augmenting the CRF with one additional label is proposed. A short sign detector, a hand appearance-based sign verification method, and a subsign reasoning method are included to further improve spotting accuracy. The short sign detector models signs that tend to have shorter than normal duration. The hand appearance-based sign verification method overcomes the ambiguity among signs that exhibits similar overall hand movements, but differ in hand shape. Finally, the subsign reasoning method avoids premature detection of a sign that can be made by parts of longer sign movements. Experiments demonstrate that our system can detect signs from continuous data with an 88% spotting rate and can recognize signs from isolated data with a 94% recognition rate, versus 61% spotting rate and 85% recognition rate respectively for CRF without a garbage label. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | sign language recognition / hand gesture recognition / gesture recognition / conditional random fields / garbage model / garbage conditional random fields |
| Paper # | PRMU2007-122 |
| Date of Issue |
| Conference Information | |
| Committee | PRMU |
|---|---|
| Conference Date | 2007/10/18(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Pattern Recognition and Media Understanding (PRMU) |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Garbage Model Formulation for Sign Language Spotting with Conditional Random Fields(Internationa Session 7) |
| Sub Title (in English) | |
| Keyword(1) | sign language recognition |
| Keyword(2) | hand gesture recognition |
| Keyword(3) | gesture recognition |
| Keyword(4) | conditional random fields |
| Keyword(5) | garbage model |
| Keyword(6) | garbage conditional random fields |
| 1st Author's Name | Hee-Deok Yang |
| 1st Author's Affiliation | Department of Computer Science and Engineering, Korea University() |
| 2nd Author's Name | Seong-Whan Lee |
| 2nd Author's Affiliation | Department of Computer Science and Engineering, Korea University |
| Date | 2007-10-26 |
| Paper # | PRMU2007-122 |
| Volume (vol) | vol.107 |
| Number (no) | 281 |
| Page | pp.pp.- |
| #Pages | 7 |
| Date of Issue | |