| Presentation | 2022-01-29 Basic study of sign language learning support system: Facilitate learning of Non-Manual Signals Kazuki Matsumaru, Ken Tsutsuguchi, Shun-ichi Yonemura, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Japanese sign language and Pidgin sign Japanese express themselves by coordinating manual signals such as hand shapes，movements and positions with non-manual signals such as mouth gesture，facial expressions and head movements．Manual signals are mainly used to express words，and non-manual signals are used to express grammatical structures such as adverbs and clauses．It is difficult for novice to learn phoneme of non-manual signals because non-manual signals change their meaning depending on the timing of sign language expression．So，many novice neglect learning of non-manual signals． We extract keyframes in which the locus of manual signals in a sign language video changes significantly for novice to synchronize manual signals and non-manual signals appropriately and to express sign language correctly．Then，by visualizing the amount of change in the head movements included in the keyframes, we are investigating a sign language learning support system that promotes understanding of the coordination and timing gap between manual signals and non-manual signals．In this paper，we focus on head movements such as nodding and shaking head，and investigated how to highlight head movements．As a result of experimental verification using a prototype of this sign language learning support system, we report that significant learning effects were obtained for learning of head movements in both self-assessment by novice learners themselves and assessment by advanced sign language learners． |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Japanese sign language / manual signal / non-manual signal / keyframe / head movement |
| Paper # | HCS2021-56 |
| Date of Issue | 2022-01-21 (HCS) |
| Conference Information | |
| Committee | HCS |
|---|---|
| Conference Date | 2022/1/28(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Food and Communication, and other general topics |
| Chair | Tomoo Inoue(Univ. of Tsukuba) |
| Vice Chair | Yugo Hayashi(Ritsumeikan Univ.) / Tomoko Kanda(Osaka Inst. of Tech.) |
| Secretary | Yugo Hayashi(Nihon Univ.) / Tomoko Kanda(National Chung Cheng Univ) |
| Assistant | HUANG HUNGHSUAN(Univ. of Fukuchiyama) / Shigeyoshi Iizuka(Kanagawa Univ.) / Kazuki Takashima(Tohoku Univ.) / Hiroto Saito(Tokyo Denki Univ.) / Ryo Ishii(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Human Communication Science |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Basic study of sign language learning support system: Facilitate learning of Non-Manual Signals |
| Sub Title (in English) | |
| Keyword(1) | Japanese sign language |
| Keyword(2) | manual signal |
| Keyword(3) | non-manual signal |
| Keyword(4) | keyframe |
| Keyword(5) | head movement |
| 1st Author's Name | Kazuki Matsumaru |
| 1st Author's Affiliation | Shibaura Institute Of Technology(SIT) |
| 2nd Author's Name | Ken Tsutsuguchi |
| 2nd Author's Affiliation | Sojo University(Sojo Univ.) |
| 3rd Author's Name | Shun-ichi Yonemura |
| 3rd Author's Affiliation | Shibaura Institute Of Technology(SIT) |
| Date | 2022-01-29 |
| Paper # | HCS2021-56 |
| Volume (vol) | vol.121 |
| Number (no) | HCS-363 |
| Page | pp.pp.75-80(HCS), |
| #Pages | 6 |
| Date of Issue | 2022-01-21 (HCS) |