Presentation | 2022-01-29 Basic study of sign language learning support system: Facilitate learning of Non-Manual Signals Kazuki Matsumaru, Ken Tsutsuguchi, Shun-ichi Yonemura, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | Japanese sign language and Pidgin sign Japanese express themselves by coordinating manual signals such as hand shapes,movements and positions with non-manual signals such as mouth gesture,facial expressions and head movements.Manual signals are mainly used to express words,and non-manual signals are used to express grammatical structures such as adverbs and clauses.It is difficult for novice to learn phoneme of non-manual signals because non-manual signals change their meaning depending on the timing of sign language expression.So,many novice neglect learning of non-manual signals. We extract keyframes in which the locus of manual signals in a sign language video changes significantly for novice to synchronize manual signals and non-manual signals appropriately and to express sign language correctly.Then,by visualizing the amount of change in the head movements included in the keyframes, we are investigating a sign language learning support system that promotes understanding of the coordination and timing gap between manual signals and non-manual signals.In this paper,we focus on head movements such as nodding and shaking head,and investigated how to highlight head movements.As a result of experimental verification using a prototype of this sign language learning support system, we report that significant learning effects were obtained for learning of head movements in both self-assessment by novice learners themselves and assessment by advanced sign language learners. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | Japanese sign language / manual signal / non-manual signal / keyframe / head movement |
Paper # | HCS2021-56 |
Date of Issue | 2022-01-21 (HCS) |
Conference Information | |
Committee | HCS |
---|---|
Conference Date | 2022/1/28(2days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | Online |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | Food and Communication, and other general topics |
Chair | Tomoo Inoue(Univ. of Tsukuba) |
Vice Chair | Yugo Hayashi(Ritsumeikan Univ.) / Tomoko Kanda(Osaka Inst. of Tech.) |
Secretary | Yugo Hayashi(Nihon Univ.) / Tomoko Kanda(National Chung Cheng Univ) |
Assistant | HUANG HUNGHSUAN(Univ. of Fukuchiyama) / Shigeyoshi Iizuka(Kanagawa Univ.) / Kazuki Takashima(Tohoku Univ.) / Hiroto Saito(Tokyo Denki Univ.) / Ryo Ishii(NTT) |
Paper Information | |
Registration To | Technical Committee on Human Communication Science |
---|---|
Language | JPN |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | Basic study of sign language learning support system: Facilitate learning of Non-Manual Signals |
Sub Title (in English) | |
Keyword(1) | Japanese sign language |
Keyword(2) | manual signal |
Keyword(3) | non-manual signal |
Keyword(4) | keyframe |
Keyword(5) | head movement |
1st Author's Name | Kazuki Matsumaru |
1st Author's Affiliation | Shibaura Institute Of Technology(SIT) |
2nd Author's Name | Ken Tsutsuguchi |
2nd Author's Affiliation | Sojo University(Sojo Univ.) |
3rd Author's Name | Shun-ichi Yonemura |
3rd Author's Affiliation | Shibaura Institute Of Technology(SIT) |
Date | 2022-01-29 |
Paper # | HCS2021-56 |
Volume (vol) | vol.121 |
Number (no) | HCS-363 |
Page | pp.pp.75-80(HCS), |
#Pages | 6 |
Date of Issue | 2022-01-21 (HCS) |