| Presentation | 2023-01-21 Sign language learning support system for beginners Kazuki Matsumaru, Ken Tsutsuguchi, Shunichi Yonemura, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Textbooks with illustrations and video materials with live-action images are used for sign language learning. Textbooks are suitable for learning general signs such as the beginning, middle, and end points of sign movements, because they highlight important elements of the sign language such as finger shapes and finger movements. On the other hand, video materials allow, in principle, to check detailed sign movements, but it is difficult for beginners with limited knowledge of sign language expression to notice changes in finger movements, and as a result, it is difficult for them to learn sign language accurately. In this study, we have been investigating a sign language learning system that supports beginners in learning correct sign language expressions by using "sign language keyframe images" that include spatial feature points of sign language expressions. In this paper, we propose a system that automatically detects the sign words that beginners find too fast and automatically adjusts the playback speed of these words. In order to extract the sign words that are perceived as fast, the system estimates the apparent speed of the sign expression based on the amount of spatial movement of the fingers in the sign language video and the number of image frames. We experimentally verified the validity of the speed estimation of the sign language expressions proposed in this paper, and based on the results, we report on our study of a function that automatically adjusts the speed of word playback within a sentence. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Learning sign language / Sign language keyframe images / Amount of spatial movement / Number of image frames |
| Paper # | HCS2022-63 |
| Date of Issue | 2023-01-14 (HCS) |
| Conference Information | |
| Committee | HCS |
|---|---|
| Conference Date | 2023/1/21(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kyoto Institute of Technology |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Physical Communication, etc. |
| Chair | Tomoko Kanda(Osaka Inst. of Tech.) |
| Vice Chair | Yugo Hayashi(Ritsumeikan Univ.) / Masashi Komori(Osaka Electro-Comm. Univ.) |
| Secretary | Yugo Hayashi(Nihon Univ.) / Masashi Komori(Kanagawa Univ.) |
| Assistant | HUANG HUNGHSUAN(Univ. of Fukuchiyama) / Jun Ichikawa(Shizuoka Univ.) / Kazuki Takashima(Tohoku Univ.) / Hiroto Saito(Tokyo Denki Univ.) / Ryo Ishii(NTT) / Yoshimasa Ohmoto(Shizuoka Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Human Communication Science |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Sign language learning support system for beginners |
| Sub Title (in English) | Automatic playback speed adjustment function using the amount of spatial movement of hand images |
| Keyword(1) | Learning sign language |
| Keyword(2) | Sign language keyframe images |
| Keyword(3) | Amount of spatial movement |
| Keyword(4) | Number of image frames |
| 1st Author's Name | Kazuki Matsumaru |
| 1st Author's Affiliation | Shibaura Institute of Technology(SIT) |
| 2nd Author's Name | Ken Tsutsuguchi |
| 2nd Author's Affiliation | Sojo University(Sojo Univ.) |
| 3rd Author's Name | Shunichi Yonemura |
| 3rd Author's Affiliation | Shibaura Institute of Technology(SIT) |
| Date | 2023-01-21 |
| Paper # | HCS2022-63 |
| Volume (vol) | vol.122 |
| Number (no) | HCS-349 |
| Page | pp.pp.48-53(HCS), |
| #Pages | 6 |
| Date of Issue | 2023-01-14 (HCS) |