Presentation 2024-03-13
A study on piano fingering recognition using MediaPipe Hands and gate time information
Haruhi Kurachi, Nobutaka Kuroki, Masahiro Numa,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) This paper proposes a piano fingering recognition method that is robust against left-right hand crossing. Conventional methods may miss the fingers that are hidden under the other hand passing over. The proposed method does not detect the finger at the moment of key down, but estimates all fingers on the key during the gate time. In our experiment, the proposed method was applied to a piano play with left and right hand crossings, and improved the detection rate by 5.4 points.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Piano / Fingering recognition / MIDI / Gate time / MediaPipe Hands
Paper # IMQ2023-17,IE2023-72,MVE2023-46
Date of Issue 2024-03-06 (IMQ, IE, MVE)

Conference Information
Committee IE / MVE / CQ / IMQ
Conference Date 2024/3/13(3days)
Place (in Japanese) (See Japanese page)
Place (in English) Okinawa Sangyo Shien Center
Topics (in Japanese) (See Japanese page)
Topics (in English) Media of five senses, Multimedia, Media experience, Picture codinge, Image media quality, Network,quality and reliability, etc(AC)
Chair Hiroyuki Bandoh(NTT) / Kiyoshi Kiyokawa(NAIST) / Takefumi Hiraguri(Nippon Inst. of Tech.) / Hiroaki Kudo(Nagoya Univ.)
Vice Chair Yuichi Tanaka(Osaka Univ.) / Toshihiko Yamazaki(Univ. of Tokyo) / Sumaru Niida(KDDI Research) / Takahiro Matsuda(Tokyo Metropolitan Univ.) / Gou Hasegawa(Tohoku Univ.) / Sumaru Niida(KDDI Research) / Gosuke Ohashi(Shizuka Univ.)
Secretary Yuichi Tanaka(NHK) / Toshihiko Yamazaki(Tottori Univ.) / Sumaru Niida(Otsuma Women's Univ.) / Takahiro Matsuda(DNP) / Gou Hasegawa(NTT) / Sumaru Niida(NTT) / Gosuke Ohashi(Tama Univ.)
Assistant Kazunori Uruma(Kogakuin Univ.) / Shinobu Kudo(KDDI Research) / Hidehiko Shishido(Univ. of Tsukuba) / Atsushi Nakazawa(Kyoto Univ.) / Naoya Tojo(KDDI Research) / Naoki Hagiyama(NTT) / Yuji Tatada(Univ. of Tokyo) / Ryo Nakamura(Fukuoka Univ.) / Toshiro Nakahira(NTT) / Kenta Tsukatsune(Okayama Univ. of Science) / Kuniharu Imai(Nagoya Univ.) / Takashi Yamazoe(Seikei Univ.)

Paper Information
Registration To Technical Committee on Image Engineering / Technical Committee on Media Experience and Virtual Environment / Technical Committee on Communication Quality / Technical Committee on Image Media Quality
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) A study on piano fingering recognition using MediaPipe Hands and gate time information
Sub Title (in English)
Keyword(1) Piano
Keyword(2) Fingering recognition
Keyword(3) MIDI
Keyword(4) Gate time
Keyword(5) MediaPipe Hands
1st Author's Name Haruhi Kurachi
1st Author's Affiliation Kobe University(Kobe Univ.)
2nd Author's Name Nobutaka Kuroki
2nd Author's Affiliation Kobe University(Kobe Univ.)
3rd Author's Name Masahiro Numa
3rd Author's Affiliation Kobe University(Kobe Univ.)
Date 2024-03-13
Paper # IMQ2023-17,IE2023-72,MVE2023-46
Volume (vol) vol.123
Number (no) IMQ-430,IE-432,MVE-433
Page pp.pp.25-28(IMQ), pp.25-28(IE), pp.25-28(MVE),
#Pages 4
Date of Issue 2024-03-06 (IMQ, IE, MVE)