Presentation 2023-10-14
Proposal for Music Visualization Method Using Chironomie for Enhancing Musical Experience of the Hearing Impaired
Tatsumi Kana, Shinji Sako,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) The aim of this study is to enable both hearing-impaired and normal-hearing to enjoy music together by visualizing it using Chironomie which is Gregorian chant conducting. To achieve this goal, the tasks include adapting Chironomie to Western music to express intuitively perceivable musical features like tension and relaxation. Additionally, evaluating whether Chironomie can effectively convey music visually. This report focuses on the investigation of a method for automatically estimating Arsis and Thesis for complex beats to generate Chironomie, and the presentation of the results of an evaluation experiment involving normal-hearing to assess the utility of Chironomie.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Chironomie / Music Visualization
Paper # SP2023-30,WIT2023-21
Date of Issue 2023-10-07 (SP, WIT)

Conference Information
Committee WIT / SP / IPSJ-SLP
Conference Date 2023/10/14(1days)
Place (in Japanese) (See Japanese page)
Place (in English) Kyushu Institute of Technology
Topics (in Japanese) (See Japanese page)
Topics (in English) Speech and Well-being Information Technology, etc.
Chair Takeaki Shionome(Teikyo Univ.) / Tomoki Toda(Nagoya Univ.) / Tomoki Toda(Nagoya Univ.)
Vice Chair Shinji Sakou(Nagoya Inst. of Tech.)
Secretary Shinji Sakou(AIST) / (Univ. of Toyama) / (Tsukuba Univ. of Tech.)
Assistant Tsubasa Uchida(NHK) / Teppei Miura(National Inst. of Techn. Toyota College) / Ryo Aihara(Mitsubishi Electric) / Daisuke Saito(Univ. of Tokyo)

Paper Information
Registration To Technical Committee on Well-being Information Technology / Technical Committee on Speech / Special Interest Group on Spoken Language Processing
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Proposal for Music Visualization Method Using Chironomie for Enhancing Musical Experience of the Hearing Impaired
Sub Title (in English)
Keyword(1) Chironomie
Keyword(2) Music Visualization
1st Author's Name Tatsumi Kana
1st Author's Affiliation Nagoya Institute of Technology(NITech)
2nd Author's Name Shinji Sako
2nd Author's Affiliation Nagoya Institute of Technology(NITech)
Date 2023-10-14
Paper # SP2023-30,WIT2023-21
Volume (vol) vol.123
Number (no) SP-212,WIT-213
Page pp.pp.17-20(SP), pp.17-20(WIT),
#Pages 4
Date of Issue 2023-10-07 (SP, WIT)