| Presentation | 2023-01-26 Music Experience by Visualizing Imaginary Scenery Based on Song Lyrics Ayuma Nishino, Mako Ishida, Tomoko Yonezawa, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The purpose of this study is to clarify the effect of visualization of mental images synchronized with sung music to enrich the musical experience. The other is a system that realistically reproduces images of mental landscapes by mapping them to the meaning of lyrics.We conducted Experiment 1 on the effects of the presence or absence of visual images and the level of abstraction on the user's musical experience, and Experiment 2 on the effects of the synchronization and degree of dynamism of the abstract images on the musical experience, by comparing three types of musical experiences: listening with two types of visual images (abstract and realistic) created using this system, and listening with music alone.The results suggest that accompanying music with visual images enriches the musical experience, and that abstract visual images accompanying music increase the concentration on the sound flow of the music, while realistic visual images increase the concentration on the context of the lyrics.Furthermore, when accompanying abstract visualization images with music, it was suggested that synchronizing the images with the music would enhance the musical experience. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Visualization of Sung Music / Interaction between Images and Music / Musical Context / Lyrics Context Emotion / Imaginary Scenery / Visual Abstraction / Music Synchronization |
| Paper # | MVE2022-36 |
| Date of Issue | 2023-01-19 (MVE) |
| Conference Information | |
| Committee | MVE / IPSJ-CVIM / VRSJ-SIG-MR |
|---|---|
| Conference Date | 2023/1/26(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Nara Institute of Science and Technology |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Kiyoshi Kiyokawa(NAIST) |
| Vice Chair | Sumaru Niida(KDDI Research) |
| Secretary | Sumaru Niida(NAIST) / (DNP) / (Univ. of ToKyo) |
| Assistant | Hidehiko Shishido(Univ. of Tsukuba) / Atsushi Nakazawa(Kyoto Univ.) / Naoya Tojo(KDDI Research) / Naoki Hagiyama(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Media Experience and Virtual Environment / Special Interest Group on Computer Vision and Image Media / SIG-MR |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Music Experience by Visualizing Imaginary Scenery Based on Song Lyrics |
| Sub Title (in English) | |
| Keyword(1) | Visualization of Sung Music |
| Keyword(2) | Interaction between Images and Music |
| Keyword(3) | Musical Context |
| Keyword(4) | Lyrics Context Emotion |
| Keyword(5) | Imaginary Scenery |
| Keyword(6) | Visual Abstraction |
| Keyword(7) | Music Synchronization |
| 1st Author's Name | Ayuma Nishino |
| 1st Author's Affiliation | Kansai University(Kansai Univ) |
| 2nd Author's Name | Mako Ishida |
| 2nd Author's Affiliation | Kansai University(Kansai Univ) |
| 3rd Author's Name | Tomoko Yonezawa |
| 3rd Author's Affiliation | Kansai University(Kansai Univ) |
| Date | 2023-01-26 |
| Paper # | MVE2022-36 |
| Volume (vol) | vol.122 |
| Number (no) | MVE-367 |
| Page | pp.pp.9-14(MVE), |
| #Pages | 6 |
| Date of Issue | 2023-01-19 (MVE) |