| Presentation | 2022-03-07 [Poster Presentation] A Melody Generation Method based on An Image Representation of Monophonic Melodies as Rectangle Sequences and Image Inpainting. Yudai Ono, Hirohisa Hioki, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | We propose a method for generating monophonic melodies that are similar to those in a music dataset. Our method takes a monophonic melody and converts it to an image where each note is represented by a rectangle whose height and width encode the pitch and length, and color encodes the pitch name. By dropping rectangles, performing inpainting via pix2pix network and making adjustments for each bar region in the image one by one, we generate an image representing a new melody. For evaluating our method, we employed a dataset of fork music and performed experiments for seven subjects. As a result, several melodies were evaluated to be similar to those in the dataset. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Melody Generation / Image Inpainting / GAN / pix2pix |
| Paper # | EMM2021-98 |
| Date of Issue | 2022-02-28 (EMM) |
| Conference Information | |
| Committee | EMM |
|---|---|
| Conference Date | 2022/3/7(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | (Primary: Online, Secondary: On-site) |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Image and Sound Quality, Metrics for Perception and Recognition, Human Auditory and Visual System, etc. |
| Chair | Ryoichi Nishimura(NICT) |
| Vice Chair | Masaaki Fujiyoshi(Tokyo Metropolitan Univ.) / Masatsugu Ichino(Univ. of Electro-Comm.) |
| Secretary | Masaaki Fujiyoshi(Utsunomiya Univ.) / Masatsugu Ichino(NICT) |
| Assistant | Shoko Imaizumi(Chiba Univ.) / Youichi Takashima(Kaishi Professional Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Enriched MultiMedia |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | [Poster Presentation] A Melody Generation Method based on An Image Representation of Monophonic Melodies as Rectangle Sequences and Image Inpainting. |
| Sub Title (in English) | |
| Keyword(1) | Melody Generation |
| Keyword(2) | Image Inpainting |
| Keyword(3) | GAN |
| Keyword(4) | pix2pix |
| 1st Author's Name | Yudai Ono |
| 1st Author's Affiliation | Kyoto University(Kyoto Univ.) |
| 2nd Author's Name | Hirohisa Hioki |
| 2nd Author's Affiliation | Kyoto University(Kyoto Univ.) |
| Date | 2022-03-07 |
| Paper # | EMM2021-98 |
| Volume (vol) | vol.121 |
| Number (no) | EMM-417 |
| Page | pp.pp.34-39(EMM), |
| #Pages | 6 |
| Date of Issue | 2022-02-28 (EMM) |