| Presentation | 2018-06-29 Mapping Acoustic Vector Sequence to Document Vector Based on RNN Ryota Nishimura, Miho Higaki, Norihide Kitaoka, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In this research, we propose a method of searching between different media (cross media mapping) using deep learning (Machine learning algorithm which is developed and utilized rapidly in recent years). A recurrent neural network (RNN) is used for the network. By using the proposed method, music and lyrics can be correlated, and music can be searched using documents. By applying this model, it is possible to realize a music suggestion system that monitors human-to-human dialogue and provides appropriate BGM. In this paper, we constructed a proposal model, conducted an evaluation experiment, and confirmed the possibility of cross media mapping. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | RNN / LSTM / cross-media mapping / chroma vector / word2vec |
| Paper # | PRMU2018-32,SP2018-12 |
| Date of Issue | 2018-06-21 (PRMU, SP) |
| Conference Information | |
| Committee | PRMU / SP |
|---|---|
| Conference Date | 2018/6/28(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Shinichi Sato(NII) / Yoichi Yamashita(Ritsumeikan Univ.) |
| Vice Chair | Yoshihisa Ijiri(Omron) / Toru Tamaki(Hiroshima Univ.) / Akinobu Ri(Nagoya Inst. of Tech.) |
| Secretary | Yoshihisa Ijiri(NEC) / Toru Tamaki(Osaka Univ.) / Akinobu Ri(Kyoto Univ.) |
| Assistant | Go Irie(NTT) / Yoshitaka Ushiku(Univ. of Tokyo) / Tomoki Koriyama(Tokyo Inst. of Tech.) / Satoshi Kobashikawa(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Pattern Recognition and Media Understanding / Technical Committee on Speech |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Mapping Acoustic Vector Sequence to Document Vector Based on RNN |
| Sub Title (in English) | |
| Keyword(1) | RNN |
| Keyword(2) | LSTM |
| Keyword(3) | cross-media mapping |
| Keyword(4) | chroma vector |
| Keyword(5) | word2vec |
| 1st Author's Name | Ryota Nishimura |
| 1st Author's Affiliation | Tokushima University(Tokushima Univ.) |
| 2nd Author's Name | Miho Higaki |
| 2nd Author's Affiliation | Tokushima University(Tokushima Univ.) |
| 3rd Author's Name | Norihide Kitaoka |
| 3rd Author's Affiliation | Tokushima University(Tokushima Univ.) |
| Date | 2018-06-29 |
| Paper # | PRMU2018-32,SP2018-12 |
| Volume (vol) | vol.118 |
| Number (no) | PRMU-111,SP-112 |
| Page | pp.pp.59-64(PRMU), pp.59-64(SP), |
| #Pages | 6 |
| Date of Issue | 2018-06-21 (PRMU, SP) |