Presentation 2018-12-22
An Automatic Synchronization Method of Lyrics and Pictures using Word Embedding and Generic Object Recognition
Syo Yamaguchi, Daisuke Kitayama,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Generating and sharing video content has become popular. Some video contents are the slideshow that combines pictures and music. In order to generate a video of slideshow, it is necessary to automatically evaluate correspondence relationships with pictures and lyrics. In this research, we use data set of pictures stored by the user and each phrase of lyrics. We proposed a method to extract feature words by using general object recognition for images and to compare correspondence relationships by obtaining similarity by using word embedding for pictures and lyrics feature words.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Music / Picture / Slideshow video / Generic object recognition / Word embedding
Paper # DE2018-25
Date of Issue 2018-12-14 (DE)

Conference Information
Committee DE / IPSJ-DBS
Conference Date 2018/12/21(2days)
Place (in Japanese) (See Japanese page)
Place (in English) National Institute of Informatics
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Akiyo Nadamoto(Konan Univ.) / 吉川 正俊(京大)
Vice Chair Jun Miyazaki(Tokyo Inst. of Tech.) / Shingo Otsuka(Kanagawa Inst. of Tech.)
Secretary Jun Miyazaki(Univ. of Hyogo) / Shingo Otsuka(Univ. of Marketing and Distrbution Science) / (筑波大)
Assistant Kazuo Goda(Univ. of Tokyo) / Hiroaki Shiokawa(Tsukuba Univ.)

Paper Information
Registration To Technical Committee on Data Engineering / Special Interest Group on Database System
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) An Automatic Synchronization Method of Lyrics and Pictures using Word Embedding and Generic Object Recognition
Sub Title (in English)
Keyword(1) Music
Keyword(2) Picture
Keyword(3) Slideshow video
Keyword(4) Generic object recognition
Keyword(5) Word embedding
1st Author's Name Syo Yamaguchi
1st Author's Affiliation Kogakuin University(Kogakuin Univ.)
2nd Author's Name Daisuke Kitayama
2nd Author's Affiliation Kogakuin University(Kogakuin Univ.)
Date 2018-12-22
Paper # DE2018-25
Volume (vol) vol.118
Number (no) DE-377
Page pp.pp.29-34(DE),
#Pages 6
Date of Issue 2018-12-14 (DE)