Presentation 2018-06-08
Web video search reranking via graph-based soft clustering using heterogeneous metadata integration
Soh Yoshida, Mitsuji Muneyasu,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) This paper addresses the problem of analyzing a heterogeneous graph for extracting topics including videos in a dataset and improving the performance of video retrieval. Unlike previous works which only focus on an individual video graph, the proposed method leverages the ``mutual reinforcement'' of heterogeneous objects such as videos, their associated tags, and users obtained by social influence mining. In order to represent multiple types of relationships between them, the proposed method attempts to extract latent features which mean topics on a target dataset from a video group obtained by a keyword search using a heterogeneous graph-based soft clustering approach. Specifically, the proposed method constructs three subgraphs: a user-tag graph, a video-video graph, and a video-tag graph. We combine the three types of graphs to obtain the heterogeneous graph. Then the extraction of latent features becomes feasible by applying graph-based soft clustering to the heterogeneous graph and grouping different types of data as clusters. By estimating the membership of each cluster for each video, the proposed method defines a video similarity measure and formulates the video search reranking as an optimization problem.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) video retrieval / reranking / metadata / graph-based soft clustering
Paper # SIS2018-8
Date of Issue 2018-05-31 (SIS)

Conference Information
Committee SIS / IPSJ-AVM / ITE-3DIT
Conference Date 2018/6/7(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Jozankei View Hotel
Topics (in Japanese) (See Japanese page)
Topics (in English) Intelligent Multimedia Systems, Applied Enbedded Systems, Three-Dimensional Image Technology (3DIT), etc.
Chair Takayuki Nakachi(NTT) / Hideaki Kimata(NTT) / Tsutomu Horikoshi(Shonan Institute of Technology)
Vice Chair Noriaki Suetake(Yamaguchi Univ.) / Tomoaki Kimura(Kanagawa Inst. of Tech.)
Secretary Noriaki Suetake(Kyushu Inst. of Tech.) / Tomoaki Kimura(Tokyo Metropolitan Univ.) / (NTT) / (Tokyo Univ. of Science)
Assistant Takanori Koga(National Inst. of Tech. Tokuyama College) / Hideaki Misawa(National Inst. of Tech., Ube College)

Paper Information
Registration To Technical Committee on Smart Info-Media Systems / Special Interest Group on Audio Visual and Multimedia Information Processing / Technical Group on Three-Dimensional Image Technology
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Web video search reranking via graph-based soft clustering using heterogeneous metadata integration
Sub Title (in English)
Keyword(1) video retrieval
Keyword(2) reranking
Keyword(3) metadata
Keyword(4) graph-based soft clustering
1st Author's Name Soh Yoshida
1st Author's Affiliation Kansai University(Kansai Univ.)
2nd Author's Name Mitsuji Muneyasu
2nd Author's Affiliation Kansai University(Kansai Univ.)
Date 2018-06-08
Paper # SIS2018-8
Volume (vol) vol.118
Number (no) SIS-73
Page pp.pp.69-74(SIS),
#Pages 6
Date of Issue 2018-05-31 (SIS)