Presentation 2014-11-17
Direct Density Ratio Estimation with Convolutional Neural Networks with Application in Outlier Detection
Hyunha NAM, Masashi SUGIYAMA,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Recently, the ratio of probability density functions was demonstrated to be useful in solving various machine learning tasks such as outlier detection, non-stationarity adaptation, feature selection, and clustering. The key idea of this density ratio approach is that the ratio is directly estimated so that difficult density estimation is avoided. So far, parametric and non-parametric direct density ratio estimators with various loss functions have been developed, and the kernel least-squares method was demonstrated to be highly useful both in terms of accuracy and computational efficiency. On the other hand, recent study in pattern recognition exhibited that deep architectures such as a convolutional neural network can significantly outperform kernel methods. In this paper, we propose to use the convolutional neural network in density ratio estimation, and experimentally show that the proposed method tends to outperform the kernel-based method in outlier detection tasks in images.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Density ratio estimation / Convolutional neural network / Outlier detection
Paper # IBISML2014-51
Date of Issue

Conference Information
Committee IBISML
Conference Date 2014/11/10(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Information-Based Induction Sciences and Machine Learning (IBISML)
Language ENG
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Direct Density Ratio Estimation with Convolutional Neural Networks with Application in Outlier Detection
Sub Title (in English)
Keyword(1) Density ratio estimation
Keyword(2) Convolutional neural network
Keyword(3) Outlier detection
1st Author's Name Hyunha NAM
1st Author's Affiliation Tokyo Inst. of Tech.()
2nd Author's Name Masashi SUGIYAMA
2nd Author's Affiliation Univ. of Tokyo
Date 2014-11-17
Paper # IBISML2014-51
Volume (vol) vol.114
Number (no) 306
Page pp.pp.-
#Pages 6
Date of Issue