講演名 2011-03-29
Information-Maximization Clustering : Analytic Solution and Model Selection
,
PDFダウンロードページ PDFダウンロードページへ
抄録(和)
抄録(英) A recently-proposed information-maximization clustering method (Gomes et al., NIPS2010) learns a kernel logistic regression classifier in an unsupervised manner so that mutual information between feature vectors and cluster assignments is maximized. A notable advantage of this approach is that it only involves continuous optimization of a logistic model, which is substantially easier than discrete optimization of cluster assignments. However, this method still suffers from two weaknesses: (i) manual tuning of kernel parameters is necessary, and (ii) finding a good local optimal solution is not straightforward due to the strong non-convexity of logistic-regression learning. In this paper, we first show that the kernel parameters can be systematically optimized by maximizing mutual information estimates. We then propose an alternative information-maximization clustering approach using a squared-loss variant of mutual information. This novel approach allows us to obtain clustering solutions analytically in a computationally very efficient way. Through experiments, we demonstrate the usefulness of the proposed approaches.
キーワード(和)
キーワード(英) Clustering / Information Maximization / Squared-Loss Mutual Information
資料番号 IBISML2010-114
発行日

研究会情報
研究会 IBISML
開催期間 2011/3/21(から1日開催)
開催地(和)
開催地(英)
テーマ(和)
テーマ(英)
委員長氏名(和)
委員長氏名(英)
副委員長氏名(和)
副委員長氏名(英)
幹事氏名(和)
幹事氏名(英)
幹事補佐氏名(和)
幹事補佐氏名(英)

講演論文情報詳細
申込み研究会 Information-Based Induction Sciences and Machine Learning (IBISML)
本文の言語 ENG
タイトル(和)
サブタイトル(和)
タイトル(英) Information-Maximization Clustering : Analytic Solution and Model Selection
サブタイトル(和)
キーワード(1)(和/英) / Clustering
第 1 著者 氏名(和/英) / Masashi SUGIYAMA
第 1 著者 所属(和/英)
Department of Computer Science, Tokyo Institute of Technology
発表年月日 2011-03-29
資料番号 IBISML2010-114
巻番号(vol) vol.110
号番号(no) 476
ページ範囲 pp.-
ページ数 8
発行日