講演名 | 2011-03-29 Information-Maximization Clustering : Analytic Solution and Model Selection , |
---|---|
PDFダウンロードページ | PDFダウンロードページへ |
抄録(和) | |
抄録(英) | A recently-proposed information-maximization clustering method (Gomes et al., NIPS2010) learns a kernel logistic regression classifier in an unsupervised manner so that mutual information between feature vectors and cluster assignments is maximized. A notable advantage of this approach is that it only involves continuous optimization of a logistic model, which is substantially easier than discrete optimization of cluster assignments. However, this method still suffers from two weaknesses: (i) manual tuning of kernel parameters is necessary, and (ii) finding a good local optimal solution is not straightforward due to the strong non-convexity of logistic-regression learning. In this paper, we first show that the kernel parameters can be systematically optimized by maximizing mutual information estimates. We then propose an alternative information-maximization clustering approach using a squared-loss variant of mutual information. This novel approach allows us to obtain clustering solutions analytically in a computationally very efficient way. Through experiments, we demonstrate the usefulness of the proposed approaches. |
キーワード(和) | |
キーワード(英) | Clustering / Information Maximization / Squared-Loss Mutual Information |
資料番号 | IBISML2010-114 |
発行日 |
研究会情報 | |
研究会 | IBISML |
---|---|
開催期間 | 2011/3/21(から1日開催) |
開催地(和) | |
開催地(英) | |
テーマ(和) | |
テーマ(英) | |
委員長氏名(和) | |
委員長氏名(英) | |
副委員長氏名(和) | |
副委員長氏名(英) | |
幹事氏名(和) | |
幹事氏名(英) | |
幹事補佐氏名(和) | |
幹事補佐氏名(英) |
講演論文情報詳細 | |
申込み研究会 | Information-Based Induction Sciences and Machine Learning (IBISML) |
---|---|
本文の言語 | ENG |
タイトル(和) | |
サブタイトル(和) | |
タイトル(英) | Information-Maximization Clustering : Analytic Solution and Model Selection |
サブタイトル(和) | |
キーワード(1)(和/英) | / Clustering |
第 1 著者 氏名(和/英) | / Masashi SUGIYAMA |
第 1 著者 所属(和/英) | Department of Computer Science, Tokyo Institute of Technology |
発表年月日 | 2011-03-29 |
資料番号 | IBISML2010-114 |
巻番号(vol) | vol.110 |
号番号(no) | 476 |
ページ範囲 | pp.- |
ページ数 | 8 |
発行日 |