| Presentation | 2014-11-18 Unsupervised Dimension Reduction via Least-Squares Quadratic Mutual Information Janya SAINUI, Masashi SUGIYAMA, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The goal of dimension reduction is to represent high-dimensional data in a lower-dimensional subspace, while intrinsic properties of the original data are kept as much as possible. An important challenge in unsupervised dimension reduction is the choice of tuning parameters, because no supervised information is available and thus parameter selection tends to be subjective and heuristic. In this paper, we propose an information-theoretic approach to unsupervised dimension reduction that allows objective tuning parameter selection. We employ quadratic mutual information (QMI) as our information measure, which is known to be less sensitive to outliers than ordinary mutual information, and QMI is estimated analytically by a least-squares method in a computationally efficient way. Then, we provide an eigenvector-based efficient implementation for performing unsupervised dimension reduction based on the QMI estimator. The usefulness of the proposed method is demonstrated through experiments. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | unsupervised dimension reduction / quadratic mutual information / least-squares density difference / Epanechnikov kernel / hyperparameter tuning |
| Paper # | IBISML2014-69 |
| Date of Issue |
| Conference Information | |
| Committee | IBISML |
|---|---|
| Conference Date | 2014/11/10(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Information-Based Induction Sciences and Machine Learning (IBISML) |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Unsupervised Dimension Reduction via Least-Squares Quadratic Mutual Information |
| Sub Title (in English) | |
| Keyword(1) | unsupervised dimension reduction |
| Keyword(2) | quadratic mutual information |
| Keyword(3) | least-squares density difference |
| Keyword(4) | Epanechnikov kernel |
| Keyword(5) | hyperparameter tuning |
| 1st Author's Name | Janya SAINUI |
| 1st Author's Affiliation | Department of Computer Science, Tokyo Institute of Technology() |
| 2nd Author's Name | Masashi SUGIYAMA |
| 2nd Author's Affiliation | Department of Complexity Science and Engineering, University of Tokyo |
| Date | 2014-11-18 |
| Paper # | IBISML2014-69 |
| Volume (vol) | vol.114 |
| Number (no) | 306 |
| Page | pp.pp.- |
| #Pages | 4 |
| Date of Issue | |