Presentation | 2017-09-15 Quantum-Inspired Regression Forest Zeke Xie, Issei Sato, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | We propose a Quantum-Inspired Subspace(QIS) Ensemble Method for generating feature ensembles based on feature selections. We assign each principal component a Fraction Transition Probability as its probability weight based on Principal Component Analysis and quantum interpretations. In order to generate the feature subset for each base regressor, we select a feature subset from principal components based on Fraction Transition Probabilities. The idea originating from quantum mechanics can encourage ensemble diversity and the accuracy simultaneously. We incorporate Quantum-Inspired Subspace Method into Random Forest and propose Quantum-Inspired Forest. We theoretically prove that the quantum interpretation corresponds to the first order approximation of ensemble regression. We also evaluate the empirical performance of Quantum-Inspired Forest and Random Forest in multiple hyperparameter settings. Quantum-Inspired Forest prove the significant robustness of the default hyperparameters on most data sets. The contribution of this work is two-fold, a novel ensemble regression algorithm inspired by quantum mechanics and the theoretical connection between quantum interpretations and machine learning algorithms. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | Supervised LearningEnsemble MethodRegression TreeFeature SelectionQuantum Physics |
Paper # | PRMU2017-40,IBISML2017-12 |
Date of Issue | 2017-09-08 (PRMU, IBISML) |
Conference Information | |
Committee | PRMU / IBISML / IPSJ-CVIM |
---|---|
Conference Date | 2017/9/15(2days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | |
Chair | Shinichi Sato(NII) / Kenji Fukumizu(ISM) |
Vice Chair | Hironobu Fujiyoshi(Chubu Univ.) / Yoshihisa Ijiri(Omron) / Masashi Sugiyama(Univ. of Tokyo) |
Secretary | Hironobu Fujiyoshi(AIST) / Yoshihisa Ijiri(NAIST) / Masashi Sugiyama(Kyoto Univ.) / (Univ. of Tokyo) |
Assistant | Masato Ishii(NEC) / Yusuke Sugano(Osaka Univ.) / Ichiro Takeuchi(Nagoya Inst. of Tech.) / Toshihiro Kamishima(AIST) |
Paper Information | |
Registration To | Technical Committee on Pattern Recognition and Media Understanding / Technical Committee on Infomation-Based Induction Sciences and Machine Learning / Special Interest Group on Computer Vision and Image Media |
---|---|
Language | ENG |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | Quantum-Inspired Regression Forest |
Sub Title (in English) | |
Keyword(1) | Supervised LearningEnsemble MethodRegression TreeFeature SelectionQuantum Physics |
1st Author's Name | Zeke Xie |
1st Author's Affiliation | The University of Tokyo(UTokyo) |
2nd Author's Name | Issei Sato |
2nd Author's Affiliation | The University of Tokyo(UTokyo) |
Date | 2017-09-15 |
Paper # | PRMU2017-40,IBISML2017-12 |
Volume (vol) | vol.117 |
Number (no) | PRMU-210,IBISML-211 |
Page | pp.pp.7-17(PRMU), pp.7-17(IBISML), |
#Pages | 11 |
Date of Issue | 2017-09-08 (PRMU, IBISML) |