Paper Abstract and Keywords |
Presentation |
2009-01-19 13:55
On the Effect of Hyperparameter to Generalization Error in Variational Bayes Learning Shinji Oyama, Sumio Watanabe (Tokyo Inst. of Tech.) NC2008-87 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
In variational Bayes learning, the probability distribution of the hidden variable and parameter is made by the mean field approximation. In a mixture of exponential probability distributions such a normal mixture, the mean field approximation is applied to wide practical problems because it provides the fast recursive learning algorithm. It was theoretically clarified the phase transition structure of variational Bayes learning for hyperparameter. In this paper, we study the generalization errors of variational Bayes learning and experimentally show the following facts. (1) The behavior of the generalization error changes between the phase transition point. (2) At an ordinary point, the generalization error strongly depends on the condition that the true distribution is contained in the statistical model or not, whereas, at the critical point, the generalization error is not so depend on the condition. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Singular learning machines / variational Bayes generalization error / Gibbs generalization error / hyperparameter / / / / |
Reference Info. |
IEICE Tech. Rep., vol. 108, no. 383, NC2008-87, pp. 31-36, Jan. 2009. |
Paper # |
NC2008-87 |
Date of Issue |
2009-01-12 (NC) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
NC2008-87 |
Conference Information |
Committee |
NC |
Conference Date |
2009-01-19 - 2009-01-20 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Hokkaido Univ. |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Neural Dynamics, etc. |
Paper Information |
Registration To |
NC |
Conference Code |
2009-01-NC |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
On the Effect of Hyperparameter to Generalization Error in Variational Bayes Learning |
Sub Title (in English) |
|
Keyword(1) |
Singular learning machines |
Keyword(2) |
variational Bayes generalization error |
Keyword(3) |
Gibbs generalization error |
Keyword(4) |
hyperparameter |
Keyword(5) |
|
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Shinji Oyama |
1st Author's Affiliation |
Tokyo Institute of Technology (Tokyo Inst. of Tech.) |
2nd Author's Name |
Sumio Watanabe |
2nd Author's Affiliation |
Tokyo Institute of Technology (Tokyo Inst. of Tech.) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2009-01-19 13:55:00 |
Presentation Time |
25 minutes |
Registration for |
NC |
Paper # |
NC2008-87 |
Volume (vol) |
vol.108 |
Number (no) |
no.383 |
Page |
pp.31-36 |
#Pages |
6 |
Date of Issue |
2009-01-12 (NC) |
|