| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2009-07-14 13:00 Statistical Mechanics of Node-perturbation learning Kazuyuki Hara (Tokyo Metro. Colle. Ind. Eng.), Kentaro Katahira (ERATO), Kazuo Okanoya (RIKEN), Masato Okada (Tokyo Univ.)  NLP2009-38 NC2009-31 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | Node-perturbation learning is a stochastic gradient method, and it can apply to the problem where the objective function is not defined. Werfel gave the theoretical analysis of node-perturbation as a desecrate time learning curve obtained by averaging the error for possible inputs. On the other hand, we derive deterministic equations of the order parameters, which depict behavior of node-perturbation learning by using statistical mechanics method, and treated the generalization error as a function of the order parameters. From our analysis, we found the generalization error becomes large when number of outputs of the network becomes large through the cross-talk noise of the other outputs. We also found that Werfel's learning curve is identical to the generalization error when the thermodynamic limit is assumed. |
|
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Node-perturbation learning / Generalization error / Statistical Mechanics methods / linear perceptron / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 109, no. 125, NC2009-31, pp. 127-132, July 2009. | |
| Paper # | NC2009-31 | |
| Date of Issue | 2009-07-06 (NLP, NC) | |
| ISSN | Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | NLP2009-38 NC2009-31 |
|
| Conference Information | |
| Committee | NC NLP |
| Conference Date | 2009-07-13 - 2009-07-14 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | NAIST |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Paper Information | |
| Registration To | NC |
| Conference Code | 2009-07-NC-NLP |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Statistical Mechanics of Node-perturbation learning |
| Sub Title (in English) | |
| Keyword(1) | Node-perturbation learning |
| Keyword(2) | Generalization error |
| Keyword(3) | Statistical Mechanics methods |
| Keyword(4) | linear perceptron |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Kazuyuki Hara |
| 1st Author's Affiliation | Tokyo Metropolitan College of Industrial Engineering (Tokyo Metro. Colle. Ind. Eng.) |
| 2nd Author's Name | Kentaro Katahira |
| 2nd Author's Affiliation | Japa Science Technology Agency, ERATO (ERATO) |
| 3rd Author's Name | Kazuo Okanoya |
| 3rd Author's Affiliation | RIKEN (RIKEN) |
| 4th Author's Name | Masato Okada |
| 4th Author's Affiliation | The University of Tokyo (Tokyo Univ.) |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2009-07-14 13:00:00 |
| Presentation Time | 30 minutes |
| Registration for | NC |
| Paper # | NLP2009-38, NC2009-31 |
| Volume (vol) | vol.109 |
| Number (no) | no.124(NLP), no.125(NC) |
| Page | pp.127-132 |
| #Pages | 6 |
| Date of Issue | 2009-07-06 (NLP, NC) |
[Return to Top Page]