IEICE Technical Committee Submission System
Conference Paper's Information
Online Proceedings
[Sign in]
Tech. Rep. Archives
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2014-09-02 15:45
Sampling Learning Algorithm by Oracle Distribution
Sho Sonoda, Noboru Murata (Waseda Univ.) PRMU2014-52 IBISML2014-33
Abstract (in Japanese) (See Japanese page) 
(in English) A new sampling learning algorithm for neural networks is proposed. Based on the integral representation of neural networks, a practical algorithm for calculating an oracle probability distribution of hidden parameters is developed. The samples drawn from the oracle distribution would be good initial parameters for backpropagation. In general rigorous sampling from the oracle distribution holds numerical difficulty, a linear-time sampling algorithm is also developed. Numerical experiments showed that when hidden parameters were initialized by the oracle distribution, following backpropagation converged faster to better parameters than when parameters were initialized by a normal distribution.
Keyword (in Japanese) (See Japanese page) 
(in English) neural networks / integral representation / sampling learning / backpropagation / initialization / / /  
Reference Info. IEICE Tech. Rep., vol. 114, no. 198, IBISML2014-33, pp. 137-142, Sept. 2014.
Paper # IBISML2014-33 
Date of Issue 2014-08-25 (PRMU, IBISML) 
ISSN Print edition: ISSN 0913-5685  Online edition: ISSN 2432-6380
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034)
Download PDF PRMU2014-52 IBISML2014-33

Conference Information
Conference Date 2014-09-01 - 2014-09-02 
Place (in Japanese) (See Japanese page) 
Place (in English)  
Topics (in Japanese) (See Japanese page) 
Topics (in English)  
Paper Information
Registration To IBISML 
Conference Code 2014-09-PRMU-IBISML-CVIM 
Language Japanese 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) Sampling Learning Algorithm by Oracle Distribution 
Sub Title (in English)  
Keyword(1) neural networks  
Keyword(2) integral representation  
Keyword(3) sampling learning  
Keyword(4) backpropagation  
Keyword(5) initialization  
1st Author's Name Sho Sonoda  
1st Author's Affiliation Waseda University (Waseda Univ.)
2nd Author's Name Noboru Murata  
2nd Author's Affiliation Waseda University (Waseda Univ.)
3rd Author's Name  
3rd Author's Affiliation ()
4th Author's Name  
4th Author's Affiliation ()
5th Author's Name  
5th Author's Affiliation ()
6th Author's Name  
6th Author's Affiliation ()
7th Author's Name  
7th Author's Affiliation ()
8th Author's Name  
8th Author's Affiliation ()
9th Author's Name  
9th Author's Affiliation ()
10th Author's Name  
10th Author's Affiliation ()
11th Author's Name  
11th Author's Affiliation ()
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Date Time 2014-09-02 15:45:00 
Presentation Time 30 
Registration for IBISML 
Paper # IEICE-PRMU2014-52,IEICE-IBISML2014-33 
Volume (vol) IEICE-114 
Number (no) no.197(PRMU), no.198(IBISML) 
Page pp.137-142 
#Pages IEICE-6 
Date of Issue IEICE-PRMU-2014-08-25,IEICE-IBISML-2014-08-25 

[Return to Top Page]

[Return to IEICE Web Page]

The Institute of Electronics, Information and Communication Engineers (IEICE), Japan