Presentation 1994/10/13
Learning Algorithm for Elman Networks based on Quasi-Newton Method
Kazumi Saito, Ryohei Nakano,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) The BPTT and RTRL algorithms are representative learning methods for recurrent neural networks.Since these methods,however,are based on the steepest-descent algorithm,they often require a large number of iterations for convergence.In this paper,we propose a new learning algorithm called BPTTQ,which employs an efficient calculation of the optimal step lengths as the minimal points of an approximation.Experiments showed that BPTTQ worked much better than the existing algorithms.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Elman networks / BPTT / RTRL / quasi-Newton method / optimal step-length
Paper # NC94-38
Date of Issue

Conference Information
Committee NC
Conference Date 1994/10/13(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Neurocomputing (NC)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Learning Algorithm for Elman Networks based on Quasi-Newton Method
Sub Title (in English)
Keyword(1) Elman networks
Keyword(2) BPTT
Keyword(3) RTRL
Keyword(4) quasi-Newton method
Keyword(5) optimal step-length
1st Author's Name Kazumi Saito
1st Author's Affiliation Science Laboratories,NTT Communication()
2nd Author's Name Ryohei Nakano
2nd Author's Affiliation Science Laboratories,NTT Communication
Date 1994/10/13
Paper # NC94-38
Volume (vol) vol.94
Number (no) 272
Page pp.pp.-
#Pages 8
Date of Issue