| Presentation | 2010/6/11 Study on Robust Training of Neural Networks using Gradient-based Algorithm with Improved Feeding-technique of Training Data Toshikazu ABE, Yoshihiko SAKASHITA, Hiroshi NINOMIYA, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Various techniques based on the gradient descent method have been studied as the training algorithm for neural networks. Neural network training poses data-driven optimization problems in which the objective function involves the summation of loss terms over a set of data to be modeled. For a given set of training data, the gradient-based algorithms operate in one of two modes: stochastic (online) or batch. Recently, the robust training algorithm based on quasi-Newton method has been introduced improving the feeding-technique of training data. The algorithm combines the "stochastic (online)" mode with the "batch" one. In this paper the improved feeding-technique of training data is applied to the other gradient-based training algorithms. The convergence properties of the improved feeding-technique of training data to the gradient-based algorithms are studied through the computer simulations. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | neural networks / learning training algorithm / online training method / batch training method |
| Paper # | NC2010-9,NLP2010-9 |
| Date of Issue |
| Conference Information | |
| Committee | NC |
|---|---|
| Conference Date | 2010/6/11(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Neurocomputing (NC) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Study on Robust Training of Neural Networks using Gradient-based Algorithm with Improved Feeding-technique of Training Data |
| Sub Title (in English) | |
| Keyword(1) | neural networks |
| Keyword(2) | learning training algorithm |
| Keyword(3) | online training method |
| Keyword(4) | batch training method |
| 1st Author's Name | Toshikazu ABE |
| 1st Author's Affiliation | Electrical and Information Engineering, Shonan Institute of Technology() |
| 2nd Author's Name | Yoshihiko SAKASHITA |
| 2nd Author's Affiliation | Department of Information Science, Faculty of Engineering, Shonan Institute of Technology |
| 3rd Author's Name | Hiroshi NINOMIYA |
| 3rd Author's Affiliation | Department of Information Science, Faculty of Engineering, Shonan Institute of Technology |
| Date | 2010/6/11 |
| Paper # | NC2010-9,NLP2010-9 |
| Volume (vol) | vol.110 |
| Number (no) | 83 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |