| Presentation | 2017-03-13 Application of Forward-Propagation Learning Rule to Three-Layer Auto-Encoder Tadamasa Kurosawa, Naohiro Fukumura, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | By the development of Deep Learning, the concern over three-layer Auto-Encoder for Pre-training has risen. On the other hand, a Forward-propagation learning rule that propagates errors forward as an inverse model learning method in biological motion control has been proposed. This method can be applied only to a system that learns the identity mapping in the whole system and learns faster than the conventional learning method, Back-propagation learning rule. However, learning is easy to divergence. In this research, we apply this learning method to the Auto-Encoder which learns identity mapping and tried learning with various algorithms using FP. Finally, we tried to apply it Pre-training using MNIST handwritten characters. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Auto-Encoder / Identity mapping / Forward-propagation learning rule / Pre-training |
| Paper # | NC2016-82 |
| Date of Issue | 2017-03-06 (NC) |
| Conference Information | |
| Committee | MBE / NC |
|---|---|
| Conference Date | 2017/3/13(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kikai-Shinko-Kaikan Bldg. |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Yutaka Fukuoka(Kogakuin Univ.) / Shigeo Sato(Tohoku Univ.) |
| Vice Chair | Kazuki Nakajima(Univ. of Toyama) / Masafumi Hagiwara(Keio Univ.) |
| Secretary | Kazuki Nakajima(Kogakuin Univ.) / Masafumi Hagiwara(Toyama Pref. Univ.) |
| Assistant | Ryota Horie(Shibaura Inst. of Tech.) / Kim Juhyon(Univ. of Toyama) / Hisanao Akima(Tohoku Univ.) / Yoshihisa Shinozawa(Keio Univ.) |
| Paper Information | |
| Registration To | Technical Committee on ME and Bio Cybernetics / Technical Committee on Neurocomputing |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Application of Forward-Propagation Learning Rule to Three-Layer Auto-Encoder |
| Sub Title (in English) | |
| Keyword(1) | Auto-Encoder |
| Keyword(2) | Identity mapping |
| Keyword(3) | Forward-propagation learning rule |
| Keyword(4) | Pre-training |
| 1st Author's Name | Tadamasa Kurosawa |
| 1st Author's Affiliation | Toyohashi University of Technology(Toyohashi Univ. of Tech) |
| 2nd Author's Name | Naohiro Fukumura |
| 2nd Author's Affiliation | Toyohashi University of Technology(Toyohashi Univ. of Tech) |
| Date | 2017-03-13 |
| Paper # | NC2016-82 |
| Volume (vol) | vol.116 |
| Number (no) | NC-521 |
| Page | pp.pp.109-114(NC), |
| #Pages | 6 |
| Date of Issue | 2017-03-06 (NC) |