| Presentation | 2018-03-14 Gradually Stacking Neural Network Shunya Sasaki, Masafumi Hagiwara, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In this paper, we propose a neural network with multiple layers in a stepwise manner. Neural networks (NNs) become more multilayered, it is possible to extract detailed features, but the vanishing gradient problem tends to occur. In order to solve this problem, we propose a method for multilayered NN in stages by using supervised learning. Redundant multilayering is avoided by automatically determining the ?nal number of layers. In this method, by repeating the addition of layers and the deletion of one, NN is multilayered in stages and this process is repeated until learning converges. As a result of evaluation experiment with classi?cation task, it was con?rmed that the optimum number of layers can be automatically determined with reducing gradient vanishing. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | backpropagation / greedy algorithm |
| Paper # | NC2017-97 |
| Date of Issue | 2018-03-06 (NC) |
| Conference Information | |
| Committee | MBE / NC |
|---|---|
| Conference Date | 2018/3/13(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kikai-Shinko-Kaikan Bldg. |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | ME, general |
| Chair | Kazuki Nakajima(Univ. of Toyama) / Masafumi Hagiwara(Keio Univ.) |
| Vice Chair | Masaki Kyoso(TCU) / Yutaka Hirata(Chubu Univ.) |
| Secretary | Masaki Kyoso(Toyama Pref. Univ.) / Yutaka Hirata(Kindai Univ.) |
| Assistant | Kim Juhyon(Univ. of Toyama) / Takumi Kobayashi(YNU) / Yoshihisa Shinozawa(Keio Univ.) / Keiichiro Inagaki(Chubu Univ.) |
| Paper Information | |
| Registration To | Technical Committee on ME and Bio Cybernetics / Technical Committee on Neurocomputing |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Gradually Stacking Neural Network |
| Sub Title (in English) | |
| Keyword(1) | backpropagation |
| Keyword(2) | greedy algorithm |
| 1st Author's Name | Shunya Sasaki |
| 1st Author's Affiliation | Keio Univercity(Keio Univ) |
| 2nd Author's Name | Masafumi Hagiwara |
| 2nd Author's Affiliation | Keio Univercity(Keio Univ) |
| Date | 2018-03-14 |
| Paper # | NC2017-97 |
| Volume (vol) | vol.117 |
| Number (no) | NC-508 |
| Page | pp.pp.175-180(NC), |
| #Pages | 6 |
| Date of Issue | 2018-03-06 (NC) |