Paper Abstract and Keywords |
Presentation |
2018-03-14 15:30
Gradually Stacking Neural Network Shunya Sasaki, Masafumi Hagiwara (Keio Univ) NC2017-97 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
In this paper, we propose a neural network with multiple layers in a stepwise manner. Neural networks (NNs) become more multilayered, it is possible to extract detailed features, but the vanishing gradient problem tends to occur. In order to solve this problem, we propose a method for multilayered NN in stages by using supervised learning. Redundant multilayering is avoided by automatically determining the final number of layers. In this method, by repeating the addition of layers and the deletion of one, NN is multilayered in stages and this process is repeated until learning converges. As a result of evaluation experiment with classification task, it was confirmed that the optimum number of layers can be automatically determined with reducing gradient vanishing. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
backpropagation / greedy algorithm / / / / / / |
Reference Info. |
IEICE Tech. Rep., vol. 117, no. 508, NC2017-97, pp. 175-180, March 2018. |
Paper # |
NC2017-97 |
Date of Issue |
2018-03-06 (NC) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
NC2017-97 |
Conference Information |
Committee |
MBE NC |
Conference Date |
2018-03-13 - 2018-03-14 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Kikai-Shinko-Kaikan Bldg. |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
ME, general |
Paper Information |
Registration To |
NC |
Conference Code |
2018-03-MBE-NC |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Gradually Stacking Neural Network |
Sub Title (in English) |
|
Keyword(1) |
backpropagation |
Keyword(2) |
greedy algorithm |
Keyword(3) |
|
Keyword(4) |
|
Keyword(5) |
|
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Shunya Sasaki |
1st Author's Affiliation |
Keio Univercity (Keio Univ) |
2nd Author's Name |
Masafumi Hagiwara |
2nd Author's Affiliation |
Keio Univercity (Keio Univ) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2018-03-14 15:30:00 |
Presentation Time |
25 minutes |
Registration for |
NC |
Paper # |
NC2017-97 |
Volume (vol) |
vol.117 |
Number (no) |
no.508 |
Page |
pp.175-180 |
#Pages |
6 |
Date of Issue |
2018-03-06 (NC) |
|