| Presentation | 1994/7/22 Parallel back propagation training algorithm for MIMD computer with 2D-torus network Jim Torresen, Shin-ichiro Mori, Hiroshi Nakashima, Shinji Tomita, Olav Lansverk, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | This paper describes several algorithms,mapping the back propagation learning algorithm onto a large 2-D torus architecture. To obtain high speedup,we have suggested an approach to combine the possible parallel aspects(training set parallelism,node parallelism and pipelining of training patterns)of the algorithm. Several algorithms were implemented on a 512 processor APIOOO and compared using NETtalk,a network that transforms text to speech. For a large number of processors we obtained best performance for the proposed ombined algorithm,reaching 76 million weight. updates per second using 512 processors.Our results show that to obtain high speedup on a large number of prosessors,all types of parallelism in the back propagation algorithm ought to be considered to be combined.Also,highly parallel general purpose computers can compete with the performance of neurocomputers. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Neural network / parallel processing / back propagation / AP1000 / NET talk |
| Paper # | CPSY94-30 |
| Date of Issue |
| Conference Information | |
| Committee | CPSY |
|---|---|
| Conference Date | 1994/7/22(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Computer Systems (CPSY) |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Parallel back propagation training algorithm for MIMD computer with 2D-torus network |
| Sub Title (in English) | |
| Keyword(1) | Neural network |
| Keyword(2) | parallel processing |
| Keyword(3) | back propagation |
| Keyword(4) | AP1000 |
| Keyword(5) | NET talk |
| 1st Author's Name | Jim Torresen |
| 1st Author's Affiliation | Department of Information Science,Faculty of Engineering,Kyoto University() |
| 2nd Author's Name | Shin-ichiro Mori |
| 2nd Author's Affiliation | Department of Information Science,Faculty of Engineering,Kyoto University |
| 3rd Author's Name | Hiroshi Nakashima |
| 3rd Author's Affiliation | Department of Information Science,Faculty of Engineering,Kyoto University |
| 4th Author's Name | Shinji Tomita |
| 4th Author's Affiliation | Department of Information Science,Faculty of Engineering,Kyoto University |
| 5th Author's Name | Olav Lansverk |
| 5th Author's Affiliation | Department of Campute Systems and Telematics,The Norwegian Insitute of Technology |
| Date | 1994/7/22 |
| Paper # | CPSY94-30 |
| Volume (vol) | vol.94 |
| Number (no) | 163 |
| Page | pp.pp.- |
| #Pages | 8 |
| Date of Issue | |