Presentation 2015-08-05
An Implementation of the Master-Worker based Parameter Server and its Application to BESOM
Meigi Rei, Yusuke Tanimura, Yuuji Ichisugi, Hidemoto Nakada,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) We have been proposing a computational model of the cerebral cortex called BESOM. BESOMmodels the cerebral cortex as Bayesian network based on recent findings in the neuroscience area. Because of its (relatively) faithful modeling, BESOMis not only scientifically interesting but also expected to be practically useful. On the other hand, machine learning with BESOMis a quite computation intensive task, even compared with the deep learning with conventional neural networks, that attract public attention recently. This means that parallel computation with multiple node is essential for BESOM. In this paper we implement a parameter exchange mechanism, publically known as ’parameter server’, using a general-purpose master-worker task execution mechanism, and constructed multi-node BESOMexecution environment using it. We confirmed the it shows 40 times faster execution time with 16 nodes and 8 threads each.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) BESOM / Master-Worker / Parameter server
Paper # CPSY2015-33
Date of Issue 2015-07-28 (CPSY)

Conference Information
Committee CPSY / DC / IPSJ-ARC
Conference Date 2015/8/4(3days)
Place (in Japanese) (See Japanese page)
Place (in English) B-Con Plaza (Beppu)
Topics (in Japanese) (See Japanese page)
Topics (in English) Parallel, Distributed and Cooperative Processing
Chair Yasuhiko Nakashima(NAIST) / Nobuyasu Kanekawa(Hitachi)
Vice Chair Koji Nakano(Hiroshima Univ.) / Hidetsugu Irie(Univ. of Tokyo) / Michiko Inoue(NAIST)
Secretary Koji Nakano(Fujitsu Labs.) / Hidetsugu Irie(NII) / Michiko Inoue(RTRI) / (Kyoto Sangyo Univ.)
Assistant Shinya Takameda(NAIST) / Takeshi Ohkawa(Utsunomiya Univ.)

Paper Information
Registration To Technical Committee on Computer Systems / Technical Committee on Dependable Computing / Special Interest Group on System Architecture
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) An Implementation of the Master-Worker based Parameter Server and its Application to BESOM
Sub Title (in English)
Keyword(1) BESOM
Keyword(2) Master-Worker
Keyword(3) Parameter server
1st Author's Name Meigi Rei
1st Author's Affiliation University of Tsukuba(U of Tsukuba)
2nd Author's Name Yusuke Tanimura
2nd Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
3rd Author's Name Yuuji Ichisugi
3rd Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
4th Author's Name Hidemoto Nakada
4th Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
Date 2015-08-05
Paper # CPSY2015-33
Volume (vol) vol.115
Number (no) CPSY-174
Page pp.pp.179-184(CPSY),
#Pages 6
Date of Issue 2015-07-28 (CPSY)