| Presentation | 2021-06-28 Simplification of Average Consensus Algorithm in Distributed HALS Algorithm for NMF Keiju Hayashi, Tsuyoshi Migita, Norikazu Takahashi, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Nonnegative Matrix Factorization (NMF) is the process of approximating a given nonnegative matrix by the product of two nonnegative matrices, and has been applied to a wide range of fields such as image processing, audio signal processing, data mining, and recommendation systems. Recently, a distributed computation method has been proposed for multiple computers in a network to execute the hierarchical alternating least squares algorithm, which is well known as a fast computation method for NMF. This method enables us to perform NMF on large matrices with high accuracy, even in the case where they cannot be handled by a single computer. However, the average consensus algorithm used in this method requires each computer to store the entire history of the values of its variables until the complete average consensus is reached, which increases the memory usage and computational cost. In this paper, we propose a new distributed computation method that replaces the average consensus algorithm with a simple one, and verify its effectiveness experimentally. In particular, we experimentally evaluate how incomplete average consensus affects the accuracy of NMF. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | nonnegative matrix factorization / hierarchical alternating least squares algorithm / distributed computation / average consensus / multi-agent system |
| Paper # | NC2021-3,IBISML2021-3 |
| Date of Issue | 2021-06-21 (NC, IBISML) |
| Conference Information | |
| Committee | NC / IBISML / IPSJ-BIO / IPSJ-MPS |
|---|---|
| Conference Date | 2021/6/28(3days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Rieko Osu(Waseda Univ.) / Ichiro Takeuchi(Nagoya Inst. of Tech.) / 倉田 博之(九工大) / 関嶋 政和(東工大) |
| Vice Chair | Hiroshi Yamakawa(Univ of Tokyo) / Masashi Sugiyama(Univ. of Tokyo) |
| Secretary | Hiroshi Yamakawa(ATR) / Masashi Sugiyama(NICT) / (Univ. of Tokyo) / (AIST) |
| Assistant | Nobuhiko Wagatsuma(Toho Univ.) / Tomoki Kurikawa(KMU) / Tomoharu Iwata(NTT) / Atsuyoshi Nakamura(Hokkaido Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Neurocomputing / Technical Committee on Infomation-Based Induction Sciences and Machine Learning / Special Interest Group on Bioinformatics and Genomics / Special Interest Group on Mathematical Modeling and Problem Solving |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Simplification of Average Consensus Algorithm in Distributed HALS Algorithm for NMF |
| Sub Title (in English) | |
| Keyword(1) | nonnegative matrix factorization |
| Keyword(2) | hierarchical alternating least squares algorithm |
| Keyword(3) | distributed computation |
| Keyword(4) | average consensus |
| Keyword(5) | multi-agent system |
| 1st Author's Name | Keiju Hayashi |
| 1st Author's Affiliation | Okayama University(Okayama Univ.) |
| 2nd Author's Name | Tsuyoshi Migita |
| 2nd Author's Affiliation | Okayama University(Okayama Univ.) |
| 3rd Author's Name | Norikazu Takahashi |
| 3rd Author's Affiliation | Okayama University(Okayama Univ.) |
| Date | 2021-06-28 |
| Paper # | NC2021-3,IBISML2021-3 |
| Volume (vol) | vol.121 |
| Number (no) | NC-79,IBISML-80 |
| Page | pp.pp.15-22(NC), pp.15-22(IBISML), |
| #Pages | 8 |
| Date of Issue | 2021-06-21 (NC, IBISML) |