Paper Abstract and Keywords |
Presentation |
2021-06-28 13:50
Simplification of Average Consensus Algorithm in Distributed HALS Algorithm for NMF Keiju Hayashi, Tsuyoshi Migita, Norikazu Takahashi (Okayama Univ.) NC2021-3 IBISML2021-3 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
Nonnegative Matrix Factorization (NMF) is the process of approximating a given nonnegative matrix by the product of two nonnegative matrices, and has been applied to a wide range of fields such as image processing, audio signal processing, data mining, and recommendation systems. Recently, a distributed computation method has been proposed for multiple computers in a network to execute the hierarchical alternating least squares algorithm, which is well known as a fast computation method for NMF. This method enables us to perform NMF on large matrices with high accuracy, even in the case where they cannot be handled by a single computer. However, the average consensus algorithm used in this method requires each computer to store the entire history of the values of its variables until the complete average consensus is reached, which increases the memory usage and computational cost. In this paper, we propose a new distributed computation method that replaces the average consensus algorithm with a simple one, and verify its effectiveness experimentally. In particular, we experimentally evaluate how incomplete average consensus affects the accuracy of NMF. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
nonnegative matrix factorization / hierarchical alternating least squares algorithm / distributed computation / average consensus / multi-agent system / / / |
Reference Info. |
IEICE Tech. Rep., vol. 121, no. 80, IBISML2021-3, pp. 15-22, June 2021. |
Paper # |
IBISML2021-3 |
Date of Issue |
2021-06-21 (NC, IBISML) |
ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
NC2021-3 IBISML2021-3 |
Conference Information |
Committee |
NC IBISML IPSJ-BIO IPSJ-MPS |
Conference Date |
2021-06-28 - 2021-06-30 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Online |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
|
Paper Information |
Registration To |
IBISML |
Conference Code |
2021-06-NC-IBISML-BIO-MPS |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Simplification of Average Consensus Algorithm in Distributed HALS Algorithm for NMF |
Sub Title (in English) |
|
Keyword(1) |
nonnegative matrix factorization |
Keyword(2) |
hierarchical alternating least squares algorithm |
Keyword(3) |
distributed computation |
Keyword(4) |
average consensus |
Keyword(5) |
multi-agent system |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Keiju Hayashi |
1st Author's Affiliation |
Okayama University (Okayama Univ.) |
2nd Author's Name |
Tsuyoshi Migita |
2nd Author's Affiliation |
Okayama University (Okayama Univ.) |
3rd Author's Name |
Norikazu Takahashi |
3rd Author's Affiliation |
Okayama University (Okayama Univ.) |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2021-06-28 13:50:00 |
Presentation Time |
25 minutes |
Registration for |
IBISML |
Paper # |
NC2021-3, IBISML2021-3 |
Volume (vol) |
vol.121 |
Number (no) |
no.79(NC), no.80(IBISML) |
Page |
pp.15-22 |
#Pages |
8 |
Date of Issue |
2021-06-21 (NC, IBISML) |
|