| Presentation | 2019-12-12 [Invited Talk] Consensus-Based Distributed Algorithms and Applications to Machine Learning Norikazu Takahashi, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Recently, consensus-based distributed optimization methods for multi-agent systems have been vigorously studied in the field of control theory. Using these methods, all agents can find the same optimal solution even though each agent knows only a small part of the objective function. This property is very important for machine learning, because each agent has access only to its own training data but can get the same result as in the case where it has access to whole training data. In this talk, the basic concept of consensus-based distributed optimization, and recent results obtained by the author's group are presented. First, representative consensus algorithms and their properties are explained. Next, the problem setting of consensus-based distributed optimization is shown, and some distributed optimization algorithms are illustrated. Finally, distributed algorithms developed by the author's group for optimization problems related to machine learning such as linear equations with nonnegativity constraints, training of neural networks and nonnegative matrix factorization are presented. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | consensus / distributed optimization / linear equation / neural network / nonnegative matrix factorization |
| Paper # | SIS2019-29 |
| Date of Issue | 2019-12-05 (SIS) |
| Conference Information | |
| Committee | SIS |
|---|---|
| Conference Date | 2019/12/12(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Okayama University of Science |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Smart Personal Systems, etc. |
| Chair | Takayuki Nakachi(NTT) |
| Vice Chair | Noriaki Suetake(Yamaguchi Univ.) / Tomoaki Kimura(Kanagawa Inst. of Tech.) |
| Secretary | Noriaki Suetake(Tokyo Metropolitan Univ.) / Tomoaki Kimura(Kindai Univ.) |
| Assistant | Hideaki Misawa(National Inst. of Tech., Ube College) / Yukihiro Bandoh(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Smart Info-Media Systems |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | [Invited Talk] Consensus-Based Distributed Algorithms and Applications to Machine Learning |
| Sub Title (in English) | |
| Keyword(1) | consensus |
| Keyword(2) | distributed optimization |
| Keyword(3) | linear equation |
| Keyword(4) | neural network |
| Keyword(5) | nonnegative matrix factorization |
| 1st Author's Name | Norikazu Takahashi |
| 1st Author's Affiliation | Okayama University(Okayama Univ.) |
| Date | 2019-12-12 |
| Paper # | SIS2019-29 |
| Volume (vol) | vol.119 |
| Number (no) | SIS-335 |
| Page | pp.pp.35-35(SIS), |
| #Pages | 1 |
| Date of Issue | 2019-12-05 (SIS) |