Presentation | 2022-11-18 Unsupervised Representation Learning over Decentralized Federated Learning Haruki Sakurai, Hideya Ochiai, Hiroshi Esaki, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | Contrastive Learning is a form of self-supervised learning, a method for learning a general-purpose encoder using a large unlabeled dataset. As one of the pre-training methods, it has been actively studied since around 2020. On the other hand, it is expected to become more and more difficult to collect datasets for pre-training models as people become more privacy-conscious. Decentralized Federated Learning is one of the solution for this problem, which can learn models without sharing private data and using cetral server. In this study, we propose how Contrastive Learning can learn over Decentralized Federated Learning. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | Federated Learning / Distributed Learning / Self-supervised Learning / Contrastive Learning |
Paper # | CAS2022-54,MSS2022-37 |
Date of Issue | 2022-11-10 (CAS, MSS) |
Conference Information | |
Committee | CAS / MSS / IPSJ-AL |
---|---|
Conference Date | 2022/11/17(2days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | |
Chair | Yoshinobu Maeda(Niigata Univ.) / Atsuo Ozaki(Osaka Inst. of Tech.) / 全 眞嬉(東北大学) |
Vice Chair | Yasutoshi Aibara(OmniVision) / Shingo Yamaguchi(Yamaguchi Univ.) |
Secretary | Yasutoshi Aibara(NIT, Toyama college) / Shingo Yamaguchi(Renesas Electronics) / (Hokkaido Univ.) |
Assistant | Takahide Sato(Univ. of Yamanashi) / Motoi Yamaguchi(TECHNOPRO) / Shinji Shimoda(Sony Semiconductor Solutions) / Shunsuke Koshita(Hachinohe Inst. of Tech.) / Masato Shirai(Shimane Univ.) |
Paper Information | |
Registration To | Technical Committee on Circuits and Systems / Technical Committee on Mathematical Systems Science and its Applications / Special Interest Group on Algorithms |
---|---|
Language | JPN |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | Unsupervised Representation Learning over Decentralized Federated Learning |
Sub Title (in English) | |
Keyword(1) | Federated Learning |
Keyword(2) | Distributed Learning |
Keyword(3) | Self-supervised Learning |
Keyword(4) | Contrastive Learning |
Keyword(5) | |
1st Author's Name | Haruki Sakurai |
1st Author's Affiliation | The University of Tokyo(Univ. Tokyo) |
2nd Author's Name | Hideya Ochiai |
2nd Author's Affiliation | The University of Tokyo(Univ. Tokyo) |
3rd Author's Name | Hiroshi Esaki |
3rd Author's Affiliation | The University of Tokyo(Univ. Tokyo) |
Date | 2022-11-18 |
Paper # | CAS2022-54,MSS2022-37 |
Volume (vol) | vol.122 |
Number (no) | CAS-253,MSS-254 |
Page | pp.pp.79-82(CAS), pp.79-82(MSS), |
#Pages | 4 |
Date of Issue | 2022-11-10 (CAS, MSS) |