Presentation | 2022-06-27 AI knowledge forgetting based on the importance of model parameters Tomoya Yamashita, Masanori Yamada, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | The accuracy of Deep Learning has been greatly improved by the progress of research in computer technology and Deep Learning techniques, and it has produced results in many fields. However, as Deep Learning becomes more widely used, problems related to privacy violation and data leakage are expected to arise. In this paper, we aim to solve these problems by making Deep Learning models forget their knowledge. We propose a method of forgetting knowledge about a desired task by adding noise to Deep Learning model parameters. Experimental results confirm that the proposed method achieves knowledge oblivion of Deep Learning models. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | Deep Learning / Continual Learning / EWC / Catastrophic Forgetting / Privacy Protection |
Paper # | NC2022-3,IBISML2022-3 |
Date of Issue | 2022-06-20 (NC, IBISML) |
Conference Information | |
Committee | NC / IBISML / IPSJ-BIO / IPSJ-MPS |
---|---|
Conference Date | 2022/6/27(3days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | |
Chair | Hiroshi Yamakawa(Univ of Tokyo) / Masashi Sugiyama(Univ. of Tokyo) |
Vice Chair | Hirokazu Tanaka(Tokyo City Univ.) / Toshihiro Kamishima(AIST) / Koji Tsuda(Univ. of Tokyo) |
Secretary | Hirokazu Tanaka(NTT) / Toshihiro Kamishima(NICT) / Koji Tsuda(NTT) / (Hokkaido Univ.) |
Assistant | Yoshimasa Tawatsuji(Waseda Univ.) / Tomoki Kurikawa(KMU) / Yoshinobu Kawahara(Osaka Univ.) / Taiji Suzuki(Tokyo Inst. of Tech.) |
Paper Information | |
Registration To | Technical Committee on Neurocomputing / Technical Committee on Infomation-Based Induction Sciences and Machine Learning / Special Interest Group on Bioinformatics and Genomics / Special Interest Group on Mathematical Modeling and Problem Solving |
---|---|
Language | JPN |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | AI knowledge forgetting based on the importance of model parameters |
Sub Title (in English) | |
Keyword(1) | Deep Learning |
Keyword(2) | Continual Learning |
Keyword(3) | EWC |
Keyword(4) | Catastrophic Forgetting |
Keyword(5) | Privacy Protection |
1st Author's Name | Tomoya Yamashita |
1st Author's Affiliation | NTT Social Informatics Laboratories(NTT) |
2nd Author's Name | Masanori Yamada |
2nd Author's Affiliation | NTT Social Informatics Laboratories(NTT) |
Date | 2022-06-27 |
Paper # | NC2022-3,IBISML2022-3 |
Volume (vol) | vol.122 |
Number (no) | NC-89,IBISML-90 |
Page | pp.pp.14-19(NC), pp.14-19(IBISML), |
#Pages | 6 |
Date of Issue | 2022-06-20 (NC, IBISML) |