| Presentation | 2023-03-02 [Poster Presentation] Influence of Data Hiding for Transformer Encoder of ViT Using DM-QIM Shuntaro Fukuoka, Shoko Imaizumi, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In this paper, we evaluate the influence of data hiding for vision transformer (ViT) models. Specifically, we embed a payload into the transformer encoder and investigate the influence on the classification accuracy and the convergence of the training. The previous studies embedded a payload into the multilayer perceptron (MLP) layer of a convolutional neural network (CNN) model. They proved that the data hiding had little influence on the convergence of the training. We extend the previous studies to apply to a ViT model and reveal the influences. Through our simulations, we confirm the validity of the proposed method in terms of the classification accuracy, the transition of loss function, and the number of epochs for convergence. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Vision Transformer / watermarking / copyright protection / data hiding / DM-QIM / loss function |
| Paper # | EMM2022-68 |
| Date of Issue | 2023-02-23 (EMM) |
| Conference Information | |
| Committee | EMM |
|---|---|
| Conference Date | 2023/3/2(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Fukue culture hall |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Ryoichi Nishimura(NICT) |
| Vice Chair | Kotaro Sonoda(Nagasaki Univ.) / Masatsugu Ichino(Univ. of Electro-Comm.) |
| Secretary | Kotaro Sonoda(Kaishi Professional Univ.) / Masatsugu Ichino(Chiba Univ.) |
| Assistant | Tomoko Kajiyama(Hiroshima City Univ.) / Shieyuki Sakazawa(Osaka Inst. of Tech.) |
| Paper Information | |
| Registration To | Technical Committee on Enriched MultiMedia |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | [Poster Presentation] Influence of Data Hiding for Transformer Encoder of ViT Using DM-QIM |
| Sub Title (in English) | |
| Keyword(1) | Vision Transformer |
| Keyword(2) | watermarking |
| Keyword(3) | copyright protection |
| Keyword(4) | data hiding |
| Keyword(5) | DM-QIM |
| Keyword(6) | loss function |
| 1st Author's Name | Shuntaro Fukuoka |
| 1st Author's Affiliation | Chiba University(Chiba Univ.) |
| 2nd Author's Name | Shoko Imaizumi |
| 2nd Author's Affiliation | Chiba University(Chiba Univ.) |
| Date | 2023-03-02 |
| Paper # | EMM2022-68 |
| Volume (vol) | vol.122 |
| Number (no) | EMM-412 |
| Page | pp.pp.7-12(EMM), |
| #Pages | 6 |
| Date of Issue | 2023-02-23 (EMM) |