| Presentation | 2017-06-29 Consideration on Functions for Quantization in Quantized Neural Networks Takumi Kadokura, Hidehiro Nakano, Arata Miyauchi, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Quantized Neural Network (QNN) is a kind of neural networks in which its weights and activations are quantized. Since, QNN can reduce computational quantity and energy consumption by the quantization, it is expected to be used on embedded devices. This paper investigates quantization functions used for quantizing gradients in QNN. By performing the numerical experiments, the performance of some quantization functions are compared. We then show that there exists a quantization function which can keep high performance with low quantization bit rate. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Quantized Neural Networks / quantization / gradient |
| Paper # | CCS2017-2 |
| Date of Issue | 2017-06-22 (CCS) |
| Conference Information | |
| Committee | CCS |
|---|---|
| Conference Date | 2017/6/29(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Ibaraki Univ. |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Interaction and Communication, etc. |
| Chair | Naoki Wakamiya(Osaka Univ.) |
| Vice Chair | Mikio Hasegawa(Tokyo Univ. of Science) / Makoto Naruse(NICT) |
| Secretary | Mikio Hasegawa(Osaka Univ.) / Makoto Naruse(Tokyo City Univ.) |
| Assistant | Chisa Takano(Hirishima City Univ.) / Takashi Shimada(Univ. of Tokyo) / Tomoya Suzuki(Ibaraki Univ.) / Ryo Takahashi(AUT) |
| Paper Information | |
| Registration To | Technical Committee on Complex Communication Sciences |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Consideration on Functions for Quantization in Quantized Neural Networks |
| Sub Title (in English) | |
| Keyword(1) | Quantized Neural Networks |
| Keyword(2) | quantization |
| Keyword(3) | gradient |
| 1st Author's Name | Takumi Kadokura |
| 1st Author's Affiliation | Tokyo City University(Tokyo City Univ.) |
| 2nd Author's Name | Hidehiro Nakano |
| 2nd Author's Affiliation | Tokyo City University(Tokyo City Univ.) |
| 3rd Author's Name | Arata Miyauchi |
| 3rd Author's Affiliation | Tokyo City University(Tokyo City Univ.) |
| Date | 2017-06-29 |
| Paper # | CCS2017-2 |
| Volume (vol) | vol.117 |
| Number (no) | CCS-112 |
| Page | pp.pp.7-10(CCS), |
| #Pages | 4 |
| Date of Issue | 2017-06-22 (CCS) |