| Presentation | 2019-11-28 A Multiplication by a Neural Network (NN) with Power Activations and a Polynomial Enclosure for a NN with Parametric ReLU Functions Kazuya Ozawa, Kaito Isogai, Toshihiro Tachibana, Hideo Nakano, Hideaki Okazaki, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Since a series of successes of Deep neural networks (DNNs) with rectified linear units (ReLUs), many approximations by NNs with ReLUs, parametric rectified linear units (PReLUs), or rectified power units (RePUs) have been focused on. However how to obtain the parameters of NNs with PReLUs, approximating polynomials, have not been fully discussed. In this paper for finding such parameters, a multiplication of NNs with n-th power (P) activation and a polynomial enclosure of NN with PReLUs are discussed. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Parametric rectified linear units / Neural Network / Polynomial function enclosure |
| Paper # | CAS2019-49,MSS2019-28 |
| Date of Issue | 2019-11-21 (CAS, MSS) |
| Conference Information | |
| Committee | CAS / MSS / IPSJ-AL |
|---|---|
| Conference Date | 2019/11/28(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Taizo Yamawaki(Hitachi) / Shigemasa Takai(Osaka Univ.) / 瀧本 英二(九大) |
| Vice Chair | Yasuhiro Takashima(Univ. of Kitakyushu) / Atsuo Ozaki(Osaka Inst. of Tech.) |
| Secretary | Yasuhiro Takashima(Hitachi) / Atsuo Ozaki(Yamanashi Univ.) / (Osaka Univ.) |
| Assistant | Hiroki Sato(Sony LSI Design) / Motoi Yamaguchi(Renesas Electronics) / Naoki Hayashi(Osaka Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Circuits and Systems / Technical Committee on Mathematical Systems Science and its applications / Special Interest Group on Algorithms |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A Multiplication by a Neural Network (NN) with Power Activations and a Polynomial Enclosure for a NN with Parametric ReLU Functions |
| Sub Title (in English) | |
| Keyword(1) | Parametric rectified linear units |
| Keyword(2) | Neural Network |
| Keyword(3) | Polynomial function enclosure |
| 1st Author's Name | Kazuya Ozawa |
| 1st Author's Affiliation | Shonan Institute of Technology(SIT) |
| 2nd Author's Name | Kaito Isogai |
| 2nd Author's Affiliation | Shonan Institute of Technology(SIT) |
| 3rd Author's Name | Toshihiro Tachibana |
| 3rd Author's Affiliation | Shonan Institute of Technology(SIT) |
| 4th Author's Name | Hideo Nakano |
| 4th Author's Affiliation | Shonan Institute of Technology(SIT) |
| 5th Author's Name | Hideaki Okazaki |
| 5th Author's Affiliation | Shonan Institute of Technology(SIT) |
| Date | 2019-11-28 |
| Paper # | CAS2019-49,MSS2019-28 |
| Volume (vol) | vol.119 |
| Number (no) | CAS-313,MSS-314 |
| Page | pp.pp.27-32(CAS), pp.27-32(MSS), |
| #Pages | 6 |
| Date of Issue | 2019-11-21 (CAS, MSS) |