Presentation | 2019-06-07 Before the Edge of Chaos Taichi Haruna, Kohei Nakajima, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | We study short-term memory of discrete-time nonlinear recurrent neural networks driven by small input signals. We theoretically calculate memory capacity by combining a mean-field theory with the small input assumption. We show that the network contribution of memory capacity peaks in the parameter region which is chaotic in the absence of input signals while is ordered in the presence of input signals. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | Recurrent neural networks / Reservoir computing / Memory capacity / Mean-field theory |
Paper # | NLP2019-23,CCS2019-6 |
Date of Issue | 2019-05-31 (NLP, CCS) |
Conference Information | |
Committee | CCS / NLP |
---|---|
Conference Date | 2019/6/7(3days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | machinaka campus nagaoka |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | |
Chair | Makoto Naruse(NICT) / Hiroaki Kurokawa(Tokyo Univ. of Tech.) |
Vice Chair | Shigeki Shiokawa(Kanagawa Inst. of Tech.) / Tetsuya Asai(Hokkaido Univ.) / Kiyohisa Natsume(Kyushu Inst. of Tech.) |
Secretary | Shigeki Shiokawa(Hiroshima City Univ.) / Tetsuya Asai(Kanagawa Inst. of Tech.) / Kiyohisa Natsume(Nippon Inst. of Tech.) |
Assistant | Hidehiro Nakano(Tokyo City Univ.) / Kazuki Nakada(Tsukuba Univ. of Tech.) / Hiroyasu Ando(Tsukuba Univ.) / Takashi Matsubara(Kobe Univ.) / Yutaka Shimada(Saitama Univ.) / Toshikaza Samura(Yamaguchi Univ.) |
Paper Information | |
Registration To | Technical Committee on Complex Communication Sciences / Technical Committee on Nonlinear Problems |
---|---|
Language | JPN |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | Before the Edge of Chaos |
Sub Title (in English) | Short-Term Memory in Echo State Networks |
Keyword(1) | Recurrent neural networks |
Keyword(2) | Reservoir computing |
Keyword(3) | Memory capacity |
Keyword(4) | Mean-field theory |
1st Author's Name | Taichi Haruna |
1st Author's Affiliation | Tokyo Woman's Christian University(TWCU) |
2nd Author's Name | Kohei Nakajima |
2nd Author's Affiliation | The University of Tokyo(Tokyo Univ.) |
Date | 2019-06-07 |
Paper # | NLP2019-23,CCS2019-6 |
Volume (vol) | vol.119 |
Number (no) | NLP-71,CCS-72 |
Page | pp.pp.25-29(NLP), pp.25-29(CCS), |
#Pages | 5 |
Date of Issue | 2019-05-31 (NLP, CCS) |