Paper Abstract and Keywords |
Presentation |
2015-03-16 14:45
Reinforcement Learning based on Internal-Dynamics-Derived Exploration Using a Chaotic Neural Network Katsunari Shibata, Yuta Sakashita (Oita Univ.) MBE2014-166 NC2014-117 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
As a basic concept for emergence of intelligence through autonomous learning, exploration that is es- sential in reinforcement learning is considered as one aspect of the learner’s internal dynamics, which is expected to develop through learning towards purposive and dynamic higher functions such as ‘thinking’. A chaotic neural network is used to generate motions that include exploratory factors based on the chaotic dynamics without adding external random noises. Effective exploration is expected based on the dynamics such as “chaotic itinerancy”, which is also the key to learn dynamic higher functions more easily that needs both stable and transitive dynamics. Fur- thermore, a reinforcement learning method without external random noises by focusing on the correlation between the TD (Temporal Difference) error of the state value and the output change of each neuron is newly proposed. It was confirmed that an agent learned goal-directed behaviors in a simple task. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
chaotic neural network / exploration / reinforcement learning / dynamics / thinking / / / |
Reference Info. |
IEICE Tech. Rep., vol. 114, no. 515, NC2014-117, pp. 277-282, March 2015. |
Paper # |
NC2014-117 |
Date of Issue |
2015-03-09 (MBE, NC) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
MBE2014-166 NC2014-117 |
Conference Information |
Committee |
NC MBE |
Conference Date |
2015-03-16 - 2015-03-17 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Tamagawa University |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
ME, etc |
Paper Information |
Registration To |
NC |
Conference Code |
2015-03-NC-MBE |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Reinforcement Learning based on Internal-Dynamics-Derived Exploration Using a Chaotic Neural Network |
Sub Title (in English) |
|
Keyword(1) |
chaotic neural network |
Keyword(2) |
exploration |
Keyword(3) |
reinforcement learning |
Keyword(4) |
dynamics |
Keyword(5) |
thinking |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Katsunari Shibata |
1st Author's Affiliation |
Oita University (Oita Univ.) |
2nd Author's Name |
Yuta Sakashita |
2nd Author's Affiliation |
Oita University (Oita Univ.) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2015-03-16 14:45:00 |
Presentation Time |
25 minutes |
Registration for |
NC |
Paper # |
MBE2014-166, NC2014-117 |
Volume (vol) |
vol.114 |
Number (no) |
no.514(MBE), no.515(NC) |
Page |
pp.277-282 |
#Pages |
6 |
Date of Issue |
2015-03-09 (MBE, NC) |
|