| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2019-03-04 10:45 Adjustment of exploratory behavior using mutual information in reinforcement learning Kaiji Koyama, Jun Ohkubo (Saitama Univ.)  NC2018-51 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | One of the important problems in reinforcement learning is the exploration-exploitation trade-off. In this research, we propose a method to use mutual information as a exploration bonus in experimental settings with sudden environmental change; for example, we consider a maze problem in which walls will suddenly appear or disappear. As for the environmental changes, there are some previous researches such as the usage of entropy as exploration bonus and a meta-parameter control method in Boltzmann selection rule. Here, the proposed method using the mutual information is implemented in the Q learning, including the meta-parameter control method, and numerical experiments are performed. The numerical results show that the mutual information can work well as the exploration bonus. |
|
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | reinforcement learning / mutual information / / / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 118, no. 470, NC2018-51, pp. 43-47, March 2019. | |
| Paper # | NC2018-51 | |
| Date of Issue | 2019-02-25 (NC) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | NC2018-51 |
|
| Conference Information | |
| Committee | NC MBE |
| Conference Date | 2019-03-04 - 2019-03-06 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | University of Electro Communications |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Paper Information | |
| Registration To | NC |
| Conference Code | 2019-03-NC-MBE |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Adjustment of exploratory behavior using mutual information in reinforcement learning |
| Sub Title (in English) | |
| Keyword(1) | reinforcement learning |
| Keyword(2) | mutual information |
| Keyword(3) | |
| Keyword(4) | |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Kaiji Koyama |
| 1st Author's Affiliation | Saitama University (Saitama Univ.) |
| 2nd Author's Name | Jun Ohkubo |
| 2nd Author's Affiliation | Saitama University (Saitama Univ.) |
| 3rd Author's Name | |
| 3rd Author's Affiliation | () |
| 4th Author's Name | |
| 4th Author's Affiliation | () |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2019-03-04 10:45:00 |
| Presentation Time | 25 minutes |
| Registration for | NC |
| Paper # | NC2018-51 |
| Volume (vol) | vol.118 |
| Number (no) | no.470 |
| Page | pp.43-47 |
| #Pages | 5 |
| Date of Issue | 2019-02-25 (NC) |
[Return to Top Page]