Presentation 2004/1/19
A model-based reinforcement learning : a functional brain model and an fMRI study (Neurocomputing)
Wako YOSHIDA, Shin ISHII,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) We, human beings, survive in a dynamic world by predicting the behaviors of the surrounding environment. A model-based reinforcement learning (RL), in which the model of environment is directly estimated, is one of the machine learning schemes to solve an optimal decision making problem in such an environment. In this report, we suggest a possible functional brain model of a model-based RL, in which the dorsolateral prefrontal cortex is involved in maintaining environmental models, and the anterior cingulate cortex is related to the action selection based on the models. We conduct a human fMRI study to examine our model, and find that experimental results are consistent with our functional model.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) optimal decision making / model-based reinforcement learning / fMRI / prefrontal cortex
Paper # NC2003-116
Date of Issue

Conference Information
Committee NC
Conference Date 2004/1/19(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Neurocomputing (NC)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) A model-based reinforcement learning : a functional brain model and an fMRI study (Neurocomputing)
Sub Title (in English)
Keyword(1) optimal decision making
Keyword(2) model-based reinforcement learning
Keyword(3) fMRI
Keyword(4) prefrontal cortex
1st Author's Name Wako YOSHIDA
1st Author's Affiliation Nara Institute of Science and Technology:CREST, Japan Science and Technology Corporation()
2nd Author's Name Shin ISHII
2nd Author's Affiliation Nara Institute of Science and Technology:CREST, Japan Science and Technology Corporation
Date 2004/1/19
Paper # NC2003-116
Volume (vol) vol.103
Number (no) 601
Page pp.pp.-
#Pages 6
Date of Issue