Presentation | 2003/5/22 Functional MRI study of short-term and long-term prediction of reward using Markov decision problem including Spatial information Saori TANAKA, Kenji DOYA, Go OKADA, Kazutaka UEDA, Yasumasa OKAMOTO, Shigeto YAMAWAKI, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | Evaluation of both immediate, and future outcomes of an action is a critical requirement for intelligent behaviors. Here we performed a functional MRI experiment in which subjects played a computer game that required prediction of both immnediate and future rewards. We estimated the time course of reward prediction at different time scales from subjects' performance data. We found topographic maps of different time scales in ventromedial prefrontal cortex and striatum. The result suggests that different cortico-basal ganglia loops are specialized for reward prediction at different time scales. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | reward prediction / fMRI / reinforcement learning / Markov decision problem / cortico-basal ganglia loop / neuromodulator / serotonin |
Paper # | NC2003-1 |
Date of Issue |
Conference Information | |
Committee | NC |
---|---|
Conference Date | 2003/5/22(1days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | |
Chair | |
Vice Chair | |
Secretary | |
Assistant |
Paper Information | |
Registration To | Neurocomputing (NC) |
---|---|
Language | JPN |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | Functional MRI study of short-term and long-term prediction of reward using Markov decision problem including Spatial information |
Sub Title (in English) | |
Keyword(1) | reward prediction |
Keyword(2) | fMRI |
Keyword(3) | reinforcement learning |
Keyword(4) | Markov decision problem |
Keyword(5) | cortico-basal ganglia loop |
Keyword(6) | neuromodulator |
Keyword(7) | serotonin |
1st Author's Name | Saori TANAKA |
1st Author's Affiliation | Nara Institute of Science and Technology:ATR Computational Neuroscience Laboratories:CREST, Japan Science and Technology Corporation() |
2nd Author's Name | Kenji DOYA |
2nd Author's Affiliation | Nara Institute of Science and Technology:ATR Computational Neuroscience Laboratories:CREST, Japan Science and Technology Corporation |
3rd Author's Name | Go OKADA |
3rd Author's Affiliation | Hiroshima University:CREST, Japan Science and Technology Corporation |
4th Author's Name | Kazutaka UEDA |
4th Author's Affiliation | Hiroshima University:CREST, Japan Science and Technology Corporation |
5th Author's Name | Yasumasa OKAMOTO |
5th Author's Affiliation | Hiroshima University:CREST, Japan Science and Technology Corporation |
6th Author's Name | Shigeto YAMAWAKI |
6th Author's Affiliation | Hiroshima University:CREST, Japan Science and Technology Corporation |
Date | 2003/5/22 |
Paper # | NC2003-1 |
Volume (vol) | vol.103 |
Number (no) | 92 |
Page | pp.pp.- |
#Pages | 6 |
Date of Issue |