Presentation 2003/5/22
Functional MRI study of short-term and long-term prediction of reward using Markov decision problem including Spatial information
Saori TANAKA, Kenji DOYA, Go OKADA, Kazutaka UEDA, Yasumasa OKAMOTO, Shigeto YAMAWAKI,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Evaluation of both immediate, and future outcomes of an action is a critical requirement for intelligent behaviors. Here we performed a functional MRI experiment in which subjects played a computer game that required prediction of both immnediate and future rewards. We estimated the time course of reward prediction at different time scales from subjects' performance data. We found topographic maps of different time scales in ventromedial prefrontal cortex and striatum. The result suggests that different cortico-basal ganglia loops are specialized for reward prediction at different time scales.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) reward prediction / fMRI / reinforcement learning / Markov decision problem / cortico-basal ganglia loop / neuromodulator / serotonin
Paper # NC2003-1
Date of Issue

Conference Information
Committee NC
Conference Date 2003/5/22(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Neurocomputing (NC)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Functional MRI study of short-term and long-term prediction of reward using Markov decision problem including Spatial information
Sub Title (in English)
Keyword(1) reward prediction
Keyword(2) fMRI
Keyword(3) reinforcement learning
Keyword(4) Markov decision problem
Keyword(5) cortico-basal ganglia loop
Keyword(6) neuromodulator
Keyword(7) serotonin
1st Author's Name Saori TANAKA
1st Author's Affiliation Nara Institute of Science and Technology:ATR Computational Neuroscience Laboratories:CREST, Japan Science and Technology Corporation()
2nd Author's Name Kenji DOYA
2nd Author's Affiliation Nara Institute of Science and Technology:ATR Computational Neuroscience Laboratories:CREST, Japan Science and Technology Corporation
3rd Author's Name Go OKADA
3rd Author's Affiliation Hiroshima University:CREST, Japan Science and Technology Corporation
4th Author's Name Kazutaka UEDA
4th Author's Affiliation Hiroshima University:CREST, Japan Science and Technology Corporation
5th Author's Name Yasumasa OKAMOTO
5th Author's Affiliation Hiroshima University:CREST, Japan Science and Technology Corporation
6th Author's Name Shigeto YAMAWAKI
6th Author's Affiliation Hiroshima University:CREST, Japan Science and Technology Corporation
Date 2003/5/22
Paper # NC2003-1
Volume (vol) vol.103
Number (no) 92
Page pp.pp.-
#Pages 6
Date of Issue