Abstract：Model-based fMRI approach has emerged as a promising potential technique in neuroimaging field since the new century. Compared to conventional fMRI approach, model-based fMRI approach can provide insight into how a particular cognitive process is implemented in a specific brain area or brain circuit as opposed to merely identifying where a particular process is located. It can reveal the relationship between internal variable of the model and the neuroimaging data, which provides an important approach to investigate brain functional activity effectively. This article mainly focused on the model-based fMRI approach in terms of the two computational frameworks (modeling single area: including reinforcement learning model and subjective value model; modeling brain areas interaction: psychophysiological interaction), and briefly described the application of model-based fMRI approach as well as its latest progress. Finally, we discussed the existing deficiencies of this approach and a prospect for its future development trend.
[1] O’Doherty JP, Dayan P, Friston K, et al. Temporal difference models and reward-related learning in the human brain [J]. Neuron, 2003,38(2):329-337.
[2] O’Doherty JP, Hampton A, Kim H. Model-Based Fmri And Its Application To Reward Learning And Decision Making [J]. Annals of the New York Academy of Sciences, 2007,1104(1):35-53.
[3] Forstmann BU, Wagenmakers E-J. Model-Based Cognitive Neuroscience: A Conceptual Introduction[M]// Forstmann BU, Wagenmakers EJ. An Introduction to Model-Based Cognitive Neuroscience.New York: Springer New York, 2015: 139-156.
[4] Huettel SA. Event-related fMRI in cognition [J]. Neuroimage, 2012,62(2):1152-1156.
[5] Gläscher JP, O′Doherty JP. Model‐based approaches to neuroimaging: combining reinforcement learning theory with fMRI data [J]. Wiley Interdisciplinary Reviews: Cognitive Science, 2010,1(4):501-510.
[6] Fu WT, Anderson JR. From recurrent choice to skill learning: a reinforcement-learning model [J]. Journal of Experimental Psychology: General, 2006,135(2):184-206.
[7] Park SQ, Kahnt T, Rieskamp J, et al. Neurobiology of value integration: when value impacts valuation [J]. The Journal of Neuroscience, 2011,31(25):9307-9314.
[8] Friston K, Buechel C, Fink G, et al. Psychophysiological and modulatory interactions in neuroimaging [J]. Neuroimage, 1997,6(3):218-229.
[9] O’Doherty JP, Buchanan TW, Seymour B, et al. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum [J]. Neuron, 2006,49(1):157-166.
[10] Mathys C, Daunizeau J, Friston KJ, et al. A Bayesian foundation for individual learning under uncertainty [J]. Frontiers in Human Neuroscience, 2011,5(2):39.
[11] Sutton RS, Barto AG. Reinforcement learning: An introduction [M].Cambridge: Cambridge Univ Press, 2011.
[12] O'Doherty J, Dayan P, Schultz J, et al. Dissociable roles of ventral and dorsal striatum in instrumental conditioning [J]. Science, 2004,304(5669):págs. 452-454.
[13] Seymour B, Daw N, Dayan P, et al. Differential Encoding of Losses and Gains in the Human Striatum [J]. Journal of Neuroscience the Official Journal of the Society for Neuroscience, 2007,27(18):4826-4831.
[14] Gläscher J, Hampton AN, O'Doherty JP. Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making [J]. Cerebral Cortex, 2009,19(2):483-495.
[15] Murray G, Corlett PL, Pessiglione M, et al. Substantia nigra/ventral tegmental reward prediction error disruption in psychosis [J]. Molecular Psychiatry, 2008,13(3):267-276.
[16] Chen C, Omiya Y, Yang S. Dissociating contributions of ventral and dorsal striatum to reward learning [J]. Journal of Neurophysiology, 2015,114(3):1364-1366.
[17] White CN, Congdon E, Mumford JA, et al. Decomposing decision components in the stop-signal task: a model-based approach to individual differences in inhibitory control [J]. Journal of Cognitive Neuroscience, 2014,26(8):1601-1614.
[18] Hu S, Ide JS, Zhang S, et al. Conflict anticipation in alcohol dependence—A model-based fMRI study of stop signal task [J]. NeuroImage: Clinical, 2015,8:39-50.
[19] Bratec SM, Xie X, Schmid G, et al. Cognitive emotion regulation enhances aversive prediction error activity while reducing emotional responses [J]. Neuroimage, 2015,123:138-148.
[20] Davis T, Love BC, Preston AR. Striatal and hippocampal entropy and recognition signals in category learning: simultaneous processes revealed by model-based fMRI [J]. Journal of Experimental Psychology: Learning, Memory and Cognition, 2012,38(4):821-839.
[21] Bartra O, McGuire JT, Kable JW. The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value [J]. Neuroimage, 2013,76:412-427.
[22] Kable JW, Glimcher PW. The neural correlates of subjective value during intertemporal choice [J]. Nature Neuroscience, 2007,10(12):1625-1633.
[23] Peters J, Büchel C. Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision making [J]. The Journal of Neuroscience, 2009,29(50):15727-15734.
[24] Miedl SF, Büchel C, Peters J. Cue-induced craving increases impulsivity via changes in striatal value signals in problem gamblers [J]. The Journal of Neuroscience, 2014,34(13):4750-4755.
[25] Das P, Kemp AH, Liddell BJ, et al. Pathways for fear perception: modulation of amygdala activity by thalamo-cortical systems [J]. Neuroimage, 2005,26(1):141-148.
[26] Das P, Kemp AH, Flynn G, et al. Functional disconnections in the direct and indirect amygdala pathways for fear processing in schizophrenia [J]. Schizophrenia Research, 2007,90(1):284-294.
[27] Wu T, Chan P, Hallett M. Effective connectivity of neural networks in automatic movements in Parkinson's disease [J]. Neuroimage, 2010,49(3):2581-2587.
[28] Bryant RA, Kemp AH, Felmingham KL, et al. Enhanced amygdala and medial prefrontal activation during nonconscious processing of fear in posttraumatic stress disorder: An fMRI study [J]. Human Brain Mapping, 2008,29(5):517-523.
[29] Wade J, Kelso S, Crunelli V, et al. Biophysically based computational models of astrocyte～ neuron coupling and their functional significance [J]. Frontiers in Computational Neuroscience, 2013,7:44.
[30] Anticevic A, Gancsos M, Murray JD, et al. NMDA receptor function in large-scale anticorrelated neural systems with implications for cognition and schizophrenia [J]. Proceedings of the National Academy of Sciences, 2012,109(41):16720-16725.
[31] Anticevic A, Corlett PR, Cole MW, et al. N-Methyl-D-Aspartate receptor antagonist effects on prefrontal cortical connectivity better model early than chronic schizophrenia [J]. Biological Psychiatry, 2015,77(6):569-580.
[32] Anticevic A, Murray JD, Barch DM. Bridging levels of understanding in schizophrenia through computational modeling [J]. Clinical Psychological Science, 2015,3(3):433-459.
[33] Wilson RC, Niv Y. Is model fitting necessary for model-based fMRI?[J]. Plos Computational Biology,2015, 11 (6): e1004237.
[34] Den Ouden HE, Friston KJ, Daw ND, et al. A dual role for prediction error in associative learning [J]. Cerebral cortex, 2009,19(5):1175-1185.
