Wimmer GE, Daw ND, Shohamy D (2012) Generalization of value inreinforcement learning by humans. European Journal ofNeuroscience 35:1092-1104.
Ulrich-Lai YM, Herman JP (2009) Neural regulation of endocrineand autonomic stress responses. Nature ReviewsNeuroscience 10:397-409.
Tolman EC (1951) Purposive behavior in animals and men: Univ ofCalifornia Press.
Thorndike EL (1911) Animal intelligence: Experimental studies:Macmillan.
Sutton RS, Barto AG (1998) Introduction to reinforcement learning:MIT Press.
Spence KW (1956) Behavior theory and conditioning.
Sinha R (2008) Chronic stress, drug use, and vulnerability toaddiction. Annals of the New York Academy of Sciences1141:105-130.
Simon DA, Daw ND (2011) Environmental statistics and the tradeoffbetween model-based and TD learning in humans.Advances in Neural Information Processing Systems 24:127-135.
Selye H (1946) THE GENERAL ADAPTATION SYNDROME ANDTHE DISEASES OF ADAPTATION 1. The Journal of ClinicalEndocrinology & Metabolism 6:117-230.
Schwarz G (1978) Estimating the dimension of a model. The annalsof statistics 6:461-464.
Schwabe L, Wolf OT (2009) Stress prompts habit behavior in humans.The Journal of Neuroscience 29:7191-7198.
Schwabe L, Tegenthoff M, Hoffken O, Wolf OT (2012) Simultaneousglucocorticoid and noradrenergic activity disrupts the neuralbasis of goal-directed action in the human brain. The Journalof Neuroscience 32:10146-10155.
Schwabe L, Dalm S, Schachinger H, Oitzl MS (2008) Chronic stressmodulates the use of spatial and stimulus-response learningstrategies in mice and man. Neurobiology of learning andmemory 90:495-503.
Schultz W, Dayan P, Montague PR (1997) A neural substrate ofprediction and reward. Science 275:1593-1599.
Schultz W (1998) Predictive reward signal of dopamine neurons.Journal of neurophysiology 80:1-27.
Schonberg T, Daw ND, Joel D, O'Doherty JP (2007) Reinforcementlearning signals in the human striatum distinguish learnersfrom nonlearners during reward-based decision making. TheJournal of Neuroscience 27:12860-12867.
Schneiderman N, Ironson G, Siegel SD (2005) Stress and health:psychological, behavioral, and biological determinants. AnnualReview of Clinical Psychology 1:607.
Sauro MD, Jorgensen RS, Teal Pedlow C (2003) Stress,glucocorticoids, and memory: a meta-analytic review. Stress:The International Journal on the Biology of Stress 6:235-245.
Sapolsky RM (1996) Why stress is bad for your brain. Science273:749-750.
Salehi B, Cordero MI, Sandi C (2010) Learning under stress: theinverted-U-shape function revisited. Learning & Memory17:522-530.
Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning:Variations in the effectiveness of reinforcement andnonreinforcement. Classical conditioning II: Current researchand theory 2:64-99.
Pomerleau CS, Pomerleau OF (1987) The effects of a psychologicalstressor on cigarette smoking and subsequent behavioral andphysiological responses. Psychophysiology 24:278-285.
Penner MR, Mizumori SJ (2012) Neural systems analysis of decisionmaking during goal-directed navigation. Progress inneurobiology 96:96-135.
Paulus MP, Feinstein JS, Leland D, Simmons AN (2005) Superiortemporal gyrus and insula provide response and outcomedependentinformation during assessment and action selectionin a decision-making situation. Neuroimage 25:607-615.
Otto AR, Raio CM, Chiang A, Phelps EA, Daw ND (2013b) Workingmemorycapacity protects model-based learning from stress.Proceedings of the National Academy of Sciences of theUnited States of America 110:20941-20946.
Otto AR, Gershman SJ, Markman AB, Daw ND (2013a) The Curse ofPlanning Dissecting Multiple Reinforcement-LearningSystems by Taxing the Central Executive. Psychological115science 24:751-761.
O'connor T, O'halloran D, Shanahan F (2000) The stress responseand the hypothalamic?pituitary?adrenal axis: from molecule tomelancholia. Qjm 93:323-333.
O'Doherty JP, Hampton A, Kim H (2007) Model?Based fMRI and ItsApplication to Reward Learning and Decision Making. Annalsof the New York Academy of Sciences 1104:35-53.
O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ(2004) Dissociable roles of ventral and dorsal striatum ininstrumental conditioning. Science 304:452-454.
Murphy B, Arnsten A, Goldman-Rakic P, Roth R (1996) Increaseddopamine turnover in the prefrontal cortex impairs spatialworking memory performance in rats and monkeys.Proceedings of the National Academy of Sciences 93:1325-1329.
Mizoguchi K, Yuzurihara M, Ishige A, Sasaki H, Chui D-H, Tabira T(2000) Chronic stress induces impairment of spatial workingmemory because of prefrontal dopaminergic dysfunction. TheJournal of Neuroscience 20:1568-1574.
Mitra R, Sapolsky RM (2008) Acute corticosterone treatment issufficient to induce anxiety and amygdaloid dendritichypertrophy. Proceedings of the National Academy ofSciences 105:5573-5578.
Mendelson JH, Sholar MB, Goletiani N, Siegel AJ, Mello NK (2005)Effects of low-and high-nicotine cigarette smoking on moodstates and the HPA axis in men. Neuropsychopharmacology30:1751-1763.
McEwen BS, Sapolsky RM (1995) Stress and cognitive function.Current opinion in neurobiology 5:205-216.
McEwen BS (2000) Allostasis and allostatic load: implications forneuropsychopharmacology. Neuropsychopharmacology22:108-124.
Lupien SJ, Lepage M (2001) Stress, memory, and the hippocampus:can't live with it, can't live without it. Behavioural brainresearch 127:137-158.
Liston C, Miller MM, Goldwater DS, Radley JJ, Rocher AB, Hof PR,Morrison JH, McEwen BS (2006) Stress-induced alterationsin prefrontal cortical dendritic morphology predict selectiveimpairments in perceptual attentional set-shifting. TheJournal of Neuroscience 26:7870-7874.
Lee Sang W, Shimojo S, O’Doherty John P (2014) NeuralComputations Underlying Arbitration between Model-Basedand Model-free Learning. Neuron 81:687-699.
Lee H, Ghim J-W, Kim H, Lee D, Jung M (2012) Hippocampal neuralcorrelates for values of experienced events. The Journal ofNeuroscience 32:15053-15065.
Lee D (2013) Decision making: from neuroscience to psychiatry.Neuron 78:233-248.
Le A, Harding S, Juzytsch W, Funk D, Shaham Y (2005) Role ofalpha-2 adrenoceptors in stress-induced reinstatement ofalcohol seeking and alcohol self-administration in rats.Psychopharmacology 179:366-373.
Koob G, Kreek M (2007) Stress, dysregulation of drug rewardpathways, and the transition to drug dependence. AmericanJournal of Psychiatry 164:1149-1159.
Kirschbaum C, Kudielka BM, Gaab J, Schommer NC, Hellhammer DH(1999) Impact of gender, menstrual cycle phase, and oralcontraceptives on the activity of the hypothalamus-pituitaryadrenalaxis. Psychosomatic medicine 61:154-162.
Kim J, Diamond DM (2002) The stressed hippocampus, synaptic112plasticity and lost memories. Nature Reviews Neuroscience3:453-462.
Kim H, Shimojo S, O'Doherty JP (2006) Is avoiding an aversiveoutcome rewarding? Neural substrates of avoidance learningin the human brain. PLoS biology 4:e233.
Jensen J, Smith AJ, Willeit M, Crawley AP, Mikulis DJ, Vitcu I, KapurS (2007) Separate brain regions code for salience vs. valenceduring reward prediction in humans. Human brain mapping28:294-302.
Ito M, Doya K (2009) Validation of decision-making models andanalysis of decision variables in the rat basal ganglia. TheJournal of neuroscience 29:9861-9874.
Hull JG, Young RD (1983) Self-consciousness, self-esteem, andsuccess?failure as determinants of alcohol consumption inmale social drinkers. Journal of Personality and SocialPsychology 44:1097.
Hull C (1943) Principles of behavior.
Howard RA (1960) DYNAMIC PROGRAMMING AND MARKOVPROCESSES. In. USA: Massachusetts Institute of TechnologyPress.
Hollerman JR, Schultz W (1998) Dopamine neurons report an error111in the temporal prediction of reward during learning. Natureneuroscience 1:304-309.
Higgins RL, Marlatt GA (1975) Fear of interpersonal evaluation as adeterminant of alcohol consumption in male social drinkers.Journal of abnormal psychology 84:644.
Henckens MJ, Hermans EJ, Pu Z, Joels M, Fernandez G (2009)Stressed memories: how acute stress affects memoryformation in humans. The Journal of Neuroscience 29:10111-10119.
Hare TA, O'Doherty J, Camerer CF, Schultz W, Rangel A (2008)Dissociating the role of the orbitofrontal cortex and thestriatum in the computation of goal values and predictionerrors. The Journal of Neuroscience 28:5623-5630.
Gold P, Van Buskirk R, McGaugh J (1975) Effects of hormones ontime-dependent memory storage processes. Progress in brainresearch 42:210.
Glascher J, Hampton AN, O'Doherty JP (2009) Determining a role forventromedial prefrontal cortex in encoding action-based valuesignals during reward-related decision making. Cerebralcortex 19:483-495.
Foerde K, Shohamy D (2011) Feedback timing modulates brain110systems for learning in humans. The Journal of Neuroscience31:13157-13167.
Flier JS, Underhill LH, McEwen BS (1998) Protective and damagingeffects of stress mediators. New England Journal of Medicine338:171-179.
Ferragud A, Haro A, Sylvain A, Velazquez-Sanchez C, Hernandez-Rabaza V, Canales J (2010) Enhanced habit-based learningand decreased neurogenesis in the adult hippocampus in amurine model of chronic social stress. Behavioural brainresearch 210:134-139.
Domes G, Rothfischer J, Reichwald U, Hautzinger M (2005)Inverted-U function between salivary cortisol and retrieval ofverbal memory after hydrocortisone treatment. Behavioralneuroscience 119:512.
Doll BB, Simon DA, Daw ND (2012) The ubiquity of model-basedreinforcement learning. Current opinion in neurobiology22:1075-1081.
Dickinson A (1985) Actions and habits: the development ofbehavioural autonomy. Philosophical Transactions of the RoyalSociety of London B, Biological Sciences 308:67-78.
Dickerson KC, Li J, Delgado MR (2011) Parallel contributions of109distinct human memory systems during probabilistic learning.Neuroimage 55:266-276.
Dias-Ferreira E, Sousa JC, Melo I, Morgado P, Mesquita AR,Cerqueira JJ, Costa RM, Sousa N (2009) Chronic stresscauses frontostriatal reorganization and affects decisionmaking.Science 325:621-625.
Diamond DM, Bennett MC, Fleshner M, Rose GM (1992) Inverted?Urelationship between the level of peripheral corticosterone andthe magnitude of hippocampal primed burst potentiation.Hippocampus 2:421-430.
De Kloet ER, Joels M, Holsboer F (2005) Stress and the brain: fromadaptation to disease. Nature Reviews Neuroscience 6:463-475.
Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006)Cortical substrates for exploratory decisions in humans.Nature 441:876-879.
Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011)Model-based influences on humans' choices and striatalprediction errors. Neuron 69:1204-1215.
Daw ND (2011) Trial-by-trial data analysis using computationalmodels. Decision making, affect, and learning: Attention andperformance XXIII 23:3-38.
Cohen S, Williamson GM (1988) Perceived stress in a probabilitysample of the United states In: the social psychology of health:claremont symposium on applied social psychology (SpacapanS, Oskamp S, eds). Newbury Park, CA: Sage.
Cleck JN, Blendy JA (2008) Making a bad thing worse: adverseeffects of stress on drug addiction. The Journal of clinicalinvestigation 118:454-461.
Cahill L, Alkire MT (2003) Epinephrine enhancement of humanmemory consolidation: Interaction with arousal at encoding.Neurobiology of learning and memory 79:194-198.
Bromberg-Martin ES, Matsumoto M, Hikosaka O (2010) Dopaminein motivational control: rewarding, aversive, and alerting.Neuron 68:815-834.
Bernacchia A, Seo H, Lee D, Wang XJ (2011) A reservoir of timeconstants for memory traces in cortical neurons. Natureneuroscience 14:366-372.
Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007)Learning the value of information in an uncertain world. Natureneuroscience 10:1214-1221.
Barraclough DJ, Conroy ML, Lee D (2004) Prefrontal cortex anddecision making in a mixed-strategy game. Natureneuroscience 7:404-410.
Balleine BW, Dickinson A (2005) Effects of outcome devaluation onthe performance of a heterogeneous instrumental chain.International journal of comparative psychology 18.
Balleine BW, Dickinson A (1998) Goal-directed instrumental action:contingency and incentive learning and their corticalsubstrates. Neuropharmacology 37:407-419.
Anderson CR (1976) Coping behaviors as intervening mechanisms inthe inverted-U stress-performance relationship. Journal ofApplied Psychology 61:30.