Reinforcement Learning: Psyc 696C

Mon 9:00 - 11:50am, Spring 2007
Room: PSYCH 317B
Department of Psychology

Important Links

Professor: Michael Frank

UPDATED Full Syllabus: PDF

Intro lecture slides: here

Download Readings: here

Readings By Week

8/27 Neurobiology of Reward and Motivation Aaron's PPT Slides
Robbins & Everitt 2003 ;
Schultz, 2007
Optional:
Sutton & Barto 1998, Ch1

9/7 More Dopamine (Incentive Salience) (Michael's PDF Slides)
Berridge, 2006 ;
Robbins & Everitt, 2006
Optional:
Grace, 2002

9/17 Algorithms & data I (Shikhar's PDF Slides)
Dayan & Balleine 2002 ;
Cohen & Ranganath, 2007
Optional:
Montague, Hyman & Cohen 2004;
Watkins & Dayan, 1992

9/24 Algorithms & data II (Theresa's PPT Slides - Schultz) (Brad's PPT Slides - O'Doherty)
Schultz, Dayan & Montague 1997 ;
O'Doherty et al, 2004
O'Doherty Supplement, including advantage learning details
Optional:
Preuschoff & Bossaerts, 2007;
Montague, Dayan & Sejnowski 1996;
O'Doherty et al, 2003

10/1 Matching & Optimizing (Theresa's PPT Slides - Bogacz) (Dawn's PPT Slides)
Lau & Glimcher 2005 ;
Bogacz et al, 2007
Optional:
Li et al 2006

10/8 Reinforcement-based decision making in cortical networks (Dawn's PPT Slides -Sugrue) (Dawn's PPT Slides - Kennerley)
Sugrue et al, 2005 ;
Kennerley et al, 2006;
Lee et al, 2005
Optional:
Lee et al 2004

10/15 Striatum and RL (Michael's PDF Slides -Wickens) (Theresa's PPT Slides - Nakahara)
Wickens et al 2007
Arbuthnott et al, 2007 ;
Nakahara et al, 2001
Optional:
Samejima et al 2005
Niv et al 2007

10/22 Habitual vs Goal Directed Behavior (Brad's PDF Slides -Yin/Daw) (Shikhar's PPT Slides - Frank)
Yin et al 2004
Daw et al, 2005 ;
Frank, Moustafa et al, 2007
Optional:
Daw et al 2007 Supplement
Frank et al 2007 Supplement

10/29 DA Interactions with Other Neuromodulators in RL (JD's PPT Slides - McClure/Morris) (Jim's PPT Slides - Daw)
McClure et al 2005
Morris et al, 2004 ;
Daw et al 2002
Optional:
Cragg, 2006

11/8 Neuroeconomics (Aaron's PPT Slides - Yeung/Lohrenz) (Shikhar's PPT Slides - Hampton)
Yeung & Sanfey 2004
Lohrenz et al, 2007 ;
Hampton et al 2006
Optional:
McClure et al 2004

11/19 Punishment & Controllability (Luke's PPT Slides - Seymour Review) (Luke's PPT Slides - Seymour fmri) (Jim's PPT Slides - Amat)
Seymour Singer et al 2007
Seymour, Daw et al, 2007 ;
Amat et al 2005
Optional:
Amat et al 2006
Quentin Huys Dissertation CH4

11/26 RL and Addiction (Luke's PPT Slides - Robinson) (JD's PPT Slides - Redish)
Robinson & Berridge 2003
Redish, 2004
Optional:
Redish et al 2007

12/3 Final Class (Review Slides (PDF))
Cohen et al 2007
Fliessbach et al 2007
Review