NSCI 401 Lecture Notes - Lecture 11: Classical Conditioning, Causal Model, Reinforcement Learning
13 Mar 2017
School
Department
Course
Professor
Document Summary
Pavlovian conditioning: involuntary, lacing a signal before a reflex. Instrumental conditioning: voluntary behavior & consequence, applying reinforcement/punishment. Spike-timing-dependent plasticity (stdp): adjust strength of connection b/w neurons that leads to ltp of synapses. Dopamine modulation & synaptic tags: dopamine enhances ltp during a short window. Synaptic tags = slow synaptic processes triggered by coincident spiking. Model based decision making: more computationally demanding: goal-directed plans, learns causal model of the environment. Model free decision making: less computationally demanding, less accurate: trial and error, habit making, automatic. Reinforcement learning (rl) = computational approach to value-guided decision-making.
