📗 -> 11/14: Motor Control and Reinforcement Learning 2


Lecture Slide Link

🎤 Vocab

❗ Unit and Larger Context

Small summary

✒️ -> Scratch Notes

Dopamine Bursts

Why do our happiness levels not change that much, even after winning the lottery, or after becoming paralyzed?

  • Dopamine can be associated with a conditioned stimulus (CS), and be abstracted away from the reward. The dopamine burst will instead signal the deviation from our expectations.

Rescorla-Wagner / Delta Rule


But does not explain CS-onset firing

– need to anticipate the future!

CS-onset = future reward = f

<- Future expectation. Gamma () is a discount factor

Why do our happiness levels not change that much, even after winning the lottery, or after becoming paralyzed?

Our expectations change!

Resources

  • Put useful links here

Connections