Thomas Akam on Model-based RL in the Brain

About this episode

Prof. Thomas Akam discusses model-based reinforcement learning and its implications in neuroscience.

Prof Thomas Akam is a Neuroscientist at the Oxford University Department of Experimental Psychology. He is a Wellcome Career Development Fellow and Associate Professor at the University of Oxford, and leads the Cognitive Circuits research group . Featured References Brain Architecture for Adaptive Behaviour Thomas Akam, RLDM 2025 Tutorial Additional References Thomas Akam on Google Scholar pyPhotometry : Open source, Python based, fiber photometry data acquisition pyControl : Open source, Python based, behavioural experiment control. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , Nathaniel D Daw, Yael Niv, Peter Dayan, 2005 Further analysis of the hippocampal amnesic syndrome: 14-year follow-up study of H. M. , Milner, B., Corkin, S., & Teuber, H. L., 1968 Internally generated cell assembly sequences in the rat hippocampus , Pastalkova E, Itskov V, Amarasingham A, Buzsáki G. Science. 2008 Multi-disciplinary Conference on Reinforcement Learning and Decision 2025

People in this episode

Guest: Thomas Akam

Topics covered

• Model-based Reinforcement Learning
• Neuroscience
• Cognitive Circuits

Keywords

• brain architecture
• adaptive behavior
• behavioral control

Mentioned in this episode

Products: pyPhotometry, pyControl

More episodes of TalkRL: The Reinforcement Learning Podcast

• Joseph Modayil of Openmind Research Institute @ RLC 2025 · January 3, 2026 · 4 min
• Danijar Hafner on Dreamer v4 · November 10, 2025 · 1h 41m
• David Abel on the Science of Agency @ RLDM 2025 · September 8, 2025 · 60 min
• Jake Beck, Alex Goldie, & Cornelius Braun on Sutton's OaK, Metalearning, LLMs, Squirrels @ RLC 2025 · August 19, 2025 · 12 min
• Outstanding Paper Award Winners - 2/2 @ RLC 2025 · August 18, 2025 · 14 min
• Outstanding Paper Award Winners - 1/2 @ RLC 2025 · August 15, 2025 · 7 min