Reinforcement sculpts synaptic ensembles for operant dendritic control
- 1Zuckerman Institute, Columbia University
Abstract
Reinforcement learning requires the selective modification of synapses that contribute to outcome-relevant neural activity, yet the principles underlying these selective modifications remain unclear. Here we combined longitudinal two-photon imaging of identified dendritic spines with a closed-loop optical brain-machine interface (BMI), in which activity from selected apical dendrites of layer 5 motor-cortical neurons controlled an auditory cursor, with target acquisition triggering optogenetic reinforcement. Mice learned to reliably generate the specific dendritic activity that leads to reinforcement. Learning was accompanied by selective strengthening and weakening of individual spines on reinforced dendrites. At individual synapses, the direction of plasticity depended on both the timing of activity relative to reinforced dendritic events and the pre-existing temporal organization of that activity. Furthermore, plasticity was enriched in small task-relevant synaptic groups: spines in synergistic groups were preferentially strengthened, whereas those in antagonistic groups were preferentially weakened. These changes were accompanied by the emergence of increasingly reproducible, selectively recruited, and temporally focused synaptic ensembles, and the incorporation of newly formed spines into these ensembles. Finally, blocking striatal dopamine receptor signaling impaired BMI learning and cortical synaptic reorganization of target dendrites, demonstrating a role for striatal reinforcement in cortical plasticity. Together, these findings reveal how reinforcement of specific dendritic activity sculpts synaptic ensembles that support learned operant dendritic control.
Related
- Characterization of Nucleus Accumbens Dopamine Dynamics during Positive and Negative Operant Reinforcement in Rats
- Dendritic morphology and synaptic nonlinearities enhance functional complexity in human cortical neurons
- Next generation Human Neocortical Neurosolver model with biophysically realistic somatic, dendritic and synaptic dynamics
- Circuit plasticity coordinates action selection and temporal compression during operant conditioning in Aplysia
- Cholinergic and adrenergic modulation sculpts parallel inhibition of SST-INs in visual cortex
BibTeX
@misc{albarran2026reinforcement,
title = {{Reinforcement sculpts synaptic ensembles for operant dendritic control}},
author = {E. Albarran and A. Fushiki and V. Athalye and D. S. Peterka and R. M. Costa},
howpublished = {bioRxiv},
year = {2026},
month = nov,
doi = {10.64898/2026.11.04.764390},
url = {https://www.biorxiv.org/content/10.64898/2026.11.04.764390v1},
note = {CC BY-NC-ND},
}
RIS
TY - UNPB
TI - Reinforcement sculpts synaptic ensembles for operant dendritic control
AU - E. Albarran
AU - A. Fushiki
AU - V. Athalye
AU - D. S. Peterka
AU - R. M. Costa
PY - 2026
DA - 2026/11/04
PB - bioRxiv
DO - 10.64898/2026.11.04.764390
UR - https://www.biorxiv.org/content/10.64898/2026.11.04.764390v1
AB - Reinforcement learning requires the selective modification of synapses that contribute to outcome-relevant neural activity, yet the principles underlying these selective modifications remain unclear. Here we combined longitudinal two-photon imaging of identified dendritic spines with a closed-loop optical brain-machine interface (BMI), in which activity from selected apical dendrites of layer 5 motor-cortical neurons controlled an auditory cursor, with target acquisition triggering optogenetic reinforcement. Mice learned to reliably generate the specific dendritic activity that leads to reinforcement. Learning was accompanied by selective strengthening and weakening of individual spines on reinforced dendrites. At individual synapses, the direction of plasticity depended on both the timing of activity relative to reinforced dendritic events and the pre-existing temporal organization of that activity. Furthermore, plasticity was enriched in small task-relevant synaptic groups: spines in synergistic groups were preferentially strengthened, whereas those in antagonistic groups were preferentially weakened. These changes were accompanied by the emergence of increasingly reproducible, selectively recruited, and temporally focused synaptic ensembles, and the incorporation of newly formed spines into these ensembles. Finally, blocking striatal dopamine receptor signaling impaired BMI learning and cortical synaptic reorganization of target dendrites, demonstrating a role for striatal reinforcement in cortical plasticity. Together, these findings reveal how reinforcement of specific dendritic activity sculpts synaptic ensembles that support learned operant dendritic control.
ER -