{
  "abstract": "Learning from feedback is essential for effective decision-making in daily life. Previous experiments have indicated that feedback-based learning involves multiple processes, such as slower reinforcement learning (RL) and fast working memory (WM). However, most of these studies focused on the dynamics of RL and WM in short timeframes, ranging from a few seconds to minutes, whereas real-life learning may occur over hours, days, or weeks. This study aimed to investigate the interplay between RL and WM in long-term feedback-based learning. Instead of learning back-to-back iterations in quick succession, participants learned one or two iterations per day for 24 days. In this scenario, initial trials each day should isolate non WM decision processes, and WM should primarily assist in subsequent trials, and in low load conditions, for example when a given item was repeated in short succession. There were four key findings. First, WM contributed broadly to learning in trials 2-n of each day, especially in low load conditions, while trial 1 isolated non WM contributions. Second, when WM was available, it produced both immediate and long-term benefits. WM steered choices toward correct responses, allowing more immediate rewards, but also supporting the training of correct stimulus-action associations over time (a bootstrapping effect). Third, both test-phase performance and computational modeling revealed that using WM had an additional deleterious interference effect; trials during which WM was available produced slower RL updating and worse test-phase performance. Fourth, the long-term training benefits of WM overshadowed its interference effect, such that the overall effect of WM on long-term learning remained positive.",
  "abstract_shown": true,
  "affiliations": [],
  "article_type": null,
  "arxiv": null,
  "author_total": 4,
  "authors": [
    {
      "name": "Yiwen Zhang"
    },
    {
      "name": "Xitong Chen"
    },
    {
      "name": "Benjamin Rottman"
    },
    {
      "name": "Anne Collins"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/9z7vs2k8ka4at.bib",
  "cited_by": 0,
  "doi": "10.31234/osf.io/vb9u6_v2",
  "fulltext_url": null,
  "id": "9z7vs2k8ka4at",
  "issns": [],
  "landing_url": "https://osf.io/preprints/psyarxiv/vb9u6_v2/",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "bepress",
      "Cognitive Neuroscience"
    ],
    [
      "bepress",
      "Cognitive Psychology"
    ],
    [
      "bepress",
      "Computational Modeling"
    ],
    [
      "bepress",
      "Neuroscience"
    ],
    [
      "bepress",
      "Quantitative Methods"
    ],
    [
      "bepress",
      "Social and Behavioral Sciences"
    ],
    [
      "openalex",
      "2805|Neural and Behavioral Psychology Studies"
    ]
  ],
  "openalex": "W7223137827",
  "pdf_url": "https://osf.io/vb9u6/download",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-21",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/9z7vs2k8ka4at.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:19:59Z",
      "native_id": "vb9u6",
      "source": "osf",
      "url": "https://osf.io/preprints/psyarxiv/vb9u6_v2/"
    }
  ],
  "subjects": [
    {
      "field": "biology",
      "origin": "bepress:Cognitive Neuroscience",
      "subfield": "neuroscience"
    }
  ],
  "title": "The Role of Working Memory in Reward-based Learning over Long Timeframes: Opponent Bootstrapping and Interference Effects of Working Memory on Incremental Learning",
  "title_text": "The Role of Working Memory in Reward-based Learning over Long Timeframes: Opponent Bootstrapping and Interference Effects of Working Memory on Incremental Learning",
  "type": "preprint",
  "updated_at": "2026-10-30T12:19:59Z",
  "url": "https://research.draconitic.com/paper/9z7vs2k8ka4at",
  "venue": "PsyArXiv",
  "versions": []
}