{
  "abstract": "Stroke and neurodegenerative diseases can impair speech and nonverbal gestures, limiting natural communication. Brain-computer interfaces (BCIs) aim to restore these functions by translating neural activity into commands for external devices, although prior work has primarily focused on decoding speech or gestures in isolation. Here we show that neural signals recorded with a single high-density electrocorticography implant can support simultaneous decoding of speech and gestures in people with paralysis. We first show that isolated upper-limb and orofacial movements can be reliably decoded among three participants. Using parallel speech and gesture decoders, we then enabled participants to control a personalized virtual avatar by attempting speech and gestures simultaneously or in isolation. Training models on both isolated and simultaneous data improved performance across behavioral contexts. These findings demonstrate that one cortical implant can support multi-effector control and provide a step toward BCIs that enable more natural communication for people with paralysis.",
  "abstract_shown": true,
  "affiliations": [
    "Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA",
    "University of California, Berkeley-University of California, San Francisco, Graduate Program in Bioengineering, Berkeley, CA, USA",
    "Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA",
    "Department of Neurology, University of California, San Francisco, San Francisco, CA, USA",
    "Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA. edward.chang@ucsf.edu",
    "University of California, Berkeley-University of California, San Francisco, Graduate Program in Bioengineering, Berkeley, CA, USA. edward.chang@ucsf.edu",
    "Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA. edward.chang@ucsf.edu"
  ],
  "article_type": null,
  "arxiv": null,
  "author_total": 9,
  "authors": [
    {
      "affs": [
        0,
        1,
        2
      ],
      "name": "Samantha Brosler",
      "orcid": "0000-0001-5612-0982"
    },
    {
      "affs": [
        0,
        2
      ],
      "name": "Jessie R. Liu",
      "orcid": "0000-0001-9316-7624"
    },
    {
      "affs": [
        0,
        1,
        2
      ],
      "name": "Alexander B. Silva",
      "orcid": "0000-0003-0838-4136"
    },
    {
      "affs": [
        0
      ],
      "name": "Irina P Hallinan",
      "orcid": "0009-0006-1708-8952"
    },
    {
      "affs": [
        0
      ],
      "name": "Cady M Kurtz-Miott",
      "orcid": "0000-0002-2489-0584"
    },
    {
      "affs": [
        0
      ],
      "name": "Jonah Dunkel Wilker",
      "orcid": "0009-0002-7431-6422"
    },
    {
      "affs": [
        3
      ],
      "name": "Adelyn Tu-Chan",
      "orcid": "0000-0002-6783-8567"
    },
    {
      "affs": [
        3,
        2
      ],
      "name": "Karunesh Ganguly",
      "orcid": "0000-0002-2570-9943"
    },
    {
      "affs": [
        4,
        5,
        6
      ],
      "name": "Edward F. Chang",
      "orcid": "0000-0003-2480-4700"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/5nf8ym16av99m.bib",
  "cited_by": 6,
  "doi": "10.1038/s41593-026-02446-2",
  "fulltext_url": null,
  "id": "5nf8ym16av99m",
  "issns": [
    "1097-6256",
    "1546-1726"
  ],
  "landing_url": "https://doi.org/10.1038/s41593-026-02446-2",
  "language": "en",
  "licence": "CC-BY",
  "licence_label": "CC BY",
  "licence_source": "journal",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "openalex",
      "2805|EEG and Brain-Computer Interfaces"
    ]
  ],
  "openalex": "W7213121740",
  "pdf_url": "https://www.nature.com/articles/s41593-026-02446-2.pdf",
  "pmcid": "PMC13633112",
  "pmid": "42736415",
  "published": "2026-09-14",
  "publisher": "Nature Portfolio",
  "ris": "https://research.draconitic.com/paper/5nf8ym16av99m.ris",
  "sources": [
    {
      "first_seen": "2026-11-05T13:21:03Z",
      "native_id": "W7213121740",
      "source": "openalex",
      "url": "https://doi.org/10.1038/s41593-026-02446-2"
    }
  ],
  "subjects": [
    {
      "field": "biology",
      "origin": "openalex:2805|EEG and Brain-Computer Interfaces",
      "subfield": "neuroscience"
    }
  ],
  "title": "Simultaneous speech and gesture decoding for multimodal communication in paralysis",
  "title_text": "Simultaneous speech and gesture decoding for multimodal communication in paralysis",
  "type": "peer-reviewed",
  "updated_at": "2026-11-08T13:20:49Z",
  "url": "https://research.draconitic.com/paper/5nf8ym16av99m",
  "venue": "Nature Neuroscience",
  "versions": []
}