{
  "abstract": "Deep learning-based zero-shot speech synthesis has achieved substantial progress in speaker generalization, but stable modeling remains challenging in fine-grained emotional scenarios. Existing systems often process textual and emotional conditions through shared or closely coupled pathways, which may introduce interference between semantic content and emotional expression. In addition, uniformly averaging per-sample Conditional Flow Matching (CFM) losses may provide insufficient optimization emphasis to high-loss emotional samples. This study proposes a CFM-based zero-shot emotional speech synthesis method. Emotion–Text Decoupling Attention (ETDA) processes semantic and emotional conditions through parallel cross-attention streams and combines them through adaptive gated fusion, allowing the two conditions to retain their respective information before fusion. A 16-class fine-grained emotion space is constructed through classifier filtering and K-Means clustering based on pitch and energy features, and the resulting labels are mapped to continuous representations using a trainable lookup embedding. During training, Adaptive Loss-Threshold Reweighting estimates a threshold from mini-batch loss statistics and assigns larger weights to samples whose individual CFM losses exceed that threshold. Under speaker-disjoint evaluation on ESD, the proposed method achieves a word error rate of 3.62±0.06%, a mel-cepstral distortion of 4.45±0.05 dB, and an emotional expressiveness mean opinion score of 4.64±0.04. Controlled text-length expansion and analyses on a fixed subset of high-loss emotional samples further indicate that the proposed method maintains linguistic content and emotional expression more consistently under the evaluated conditions. These results suggest that the proposed method can, to some extent, improve content preservation, emotional expression, and acoustic reconstruction in fine-grained zero-shot emotional speech synthesis.",
  "abstract_shown": true,
  "affiliations": [
    "School of Design and Art, Shanghai Dianji University, Shanghai, China",
    "School of Computer Science, Nanjing University, Nanjing, China"
  ],
  "article_type": "Research Article",
  "arxiv": null,
  "author_total": 5,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Yan Zhu"
    },
    {
      "affs": [
        1
      ],
      "name": "Yu Wang"
    },
    {
      "name": "Yijin Zhou"
    },
    {
      "name": "Bomin Liu"
    },
    {
      "name": "Rui Zhou"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/2m9pfqncsavhv.bib",
  "cited_by": 0,
  "doi": "10.1371/journal.pone.0358777",
  "fulltext_url": null,
  "id": "2m9pfqncsavhv",
  "issns": [
    "1932-6203"
  ],
  "landing_url": "https://doi.org/10.1371/journal.pone.0358777",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "journal",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "openalex",
      "1702|Speech Recognition and Synthesis"
    ],
    [
      "plos",
      "/Biology and life sciences/Bioacoustics"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Cognitive science/Cognitive psychology/Perception/Sensory perception/Vision"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Sensory perception/Vision"
    ],
    [
      "plos",
      "/Biology and life sciences/Psychology/Cognitive psychology/Perception/Sensory perception/Vision"
    ],
    [
      "plos",
      "/Biology and life sciences/Psychology/Emotions"
    ],
    [
      "plos",
      "/Medicine and health sciences/Pharmacology/Behavioral pharmacology/Recreational drug use/MDMA"
    ],
    [
      "plos",
      "/Physical sciences/Physics/Acoustics"
    ],
    [
      "plos",
      "/Physical sciences/Physics/Acoustics/Bioacoustics"
    ],
    [
      "plos",
      "/Social sciences/Linguistics/Semantics"
    ],
    [
      "plos",
      "/Social sciences/Linguistics/Speech"
    ],
    [
      "plos",
      "/Social sciences/Psychology/Cognitive psychology/Perception/Sensory perception/Vision"
    ],
    [
      "plos",
      "/Social sciences/Psychology/Emotions"
    ],
    [
      "plos",
      "/Social sciences/Sociology/Education/Training (education)/Adaptive training"
    ]
  ],
  "openalex": "W7214091500",
  "pdf_url": "https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0358777&type=printable",
  "pmcid": null,
  "pmid": null,
  "published": "2026-09-23",
  "publisher": "Public Library of Science",
  "ris": "https://research.draconitic.com/paper/2m9pfqncsavhv.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:17:43Z",
      "native_id": "10.1371/journal.pone.0358777",
      "source": "plos",
      "url": "https://doi.org/10.1371/journal.pone.0358777"
    }
  ],
  "subjects": [
    {
      "field": "biology",
      "origin": "plos:neuroscience",
      "subfield": "neuroscience"
    },
    {
      "field": "medicine",
      "origin": "plos:pharmacology",
      "subfield": "pharmacology-toxicology"
    }
  ],
  "title": "Zero-shot emotional speech synthesis based on feature decoupling and adaptive loss-threshold reweighting",
  "title_text": "Zero-shot emotional speech synthesis based on feature decoupling and adaptive loss-threshold reweighting",
  "type": "peer-reviewed",
  "updated_at": "2026-10-30T12:17:43Z",
  "url": "https://research.draconitic.com/paper/2m9pfqncsavhv",
  "venue": "PLOS One",
  "versions": []
}