{
  "abstract": "Psychosis-Bench recently showed that production chat models confirm and elaborate users' delusion-like beliefs under multi-turn pressure, but its evidence is English-only, Western-flagship-only, and rests on an uncalibrated LLM judge. We present Echo-Bench, a Chinese replication and cross-lingual extension: the full 16-case, 12-turn protocol mirrored into Chinese under a fidelity-first translation protocol with an independent re-translation audit, run against two widely deployed Chinese chat models (DeepSeek V4.1-Flash, qwen-plus) in both languages — 192 sessions, 4,032 turn-level ratings. The original qualitative finding replicates in both languages (RQ1). All six pre-committed cross-language contrasts are significant after Benjamini–Hochberg control: the Chinese arm is directionally worse on every dimension, with model-differentiated failure channels (RQ2). Because our pipeline required a bilingual rater, we placed the measurement instrument itself under test (RQ3): a five-layer rater trust chain — entrance examination against human gold, extreme-score arbitration, red-line audit of the arbiter, blind human adjudication, and a spot check of the non-extreme stratum — shows that automated raters fail concentratedly in the extreme band, with two named failure modes (disclaimer laundering, eloquence inflation), and that a strong general-purpose arbiter is disqualified by pre-specified red lines. A negative control bounds rater language sensitivity below what the observed gaps require. Safety behavior certified in English does not certify safety behavior in Chinese; the instruments used to check either must themselves be checked.",
  "abstract_shown": true,
  "affiliations": [],
  "article_type": null,
  "arxiv": null,
  "author_total": 1,
  "authors": [
    {
      "name": "Yucheng Zhao"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/amnjg779k6vbt.bib",
  "cited_by": 0,
  "doi": "10.31234/osf.io/thvpz_v1",
  "fulltext_url": null,
  "id": "amnjg779k6vbt",
  "issns": [],
  "landing_url": "https://osf.io/preprints/psyarxiv/thvpz_v1/",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "bepress",
      "Meta-science"
    ],
    [
      "bepress",
      "Psychiatry"
    ],
    [
      "openalex",
      "3311|Ethics and Social Impacts of AI"
    ]
  ],
  "openalex": "W7223082689",
  "pdf_url": "https://osf.io/thvpz/download",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-21",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/amnjg779k6vbt.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:20:17Z",
      "native_id": "thvpz",
      "source": "osf",
      "url": "https://osf.io/preprints/psyarxiv/thvpz_v1/"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "bepress:Psychiatry",
      "subfield": "psychiatry"
    }
  ],
  "title": "Echo-Bench: A Chinese Replication and Cross-Lingual Extension of Psychosis-Bench",
  "title_text": "Echo-Bench: A Chinese Replication and Cross-Lingual Extension of Psychosis-Bench",
  "type": "preprint",
  "updated_at": "2026-10-30T12:20:17Z",
  "url": "https://research.draconitic.com/paper/amnjg779k6vbt",
  "venue": "PsyArXiv",
  "versions": []
}