{
  "abstract": "Mental health misconceptions are widespread, yet it remains unclear how accurately psychology students distinguish such misconceptions from evidence-based information, whether this differs across stages of psychology education, and how their performance compares with that of large language models (LLMs). We evaluated the accuracy of 150 psychology students, including 70 first-semester and 80 more advanced students, in classifying 15 mental health myths and 15 facts. Additionally, we used Chat GPT-5.4, Claude Sonnet 4.5, DeepSeek V3.2, and GLM-5 to classify the same statements across 80 independent runs per statement and model. Students classified mental health myths more accurately than facts, and advanced students outperformed first-semester students in classifying both statement types (myths: 87.7% vs. 75.2%; facts: 69.3% vs. 55.4%). A binomial generalized linear mixed-effects model indicated that group differences in classification accuracy varied between myths and facts. LLMs generally showed higher accuracy than both student groups in classifying statements, although performance varied substantially across models, particularly for facts. Item-level analyses revealed partly distinct error patterns: students and LLMs struggled with some of the same facts, whereas they also showed relative advantages on specific statements. These findings suggest that mental health literacy differs significantly across stages of psychology education and that, although current LLMs perform strongly on this classification task, some item-specific errors recurred across repeated runs. Examining which misconceptions and facts remain difficult may help identify specific gaps in both psychology education and AI-generated mental health information.",
  "abstract_shown": true,
  "affiliations": [],
  "article_type": null,
  "arxiv": null,
  "author_total": 7,
  "authors": [
    {
      "name": "Eileen Richter"
    },
    {
      "name": "Konrad Schöniger"
    },
    {
      "name": "Maya Schulze"
    },
    {
      "name": "Luisa Frede"
    },
    {
      "name": "Korbinian Moeller"
    },
    {
      "name": "Ronny Redlich"
    },
    {
      "name": "Markus Spitzer"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/07shtyme168p7.bib",
  "cited_by": 0,
  "doi": "10.31234/osf.io/e6s4t_v1",
  "fulltext_url": null,
  "id": "07shtyme168p7",
  "issns": [],
  "landing_url": "https://osf.io/preprints/psyarxiv/e6s4t_v1/",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "bepress",
      "Clinical Psychology"
    ],
    [
      "bepress",
      "Educational Psychology"
    ],
    [
      "bepress",
      "Social and Behavioral Sciences"
    ],
    [
      "openalex",
      "3207|Mental Health Treatment and Access"
    ]
  ],
  "openalex": "W7213956728",
  "pdf_url": "https://osf.io/e6s4t/download",
  "pmcid": null,
  "pmid": null,
  "published": "2026-09-21",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/07shtyme168p7.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:23:55Z",
      "native_id": "e6s4t",
      "source": "osf",
      "url": "https://osf.io/preprints/psyarxiv/e6s4t_v1/"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "bepress:Clinical Psychology",
      "subfield": "psychiatry"
    }
  ],
  "title": "Mental Health Literacy Across Psychology Students and Large Language Models",
  "title_text": "Mental Health Literacy Across Psychology Students and Large Language Models",
  "type": "preprint",
  "updated_at": "2026-10-30T12:23:55Z",
  "url": "https://research.draconitic.com/paper/07shtyme168p7",
  "venue": "PsyArXiv",
  "versions": []
}