{
  "abstract": "We report a vignette study and a survey to investigate which study characteristics influence quality ratings psychology academics give of articles submitted for publication, and psychology academics and students to theses written by psychology students. In the vignette study, 800 respondents evaluated the quality of an abstract (7-point scale) of studies with small (N = 54) or large sample sizes (N = 540), showing statistically significant or non-significant results, and containing statistical reporting errors or no errors. In the subsequent survey, the same participants rated the importance of 29 manuscript characteristics related to a study’s theory, design, conduct, data analyses, and presentation for assessing either the quality of a manuscript or its publishability (article) or grade (thesis). Results showed that quality ratings were affected by sample sizes but not by statistical significance or the presence of statistical reporting errors in the rated research vignette. Furthermore, in the survey academics and students provided highly similar ratings of the importance of different aspects relevant to quality assessment of articles and theses. These results suggest that quality criteria for scientific manuscripts are already adopted by students and are similar for submitted manuscripts and theses. Further research is needed to examine which study characteristics researchers consider most important when assessing a manuscript’s quality in peer review.",
  "abstract_shown": true,
  "affiliations": [
    "Department Methodology and Statistics, Tilburg University, the Netherlands",
    "Department of Sociology, Utrecht University, the Netherlands"
  ],
  "article_type": "Research Article",
  "arxiv": null,
  "author_total": 4,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Hilde E.M. Augusteijn"
    },
    {
      "affs": [
        1
      ],
      "name": "Jelte M. Wicherts"
    },
    {
      "name": "Klaas Sijtsma"
    },
    {
      "name": "Marcel A.L.M. van Assen"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/bqn51gecjskwe.bib",
  "cited_by": 0,
  "doi": "10.1371/journal.pone.0355938",
  "fulltext_url": null,
  "id": "bqn51gecjskwe",
  "issns": [
    "1932-6203"
  ],
  "landing_url": "https://doi.org/10.1371/journal.pone.0355938",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "journal",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "openalex",
      "1207|Academic Writing and Publishing"
    ],
    [
      "plos",
      "/Biology and life sciences/Psychology"
    ],
    [
      "plos",
      "/Computer and information sciences/Data management"
    ],
    [
      "plos",
      "/Computer and information sciences/Network analysis/Social networks/Social media/Facebook"
    ],
    [
      "plos",
      "/Research and analysis methods/Research assessment/Peer review"
    ],
    [
      "plos",
      "/Research and analysis methods/Research assessment/Research quality assessment"
    ],
    [
      "plos",
      "/Research and analysis methods/Research design/Survey research/Surveys"
    ],
    [
      "plos",
      "/Science policy/Research integrity/Publication ethics"
    ],
    [
      "plos",
      "/Social sciences/Economics/Labor economics/Employment/Careers"
    ],
    [
      "plos",
      "/Social sciences/Psychology"
    ],
    [
      "plos",
      "/Social sciences/Sociology/Communications/Social communication/Social media/Facebook"
    ],
    [
      "plos",
      "/Social sciences/Sociology/Social networks/Social media/Facebook"
    ]
  ],
  "openalex": "W7213296561",
  "pdf_url": "https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0355938&type=printable",
  "pmcid": null,
  "pmid": null,
  "published": "2026-09-15",
  "publisher": "Public Library of Science",
  "ris": "https://research.draconitic.com/paper/bqn51gecjskwe.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:17:50Z",
      "native_id": "10.1371/journal.pone.0355938",
      "source": "plos",
      "url": "https://doi.org/10.1371/journal.pone.0355938"
    }
  ],
  "subjects": [
    {
      "field": "biology",
      "origin": "plos:biology and life sciences",
      "subfield": "general"
    }
  ],
  "title": "The effect of manuscript characteristics on quality assessment of scientific manuscripts in psychology",
  "title_text": "The effect of manuscript characteristics on quality assessment of scientific manuscripts in psychology",
  "type": "peer-reviewed",
  "updated_at": "2026-10-30T12:17:50Z",
  "url": "https://research.draconitic.com/paper/bqn51gecjskwe",
  "venue": "PLOS One",
  "versions": []
}