1. Home
  2. Browse
  3. Stage 1 Registered Report: Restric…
This is not the latest version of this Digital Research Object (DRO). The latest version can be found here!
Preregistration

Stage 1 Registered Report: Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template

Author(s) / Creator(s)

Spitzer, Lisa
Mueller, Stefanie

Abstract / Description

Preregistration can help to reduce researcher degrees of freedom, but its value depends on whether researchers specify their study plan in sufficient detail and adhere to this plan. Previous research indicates that specificity is better when preregistrations are based on structured versus unstructured template formats, although there is room for further improvement. The planned study aims to build on these findings and investigate the specificity of preregistrations based on the PRP-QUANT Template, a comprehensive template that aids the preregistration of quantitative studies in psychology. Preregistrations will be sampled from PsychArchives and coded for their level of specificity using the coding scheme of Bakker et al. (2020) and Heirene et al. (2021). We predict that preregistrations based on the PRP-QUANT Template (N = [74]) are more specific than preregistrations based on the OSF Preregistration Template (N = 52, Bakker et al., 2020, hypothesis 1). We will also inspect whether peer review can contribute further to restricting flexibility and predict higher specificity for peer-reviewed (n = [27]) than non-peer-reviewed preregistrations (n = [47], hypothesis 2), using Wilcoxon-Mann-Whitney tests. Additionally, we will examine adherence to the preregistered plans and risk of bias in reporting in the publications associated with the studied preregistrations (N = [17]). [In line/in contrast] to hypothesis 1, PRP-QUANT preregistrations [had significantly/did not have] higher specificity scores than OSF Preregistrations. Moreover, [consistent/inconsistent] with hypothesis 2, peer-reviewed preregistrations [had significantly/did not have] higher specificity than non-peer-reviewed ones. […] percent of the associated articles included undeclared deviations. [NOTE: A sentence describing the risk of bias in reporting results might be added.] We discuss the implications of our findings for the PRP-QUANT Template. Please note: This is a Stage 1 Registered Report that will be submitted to PCI RR. To maximize transparency in the further process, we have already formulated the results section and a description of the results in the abstract in past tense, but the analyses of this study have yet to be carried out. The results section is based on dummy/blinded data and, thus, values are nonsensical. To facilitate review, we have highlighted text parts that will be edited in brackets and color. In Stage 2, we will change the tense to past and append discussion and conclusion sections.

Keyword(s)

preregistration open science meta-research reproducibility replicability

Persistent Identifier

PsychArchives acquisition timestamp

2023-08-25 12:03:38 UTC

Publisher

PsychArchives

Citation

Download BibTex
Download as Text
  • 3
    2024-01-26
    Updated Stage 1 Registered Report based on revisions for PCI-RR
    View object
  • 2
    2024-01-08
    Updated Stage 1 Registered Report based on revisions for PCI-RR
    View object
  • 1
    2023-08-25
  • Author(s) / Creator(s)
    Spitzer, Lisa
  • Author(s) / Creator(s)
    Mueller, Stefanie
  • PsychArchives acquisition timestamp
    2023-08-25T12:03:38Z
  • Made available on
    2023-08-25T12:03:38Z
  • Date of first publication
    2023-08-25
  • Abstract / Description
    Preregistration can help to reduce researcher degrees of freedom, but its value depends on whether researchers specify their study plan in sufficient detail and adhere to this plan. Previous research indicates that specificity is better when preregistrations are based on structured versus unstructured template formats, although there is room for further improvement. The planned study aims to build on these findings and investigate the specificity of preregistrations based on the PRP-QUANT Template, a comprehensive template that aids the preregistration of quantitative studies in psychology. Preregistrations will be sampled from PsychArchives and coded for their level of specificity using the coding scheme of Bakker et al. (2020) and Heirene et al. (2021). We predict that preregistrations based on the PRP-QUANT Template (N = [74]) are more specific than preregistrations based on the OSF Preregistration Template (N = 52, Bakker et al., 2020, hypothesis 1). We will also inspect whether peer review can contribute further to restricting flexibility and predict higher specificity for peer-reviewed (n = [27]) than non-peer-reviewed preregistrations (n = [47], hypothesis 2), using Wilcoxon-Mann-Whitney tests. Additionally, we will examine adherence to the preregistered plans and risk of bias in reporting in the publications associated with the studied preregistrations (N = [17]). [In line/in contrast] to hypothesis 1, PRP-QUANT preregistrations [had significantly/did not have] higher specificity scores than OSF Preregistrations. Moreover, [consistent/inconsistent] with hypothesis 2, peer-reviewed preregistrations [had significantly/did not have] higher specificity than non-peer-reviewed ones. […] percent of the associated articles included undeclared deviations. [NOTE: A sentence describing the risk of bias in reporting results might be added.] We discuss the implications of our findings for the PRP-QUANT Template. Please note: This is a Stage 1 Registered Report that will be submitted to PCI RR. To maximize transparency in the further process, we have already formulated the results section and a description of the results in the abstract in past tense, but the analyses of this study have yet to be carried out. The results section is based on dummy/blinded data and, thus, values are nonsensical. To facilitate review, we have highlighted text parts that will be edited in brackets and color. In Stage 2, we will change the tense to past and append discussion and conclusion sections.
    en
  • Publication status
    other
  • Review status
    unknown
  • Persistent Identifier
    https://hdl.handle.net/20.500.12034/8644
  • Persistent Identifier
    https://doi.org/10.23668/psycharchives.13151
  • Language of content
    eng
  • Publisher
    PsychArchives
  • Is related to
    https://doi.org/10.23668/psycharchives.12902
  • Is related to
    https://www.psycharchives.org/handle/20.500.12034/8648
  • Is related to
    https://www.psycharchives.org/handle/20.500.12034/8645
  • Is related to
    https://www.psycharchives.org/handle/20.500.12034/8646
  • Is related to
    https://www.psycharchives.org/handle/20.500.12034/8647
  • Keyword(s)
    preregistration
    en
  • Keyword(s)
    open science
    en
  • Keyword(s)
    meta-research
    en
  • Keyword(s)
    reproducibility
    en
  • Keyword(s)
    replicability
    en
  • Dewey Decimal Classification number(s)
    150
  • Title
    Stage 1 Registered Report: Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template
    en
  • DRO type
    preregistration