Article Version of Record

Visual representations of meta-analyses of multiple outcomes: Extensions to forest plots, funnel plots, and caterpillar plots

Author(s) / Creator(s)

Fernández-Castilla, Belén
Declercq, Lies
Jamshidi, Laleh
Beretvas, Susan Natasha
Onghena, Patrick
Van den Noortgate, Wim

Abstract / Description

Meta-analytic datasets can be large, especially when in primary studies multiple effect sizes are reported. The visualization of meta-analytic data is therefore useful to summarize data and understand information reported in primary studies. The gold standard figures in meta-analysis are forest and funnel plots. However, none of these plots can yet account for the existence of multiple effect sizes within primary studies. This manuscript describes extensions to the funnel plot, forest plot and caterpillar plot to adapt them to three-level meta-analyses. For forest plots, we propose to plot the study-specific effects and their precision, and to add additional confidence intervals that reflect the sampling variance of individual effect sizes. For caterpillar plots and funnel plots, we recommend to plot individual effect sizes and averaged study-effect sizes in two separate graphs. For the funnel plot, plotting separate graphs might improve the detection of both publication bias and/or selective outcome reporting bias.

Keyword(s)

meta-analysis graphical display forest plot funnel plot (3-level) multilevel

Persistent Identifier

Date of first publication

2020-12-22

Journal title

Methodology

Volume

16

Issue

4

Page numbers

299–315

Publisher

PsychOpen GOLD

Publication status

publishedVersion

Review status

peerReviewed

Is version of

Citation

Fernández-Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2020). Visual representations of meta-analyses of multiple outcomes: Extensions to forest plots, funnel plots, and caterpillar plots. Methodology, 16(4), 299-315. https://doi.org/10.5964/meth.4013
  • Author(s) / Creator(s)
    Fernández-Castilla, Belén
  • Author(s) / Creator(s)
    Declercq, Lies
  • Author(s) / Creator(s)
    Jamshidi, Laleh
  • Author(s) / Creator(s)
    Beretvas, Susan Natasha
  • Author(s) / Creator(s)
    Onghena, Patrick
  • Author(s) / Creator(s)
    Van den Noortgate, Wim
  • PsychArchives acquisition timestamp
    2022-04-14T11:24:45Z
  • Made available on
    2022-04-14T11:24:45Z
  • Date of first publication
    2020-12-22
  • Abstract / Description
    Meta-analytic datasets can be large, especially when in primary studies multiple effect sizes are reported. The visualization of meta-analytic data is therefore useful to summarize data and understand information reported in primary studies. The gold standard figures in meta-analysis are forest and funnel plots. However, none of these plots can yet account for the existence of multiple effect sizes within primary studies. This manuscript describes extensions to the funnel plot, forest plot and caterpillar plot to adapt them to three-level meta-analyses. For forest plots, we propose to plot the study-specific effects and their precision, and to add additional confidence intervals that reflect the sampling variance of individual effect sizes. For caterpillar plots and funnel plots, we recommend to plot individual effect sizes and averaged study-effect sizes in two separate graphs. For the funnel plot, plotting separate graphs might improve the detection of both publication bias and/or selective outcome reporting bias.
    en_US
  • Publication status
    publishedVersion
  • Review status
    peerReviewed
  • Citation
    Fernández-Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2020). Visual representations of meta-analyses of multiple outcomes: Extensions to forest plots, funnel plots, and caterpillar plots. Methodology, 16(4), 299-315. https://doi.org/10.5964/meth.4013
    en_US
  • ISSN
    1614-2241
  • Persistent Identifier
    https://hdl.handle.net/20.500.12034/5697
  • Persistent Identifier
    https://doi.org/10.23668/psycharchives.6301
  • Language of content
    eng
  • Publisher
    PsychOpen GOLD
  • Is version of
    https://doi.org/10.5964/meth.4013
  • Is related to
    https://doi.org/10.23668/psycharchives.4420
  • Keyword(s)
    meta-analysis
    en_US
  • Keyword(s)
    graphical display
    en_US
  • Keyword(s)
    forest plot
    en_US
  • Keyword(s)
    funnel plot
    en_US
  • Keyword(s)
    (3-level) multilevel
    en_US
  • Dewey Decimal Classification number(s)
    150
  • Title
    Visual representations of meta-analyses of multiple outcomes: Extensions to forest plots, funnel plots, and caterpillar plots
    en_US
  • DRO type
    article
  • Issue
    4
  • Journal title
    Methodology
  • Page numbers
    299–315
  • Volume
    16
  • Visible tag(s)
    Version of Record
    en_US