Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis

Abstract

We study recently developed nonparametric methods for estimating the number of missing studies that might exist in a meta-analysis and the effect that these studies might have had on its outcome. These are simple rank-based data augmentation techniques, which formalize the use of funnel plots. We show that they provide effective and relatively powerful tests for evaluating the existence of such publication bias. After adjusting for missing studies, we find that the point estimate of the overall effect size is approximately correct and coverage of the effect size confidence intervals is substantially improved, in many cases recovering the nominal confidence levels entirely. We illustrate the trim and fill method on existing meta-analyses of studies in clinical trials and psychometrics.

Cite this paper

Related papers

1. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews2021
2. The Measurement of Observer Agreement for Categorical Data1977
3. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement2009
4. Bias in meta-analysis detected by a simple, graphical test1997
5. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation2018