Introduction to Meta-analysis

SPORTSCIENCE · sportsci.org
Perspectives / Research Resources

An Introduction to Meta-analysis

Will G Hopkins

Sportscience 8, 20-24, 2004 (sportsci.org/jour/04/wghmeta.htm)
Sport and Recreation, Auckland University of Technology, Auckland 1020, New Zealand. Email.
Reviewer: George A Kelley, Meta-Analytic Research Group, Community Medicine, West Virginia University, Morgantown, WV 26506-9190.

A meta-analysis is a systematic quantitative review of original research studies of some phenomenon, such as the effect of a specific treatment on some aspect of health or behavior. The meta-analyst expresses the magnitudes of effects from all relevant studies in the same units, then uses an appropriate weighting factor (the inverse of each effect's error variance) to combine the magnitudes into a mean value and its uncertainty (confidence limits). In a traditional meta-analysis, the true effects are assumed to be homogeneous (have the same value) in the analyzed studies, and some "outlier" studies may be eliminated to satisfy this assumption. In the more recent and realistic random-effect or mixed-model meta-analysis, true values of all effects are assumed to be heterogeneous (different), and the analysis provides an estimate of the heterogeneity as a standard deviation representing unexplained typical true variation in the effect between studies. Inclusion of study and mean subject characteristics in the analysis as covariates may reduce heterogeneity and provide further useful information about the magnitude of the effect in different locations and with different subjects. Published effects are usually larger than their true values, owing to the misuse of statistical significance as a criterion for publication. A funnel plot can detect such publication bias, but there is currently no satisfactory way to adjust for it in the meta-analysis, and the only long-term solution is to ban statistical significance.

KEYWORDS: Cochrane Collaboration, funnel plot, mixed model, quantitative analysis, random effect, research, systematic review.

Reprint pdf · Reprint doc · Slideshow

Update Aug 2007: minor improvements to slideshow. See also a more succinct version of the slideshow prepared for but not presented at the 2007 ACSM meeting, as explained in the conference report.

The basis for this article is an updated version of a slideshow accompanying a talk on meta-analysis I presented this year locally and at the University of Bath. The article should meet a need for a straightforward and up-to-date account of meta-analysis suitable for research students and staff in the sport sciences and other biomedical disciplines.

My experience with meta-analysis is limited–one analysis published and three others completed recently–but most of my assertions appear to be consistent with those in the ultimate source of meta-analytic wisdom, the handbook of the Cochrane Collaboration (cochrane.org) I depart from the handbook with my emphasis or novel material on individual responses, standardized differences in means, log transformation, measures of physical performance, and correlations. You will need to refer to the Cochrane handbook for information on topics I don't cover, including survival analysis, intention-to-treat analysis, and meta-analysis of single-subject studies (cases or individual patient data).

The reprint pdf version of this article contains printer-friendly images of the PowerPoint slideshow and references to relevant publications.