Meta-analysis of correlation coefficients: a Monte Carlo comparison of fixed- and random-effects methods

Psychol Methods. 2001 Jun;6(2):161-80. doi: 10.1037/1082-989x.6.2.161.

Abstract

The efficacy of the Hedges and colleagues, Rosenthal-Rubin, and Hunter-Schmidt methods for combining correlation coefficients was tested for cases in which population effect sizes were both fixed and variable. After a brief tutorial on these meta-analytic methods, the author presents two Monte Carlo simulations that compare these methods for cases in which the number of studies in the meta-analysis and the average sample size of studies were varied. In the fixed case the methods produced comparable estimates of the average effect size; however, the Hunter-Schmidt method failed to control the Type I error rate for the associated significance tests. In the variable case, for both the Hedges and colleagues and Hunter-Schmidt methods, Type I error rates were not controlled for meta-analyses including 15 or fewer studies and the probability of detecting small effects was less than .3. Some practical recommendations are made about the use of meta-analysis.

MeSH terms

  • Humans
  • Meta-Analysis as Topic*
  • Monte Carlo Method*
  • Psychometrics*
  • Reproducibility of Results