Quantifying heterogeneity in a meta‐analysis

Julian P. T. Higgins; Simon G. Thompson

doi:10.1002/sim.1186

journal article May 21, 2002

Quantifying heterogeneity in a meta‐analysis

Julian P. T. Higgins Simon G. Thompson

Statistics in Medicine Vol. 21 No. 11 pp. 1539-1558 · Wiley

View at Publisher Save 10.1002/sim.1186

Abstract

AbstractThe extent of heterogeneity in a meta‐analysis partly determines the difficulty in drawing overall conclusions. This extent may be measured by estimating a between‐study variance, but interpretation is then specific to a particular treatment effect metric. A test for the existence of heterogeneity exists, but depends on the number of studies in the meta‐analysis. We develop measures of the impact of heterogeneity on a meta‐analysis, from mathematical criteria, that are independent of the number of studies and the treatment effect metric. We derive and propose three suitable statistics: H is the square root of the χ2 heterogeneity statistic divided by its degrees of freedom; R is the ratio of the standard error of the underlying mean from a random effects meta‐analysis to the standard error of a fixed effect meta‐analytic estimate, and I2 is a transformation of H that describes the proportion of total variation in study estimates that is due to heterogeneity. We discuss interpretation, interval estimates and other properties of these measures and examine them in five example data sets showing different amounts of heterogeneity. We conclude that H and I2, which can usually be calculated for published meta‐analyses, are particularly useful summaries of the impact of heterogeneity. One or both should be presented in published meta‐analyses in preference to the test for heterogeneity. Copyright © 2002 John Wiley & Sons, Ltd.

Topics

No keywords indexed for this article. Browse by subject →

References

27

[1]

Meta-analysis in clinical trials

Rebecca DerSimonian, Nan Laird

Controlled Clinical Trials 10.1016/0197-2456(86)90046-2

[2]

10.2307/3001666

[3]

10.1002/sim.4780101105

[4]

10.1002/(sici)1097-0258(19980430)17:8<841::aid-sim781>3.0.co;2-d

[5]

10.1136/bmj.317.7153.235

[6]

Beale RJ "Human albumin administration in critically ill patients: Analysis is superficial and conclusions exaggerated" British Medical Journal (1998)

[7]

10.1016/s0140-6736(97)08165-8

[8]

10.7326/0003-4819-117-1-59

[9]

FioravantiM YanagiM.Cytidinediphosphocholine (CDP choline) for cognitive and behavioural disturbances associated with chronic cerebral disorders in the elderly (Cochrane Review). Cochrane Database of Systematic Reviews. Update Software: Oxford 2000 Issue 3. 10.1002/14651858.cd000269

[10]

ParkerMJ HandollHHG.Gamma and other cephalocondylic intramedullary nails versus extramedullary implants for extracapsular hip fractures (Cochrane review). Cochrane Database of Systematic Reviews. Update Software: Oxford 2000 Issue 3.

[11]

10.1016/s0033-0620(85)80003-7

[12]

10.1093/oxfordjournals.aje.a009981

[13]

National Health and Medical Research Council (Australia) (2000)

[14]

10.2307/2290987

[15]

10.1002/sim.4780070807

[16]

The Cochrane Collaboration.Cochrane Database of Systematic Reviews. Update Software: Oxford 2001 Issue 2.

[17]

Kish L (1965)

[18]

10.1002/sim.4780080408

[19]

10.1002/1097-0258(20000715)19:13<1707::aid-sim491>3.0.co;2-p

[20]

10.1177/096228029300200205

[21]

10.1002/(sici)1097-0258(19991030)18:20<2693::aid-sim235>3.0.co;2-v

[22]

SpiegelhalterDJ ThomasA BestNG GilksWR. BUGS: Bayesian Inference Using Gibbs Sampling. Version 0.50. MRC Biostatistics Unit: Cambridge 1995.

[23]

10.1002/(sici)1097-0258(19970415)16:7<753::aid-sim494>3.0.co;2-g

[24]

10.1093/oxfordjournals.aje.a112220

[25]

Abramowitz M (1965)

[26]

10.1002/(sici)1097-0258(19960330)15:6<619::aid-sim188>3.0.co;2-a

[27]

10.1002/sim.4780142408

Cited By

31,148

Exploring mediators and moderators in the relationship between anxiety and alcohol use: A systematic review

Tara Gückel, Katrina Prior · 2026

Behaviour Research and Therapy

The effect of drugs and stem cell therapies on established abdominal aortic aneurysms in mice: A systematic review and meta-analysis

Callan D. Wesley, Shivshankar Thanigaimani · 2026

Vascular Pharmacology

Diagnostic Accuracy of Deep Learning Models in Detecting Peri‐Implant Marginal Bone Loss: A Systematic Review and Meta‐Analysis

Momen A. Atieh, Maanas Shah · 2026

Clinical Oral Implants Research

Effectiveness of online mindfulness-based interventions based on the structured curriculum framework in improving mental health: A meta-analysis of randomized controlled trials

MengJie Tong, Yufei Qiu · 2026

General Hospital Psychiatry

Global health worker visit time variation: A systematic review

Peter Murphy, Wajeeha Raza · 2026

Health Policy OPEN

Exposure to Occupational Inhalants and the Risk of Developing Rheumatoid Arthritis: A Systematic Review and Meta‐Analysis

Qianwen Liu, Xin Song · 2026

Arthritis & Rheumatology

Crop rotation impacts on SOC fraction contents and stability: Insights from a global meta-analysis

Samuel Adingo, Rui Jiang · 2026

Agriculture, Ecosystems & Envir...

Defining the dose-response curve of digital CBT for insomnia: a model-based network meta-analysis of treatment duration and clinical effectiveness

Yan-Bing Huang, Lu Yuan · 2026

Behaviour Research and Therapy

Efficacy and safety of Burosumab in tumor-induced osteomalacia: A systematic review and meta-analysis

Cainã Gonçalves Rodrigues, Caio Teotonio de Oliveira · 2026

Bone

Global patterns of communicable disease risk and prevention in migrant populations: A systematic literature review and meta-analysis

Anis Ben Brik, Hamad Eid Al-Romaihi · 2026

Public Health in Practice

Prevalence and Prognostic Relevance of Central Pulmonary Embolism: Systematic Review and Meta-Analysis

Winnifer Briceño, Juan Manuel Velasco · 2026

Archivos de Bronconeumología

Maternal smoking during pregnancy and childhood seizure: a systematic review and meta-analysis

Sukdong Yoo, Kihun Kim · 2026

BMC Pregnancy and Childbirth

Prevalence and epidemiological patterns of Neisseria gonorrhoeae infection in Canada, 1969–2025: a systematic review and meta-analysis

Manale Harfouche, Ammar Khan · 2026

BMC Public Health

Artificial intelligence assimilation shapes sustainable performance through dynamic capabilities

Mingyang Zhang, Wenwen Dong · 2026

Scientific Reports

Effectiveness of Interventions to Reduce Children’s Exposure to Secondhand Smoke at Home: A Meta-Analysis

Ercan Asi, Sebahat Gözüm · 2026

Journal of Child and Family Studies

It's never too late: The impact of resistance training on strength and body composition in females across the lifespan – A systematic review and meta-analysis

Eduard Isenmann, Stephan Geisler · 2026

Journal of Science and Medicine in...

Behavioral activation and prevention of depression in at-risk adults: A meta-analysis

Nathania Seanette Rochelle, Juergen Hoyer · 2026

Journal of Affective Disorders

Epidemiology of Keratoconus in India: A Systematic Review and Meta-Analysis of Indian Study Populations

Matteo Ripa, Chiara Schipa · 2026

Vision

Prevalence, species composition, and associated factors of coccidiosis among domestic ruminants in Ethiopia: Systematic review and meta-analysis

Yihenew Getahun Ambaw, Simegnew Adugna Kallu · 2026

Veterinary and Animal Science

Effect of Vitamin E Supplementation on Biomarkers of Endothelial Function in Adults: A GRADE-assessed Systematic Review and Dose-Response Meta-Analysis

Mehdi Karimi, Sepideh Abdi · 2026

Artery Research

Metrics

31,148

Citations

27

References

Details

Published: May 21, 2002
Vol/Issue: 21(11)
Pages: 1539-1558
License: View

Authors

J

Julian P. T. Higgins

Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom; NIHR Bristol Biomedical Research Centre, Bristol, United Kingdom

S

Simon G. Thompson

Cite This Article

Julian P. T. Higgins, Simon G. Thompson (2002). Quantifying heterogeneity in a meta‐analysis. Statistics in Medicine, 21(11), 1539-1558. https://doi.org/10.1002/sim.1186

Quantifying heterogeneity in a meta‐analysis

You May Also Like