Intraclass Correlation Values for Planning Group-Randomized Trials in Education

Larry V. Hedges; E. C. Hedberg

doi:10.3102/0162373707299706

journal article Mar 01, 2007

Intraclass Correlation Values for Planning Group-Randomized Trials in Education

Larry V. Hedges E. C. Hedberg

Educational Evaluation and Policy Analysis Vol. 29 No. 1 pp. 60-87 · American Educational Research Association (AERA)

View at Publisher Save 10.3102/0162373707299706

Abstract

Experiments that assign intact groups to treatment conditions are increasingly common in social research. In educational research, the groups assigned are often schools. The design of group-randomized experiments requires knowledge of the intraclass correlation structure to compute statistical power and sample sizes required to achieve adequate power. This article provides a compilation of intraclass correlation values of academic achievement and related covariate effects that could be used for planning group-randomized experiments in education. It also provides variance component information that is useful in planning experiments involving covariates. The use of these values to compute the statistical power of group-randomized experiments is illustrated.

Topics

No keywords indexed for this article. Browse by subject →

References

35

[1]

10.3102/10769986011002161

[2]

10.1177/0193841x9501900504

[3]

Bloom HS (2005)

[4]

10.1177/0193841x9902300405

[5]

10.3102/0162373707299550

[6]

Borenstein M (2001)

[7]

Cohen J (1977)

[8]

Curtin TR (2002)

[9]

RANDOMIZATION BY CLUSTER

ALLAN DONNER, NICHOLAS BIRKETT, CAROL BUCK

American Journal of Epidemiology 1981 10.1093/oxfordjournals.aje.a113261

[10]

Donner A (2000)

[11]

Donner A Annals of Human Genetics (1982) 10.1111/j.1469-1809.1982.tb00718.x

[12]

Gulliford MC American Journal of Epidemiology (1999) 10.1093/oxfordjournals.aje.a009904

[13]

Hedges LV Journal of Educational and Behavioral Statistics

[14]

Hedges LV Journal of Educational and Behavioral Statistics

[15]

10.3102/00028312019001005

[16]

Kish L (1965)

[17]

Klar N Statistics in Medicine (2001) 10.1002/sim.1115

[18]

Konstantopoulos S (2006)

[19]

Kraemer HC (1987)

[20]

Lipsey MW (1990)

[21]

Miller JD (1992)

[22]

Miller R (1977)

[23]

Mosteller F (2002)

[24]

Murray DM (1998)

[25]

10.1177/0193841x02239019

[26]

10.1177/0193841x9602000305

[27]

Murray DM American Journal of Public Health (2004) 10.2105/ajph.94.3.423

[28]

Puma MJ (1997)

[29]

Raudenbush SW Psychological Methods (1997) 10.1037/1082-989x.2.2.173

[30]

Raudenbush SW (2002)

[31]

Raudenbush SW Psychological Methods (2000) 10.1037/1082-989x.5.2.199

[32]

Schochet PZ (2005)

[33]

10.3102/10769986018003237

[34]

Tourangeau K (2005)

[35]

Verma V International Statistical Review (1996) 10.2307/1403786

Cited By

620

Role of School Principals’ Technology Leadership Practices in Building a Learning Organization Culture in Public K-12 Schools

Köksal Banoğlu, Ruben Vanderlinde · 2022

Journal of School Leadership

Effect of nutritionally modified infant formula on academic performance: linkage of seven dormant randomised controlled trials to national education data

Maximiliane L Verfürden, Ruth Gilbert · 2021

BMJ

Differentiated Literacy Instruction: Boondoggle or Best Practice?

Kelly Puzio, Glenn T. Colby · 2020

Review of Educational Research

The Effects of Writing on Learning in Science, Social Studies, and Mathematics: A Meta-Analysis

Steve Graham, Sharlene A. Kiuhara · 2020

Review of Educational Research

Updating and expanding systematic reviews and meta‐analyses on the effects of school‐wide positive behavior interventions and supports

Ahhyun Lee, Nicholas A. Gage · 2020

Psychology in the Schools

A Meta-Analytic Review of Preschool Social and Emotional Learning Interventions

Dana Murano, Jeremy E. Sawyer · 2020

Review of Educational Research

Effects of bystander programs on the prevention of sexual assault among adolescents and college students: A systematic review

Heather Hensman Kettrey, Robert A. Marx · 2019

Campbell Systematic Reviews

Multiple dimensions of adolescents’ reading attitudes and their relationship with reading comprehension

Bong Gee Jang, Ji Hoon Ryoo · 2018

Reading and Writing

The Effects of Bystander Programs on the Prevention of Sexual Assault across the College Years: A Systematic Review and Meta-analysis

Heather Hensman Kettrey, Robert A Marx · 2018

Journal of Youth and Adolescence

Effectiveness of Literacy Programs Balancing Reading and Writing Instruction: A Meta‐Analysis

Steve Graham, Xinghua Liu · 2017

Reading Research Quarterly

Back to Basics with Mixed-Effects Models: Nine Take-Away Points

Paul D. Bliese, Mark A. Maltarich · 2017

Journal of Business and Psychology

The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling

Hsien-Yuan Hsu, Jr-Hung Lin · 2016

Educational and Psychological Measu...

Reference Values of Within-District Intraclass Correlations of Academic Achievement by District Characteristics

E. C. Hedberg, Larry V. Hedges · 2014

Evaluation Review

The Effect of Small Sample Size on Two-Level Model Estimates: A Review and Illustration

Daniel M. McNeish, Laura M. Stapleton · 2014

Educational Psychology Review

Does spelling instruction make students better spellers, readers, and writers? A meta-analytic review

Steve Graham, Tanya Santangelo · 2014

Reading and Writing

Teachers’ self-efficacy, personality, and teaching effectiveness: A meta-analysis

Robert M. Klassen, Virginia M.C. Tze · 2014

Educational Research Review

Intraclass Correlations and Covariate Outcome Correlations for Planning Two- and Three-Level Cluster-Randomized Experiments in Education

Larry V. Hedges, E. C. Hedberg · 2013

Evaluation Review

PowerUp!: A Tool for Calculating Minimum Detectable Effect Sizes and Minimum Required Sample Sizes for Experimental and Quasi-Experimental Design Studies

Nianbo Dong, Rebecca Maynard · 2013

Journal of Research on Educational...

Best-Practice Recommendations for Estimating Cross-Level Interaction Effects Using Multilevel Modeling

Herman Aguinis, Ryan K. Gottfredson · 2013

Journal of Management

Which decision‐making arrangements generate the strongest legitimacy beliefs? Evidence from a randomised field experiment

Peter Esaiasson, Mikael Gilljam · 2012

European Journal of Political Resea...

Metrics

620

Citations

35

References

Details

Published: Mar 01, 2007
Vol/Issue: 29(1)
Pages: 60-87
License: View

Authors

L

Larry V. Hedges

Northwestern University

E

E. C. Hedberg

University of Chicago

Cite This Article

Larry V. Hedges, E. C. Hedberg (2007). Intraclass Correlation Values for Planning Group-Randomized Trials in Education. Educational Evaluation and Policy Analysis, 29(1), 60-87. https://doi.org/10.3102/0162373707299706

Intraclass Correlation Values for Planning Group-Randomized Trials in Education

You May Also Like