journal article Feb 06, 2025

Estimating Average Treatment Effects With Support Vector Machines

View at Publisher Save 10.1002/sim.70006
Abstract
ABSTRACT
Support vector machine (SVM) is one of the most popular classification algorithms in the machine learning literature. We demonstrate that SVM can be used to balance covariates and estimate average causal effects under the unconfoundedness assumption. Specifically, we adapt the SVM classifier as a kernel‐based weighting procedure that minimizes the maximum mean discrepancy between the treatment and control groups while simultaneously maximizing effective sample size. We also show that SVM is a continuous relaxation of the quadratic integer program for computing the largest balanced subset, establishing its direct relation to the cardinality matching method. Another important feature of SVM is that the regularization parameter controls the trade‐off between covariate balance and effective sample size. As a result, the existing SVM path algorithm can be used to compute the balance‐sample size frontier. We characterize the bias of causal effect estimation arising from this trade‐off, connecting the proposed SVM procedure to the existing kernel balancing methods. Finally, we conduct simulation and empirical studies to evaluate the performance of the proposed methodology and find that SVM is competitive with the state‐of‐the‐art covariate balancing methods.
Topics

No keywords indexed for this article. Browse by subject →

References
47
[4]
Matching Methods for Causal Inference: A Review and a Look Forward

Elizabeth A. Stuart

Statistical Science 10.1214/09-sts313
[6]
Covariate Balancing Propensity Score

Kosuke Imai, Marc Ratkovic

Journal of the Royal Statistical Society Series B:... 10.1111/rssb.12027
[7]
Stable Weights that Balance Covariates for Estimation With Incomplete Outcome Data

José R. Zubizarreta

Journal of the American Statistical Association 10.1080/01621459.2015.1023805
[8]
Globally Efficient Non-Parametric Inference of Average Treatment Effects by Empirical Balancing Calibration Weighting

Kwun Chuen Gary Chan, Sheung Chi Phillip Yam, Zheng Zhang

Journal of the Royal Statistical Society Series B:... 10.1111/rssb.12129
[10]
Balancing Covariates via Propensity Score Weighting

Fan Li, Kari Lock Morgan, Alan M. Zaslavsky

Journal of the American Statistical Association 10.1080/01621459.2016.1260466
[13]
Hazlett C. "Kernel Balancing: A Flexible Non‐parametric Weighting Procedure for Estimating Causal Effects" Statistica Sinica (2020)
[14]
Kallus N. "Generalized Optimal Matching Methods for Causal Inference" Journal of Machine Learning Research (2020)
[17]
Support-Vector Networks

Corinna Cortes, Vladimir Vapnik

Machine Learning 10.1023/a:1022627411411
[18]
Schölkopf B. (2002)
[19]
Gretton A. "A Kernel Method for the Two‐Sample‐Problem" Advances in Neural Information Processing Systems (2007)
[20]
Hastie T. "The Entire Regularization Path for the Support Vector Machine" Journal of Machine Learning Research (2004)
[23]
Ratkovic M. (2014)
[31]
Gretton A. "A Kernel Statistical Test of Independence" Advances in Neural Information Processing Systems (2007)
[32]
Gretton A. "A Kernel Two‐Sample Test" Journal of Machine Learning Research (2012)
[34]
Sriperumbudur B. K. "Hilbert Space Embeddings and Metrics on Probability Measures" Journal of Machine Learning Research (2010)
[39]
Improving propensity score weighting using machine learning

Brian K. Lee, Justin Lessler, Elizabeth A. Stuart

Statistics in Medicine 10.1002/sim.3782
[41]
O. L.Gurobi “Gurobi Optimizer Reference Manual ”2020.
[45]
Steinwart I. "Sparseness of Support Vector Machines—Some Asymptotically Sharp Bounds" Advances in Neural Information Processing Systems (2004)
Metrics
2
Citations
47
References
Details
Published
Feb 06, 2025
Vol/Issue
44(5)
License
View
Funding
Alfred P. Sloan Foundation Award: 2020‐13946
Cite This Article
Alexander Tarr, Kosuke Imai (2025). Estimating Average Treatment Effects With Support Vector Machines. Statistics in Medicine, 44(5). https://doi.org/10.1002/sim.70006