Balancing Weights for Estimating Treatment Effects in Educational Studies.
Saved in:
| Title: | Balancing Weights for Estimating Treatment Effects in Educational Studies. |
|---|---|
| Authors: | Keele, Luke1 (AUTHOR) luke.keele@gmail.com, Ben-Michael, Eli2 (AUTHOR), Lenard, Matthew3 (AUTHOR), Page, Lindsay4 (AUTHOR) |
| Source: | Journal of Research on Educational Effectiveness. Apr-Jun2026, Vol. 19 Issue 2, p375-402. 28p. |
| Subject Terms: | *Education research, *Preschools, Statistical weighting, Causal inference, Treatment effectiveness, Logistic regression analysis, Simulation methods & models |
| Geographic Terms: | Wake County (N.C.) |
| Abstract: | Inverse probability weights often are used in education to estimate causal effects in observational studies. A common practice is to estimate the probability of treatment (e.g., by logistic regression) and use the estimated treatment probabilities to estimate the weights. However, this approach can fail to lead to weights that adequately balance covariates between the treatment and control groups. Balancing weights provide one alternative method for estimating inverse probability weights that does not suffer from this limitation. Balancing weights are based on an algorithm that directly targets reducing imbalances during the estimation process, rather than improving model fit. Here, we provide an introduction to balancing weights methods. We outline the basic mechanics for the estimation of balancing weights, including the specification of a hyperparameter. We review the role of the hyperparameter and detail methods for data driven selection. We compare and contrast the analytic workflow for balancing weights with the more standard inverse probability weighting methods. We present a comparison based on a simulation study to illustrate conditions under which balancing weights perform as well as or better than weights estimated via logistic regression. We conclude with an original empirical application where we evaluate the effectiveness of Pre-K school programs in Wake County, North Carolina. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Research on Educational Effectiveness is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Inverse probability weights often are used in education to estimate causal effects in observational studies. A common practice is to estimate the probability of treatment (e.g., by logistic regression) and use the estimated treatment probabilities to estimate the weights. However, this approach can fail to lead to weights that adequately balance covariates between the treatment and control groups. Balancing weights provide one alternative method for estimating inverse probability weights that does not suffer from this limitation. Balancing weights are based on an algorithm that directly targets reducing imbalances during the estimation process, rather than improving model fit. Here, we provide an introduction to balancing weights methods. We outline the basic mechanics for the estimation of balancing weights, including the specification of a hyperparameter. We review the role of the hyperparameter and detail methods for data driven selection. We compare and contrast the analytic workflow for balancing weights with the more standard inverse probability weighting methods. We present a comparison based on a simulation study to illustrate conditions under which balancing weights perform as well as or better than weights estimated via logistic regression. We conclude with an original empirical application where we evaluate the effectiveness of Pre-K school programs in Wake County, North Carolina. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 19345747 |
| DOI: | 10.1080/19345747.2025.2483775 |
