A Comparison of Propensity Score Weighting Methods for Evaluating the Effects of Programs With Multiple Versions


Leite W. L., Aydin B., Gurel S.

JOURNAL OF EXPERIMENTAL EDUCATION, cilt.87, sa.1, ss.75-88, 2019 (SSCI) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 87 Sayı: 1
  • Basım Tarihi: 2019
  • Doi Numarası: 10.1080/00220973.2017.1409179
  • Dergi Adı: JOURNAL OF EXPERIMENTAL EDUCATION
  • Derginin Tarandığı İndeksler: Social Sciences Citation Index (SSCI), Scopus
  • Sayfa Sayıları: ss.75-88
  • Recep Tayyip Erdoğan Üniversitesi Adresli: Evet

Özet

This Monte Carlo simulation study compares methods to estimate the effects of programs with multiple versions when assignment of individuals to program version is not random. These methods use generalized propensity scores, which are predicted probabilities of receiving a particular level of the treatment conditional on covariates, to remove selection bias. The results indicate that inverse probability of treatment weighting (IPTW) removes the most bias, followed by optimal full matching (OFM), and marginal mean weighting through stratification (MMWTS). The study also compared standard error estimation with Taylor series linearization, bootstrapping and the jackknife across propensity score methods. With IPTW, these standard error estimation methods performed adequately, but standard errors estimates were biased in most conditions with OFM and MMWTS.