Estimating school effectiveness with student growth percentile and gain score models

Measuring school effectiveness using student test scores is controversial and some methods used for this can be inaccurate in some situations. The validity of two statistical models – the Student Growth Percentile (SGP) model and a multilevel gain score model – are evaluated. The SGP model conditions on previous test scores thereby unblocking a backdoor path between true school/teacher effectiveness and student test scores. When the product of the coefficients that make up this unblocked backdoor path is positive, the SGP estimates can be inaccurate. The accuracy of the multilevel gain score model was not associated with the product of this backdoor path. The gain score model appears promising in these situations where the SGP and other covariate adjusted models perform poorly.