TY - JOUR
T1 - The District-Wide Effectiveness of the Achieve3000 Program
T2 - A Quasi-Experimental Study
AU - Borman, Geoffrey D.
AU - Yang, Hyunwoo
AU - Audrain, R. Lennon
AU - Park, So Jung
N1 - Publisher Copyright:
© 2023 Taylor & Francis Group, LLC.
PY - 2023
Y1 - 2023
N2 - Drawing on state reading achievement data provided by a California school district, we analyze the achievement impacts of Achieve3000, an intervention designed to offer K-12 students expanded opportunities to acquire literacy skills. Achieve3000 is a personalized, technology-adaptive program to supplement regular instruction in English language arts, science, and social studies. We apply propensity score matching methods to match 1,761 participating Achieve3000 students to 945 similar students to estimate the effects of the Achieve3000 intervention. Applying a doubly-robust regression model, our results suggest that Achieve3000 students outperformed comparison students by a mean effect size of 0.06. Further, two-stage least squares regression models reveal that treatment students’ scores increased statistically significantly by 0.001 standard deviations for both each activity completed and for each additional hour of Achieve3000 participation. Despite some problems of implementation, our quasi-experimental evidence of the positive impacts of Achieve3000 suggests a possibly promising way to overcome COVID-19 learning losses through computer-based, one-on-one tutoring at scale.
AB - Drawing on state reading achievement data provided by a California school district, we analyze the achievement impacts of Achieve3000, an intervention designed to offer K-12 students expanded opportunities to acquire literacy skills. Achieve3000 is a personalized, technology-adaptive program to supplement regular instruction in English language arts, science, and social studies. We apply propensity score matching methods to match 1,761 participating Achieve3000 students to 945 similar students to estimate the effects of the Achieve3000 intervention. Applying a doubly-robust regression model, our results suggest that Achieve3000 students outperformed comparison students by a mean effect size of 0.06. Further, two-stage least squares regression models reveal that treatment students’ scores increased statistically significantly by 0.001 standard deviations for both each activity completed and for each additional hour of Achieve3000 participation. Despite some problems of implementation, our quasi-experimental evidence of the positive impacts of Achieve3000 suggests a possibly promising way to overcome COVID-19 learning losses through computer-based, one-on-one tutoring at scale.
UR - http://www.scopus.com/inward/record.url?scp=85161372330&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85161372330&partnerID=8YFLogxK
U2 - 10.1080/10824669.2023.2218093
DO - 10.1080/10824669.2023.2218093
M3 - Article
AN - SCOPUS:85161372330
SN - 1082-4669
JO - Journal of Education for Students Placed at Risk
JF - Journal of Education for Students Placed at Risk
ER -