Abstract
The Education Value-Added Assessment System (EVAAS), the value-added model (VAM) sold by the international business analytics software company SAS Institute Inc., is advertised as offering “precise, reliable and unbiased results that go far beyond what other simplistic [value-added] models found in the market today can provide.” In this study, we investigated these claims, as well as others pertaining to the validity or truthfulness of model output, by conducting analyses on more than 1,700 teachers’ EVAAS results (i.e., actual EVAAS output to which no other external scholars have had access prior) from the Houston Independent School District (HISD). We found the EVAAS to perform, overall, in line with other VAMs in terms of validity and reliability, although it yielded possibly more biased value-added estimates than other VAMs due to differences in teacher’s EVAAS scores based on school-level student composition factors.
Original language | English (US) |
---|---|
Journal | SAGE Open |
Volume | 10 |
Issue number | 2 |
DOIs | |
State | Published - Apr 2020 |
Keywords
- accountability
- evaluation
- teacher assessment
- validity/reliability
- value-added models
ASJC Scopus subject areas
- General Arts and Humanities
- General Social Sciences
Fingerprint
Dive into the research topics of 'Methodological Concerns About the Education Value-Added Assessment System (EVAAS): Validity, Reliability, and Bias'. Together they form a unique fingerprint.Datasets
-
Methodological Concerns About the Education Value-Added Assessment System (EVAAS): Validity, Reliability, and Bias
Amrein-Beardsley, A. (Creator) & Geiger, T. (Contributor), figshare SAGE Publications, 2020
DOI: 10.25384/sage.c.4987343.v1, https://sage.figshare.com/collections/Methodological_Concerns_About_the_Education_Value-Added_Assessment_System_EVAAS_Validity_Reliability_and_Bias/4987343/1
Dataset
-
EVAAS_SAGEOpen_Appendix – Supplemental material for Methodological Concerns About the Education Value-Added Assessment System (EVAAS): Validity, Reliability, and Bias
Amrein-Beardsley, A. (Contributor) & Geiger, T. (Contributor), figshare SAGE Publications, Jan 1 2020
DOI: 10.25384/sage.12349580.v1, https://doi.org/10.25384%2Fsage.12349580.v1
Dataset
-
Methodological Concerns About the Education Value-Added Assessment System (EVAAS): Validity, Reliability, and Bias
Amrein-Beardsley, A. (Creator) & Geiger, T. (Contributor), SAGE Journals, 2020
DOI: 10.25384/sage.c.4987343, https://sage.figshare.com/collections/Methodological_Concerns_About_the_Education_Value-Added_Assessment_System_EVAAS_Validity_Reliability_and_Bias/4987343
Dataset