Logo image
(In)Stability of Test Scores
Journal article   Open access   Peer reviewed

(In)Stability of Test Scores

Stefan Merchant, Jessica Rich and Don A. Klinger
Canadian Journal of Educational Administration and Policy, Vol.201, pp.15-27
2023
pdf
Published604.67 kBDownloadView
Published (Version of Record)CC BY V4.0 Open Access
url
https://doi.org/10.7202/1095480arView
Published (Version of Record) Open

Abstract

large-scale testing G-theory educational policy test reliability
Both school and district administrators use the results of standardized, large-scale tests to inform decisions about the need for, or success of, educational programs and interventions. However, test results at the school level are subject to random fluctuations due to changes in cohort, test items, and other factors outside of the school’s control. This study examined year to year changes in school level results on standardized tests delivered in Ontario, Canada. G-theory analyses found that test scores are not stable enough for meaningful conclusions to be made based on year to year changes in school level results. For small and medium sized schools, years of data need to be collected before defensible decisions can be made about trends in test scores. The authors introduce a ‘bounce’ statistic that provides a simple, easy to interpret measure of test score stability.

Details

UN Sustainable Development Goals (SDGs)

This output has contributed to the advancement of the following goals:

#4 Quality Education

Source: InCites

Metrics

1 File views/ downloads
46 Record Views
Logo image