faculty:
jay p. greene
department head,
endowed chair
in education reform
robert m. costrell
endowed chair
in
accountability
robert maranto
endowed chair
in leadership
gary w. ritter
endowed chair
in education policy
sandra stotsky
endowed chair
in teacher quality
patrick j. wolf
endowed chair
in school choice
| The School Performance Index in Arkansas |
January 2006 Jay P. Greene, Ph.D. Joshua H. Barnett Gary W. Ritter, Ph.D. Marcus A. Winters Executive Summary Policymakers, practitioners, journalists, and the general public regularly use the results of state accountability tests to assess the quality of schools. Schools with high scores must be “good schools,” people assume, while schools with low scores must be “bad schools.” Unfortunately this use of test results is actually a misuse. Test score results are only partially a reflection of the quality of school instruction; they are also partially a reflection of the advantages and disadvantages that students bring to school. A school with high test scores might actually be of sub-par quality propped up by very advantaged students. Conversely, a school with low test scores might actually be of high quality masked by the severity of its students’ disadvantages. Unless one isolates the influence of student characteristics and other resources made available to schools, it is impossible to determine school quality simply from test results. The School Performance Index (SPI) is an attempt to disentangle school quality from the advantages and disadvantages given to a school. Using a regression model controlling for a host of student characteristics, community characteristics, and resources, we are able to predict how well each school should be performing on standardized tests given those inputs. The extent to which schools perform better or worse than we would expect given the context in which they operate is our best estimate of the quality of the school itself. Based on our analyses, we note six key findings:
The School Performance Index is certainly not perfect. For example, it may not fully control for all advantages and disadvantages given to each school, thereby confusing school quality with unmeasured student characteristics. Nevertheless, we believe that it is a significant advance in assessing school quality. As the policymakers in the Arkansas Department of Education consider ways of reporting the level of school performance as required in Act 35, we hope they will consider the approach outlined in this report.
|
university of arkansas | department of education reform | 201 graduate education building | fayetteville | ar | 72701
Ph: 479|575-3172 Fax: 479|575-3196 | e-mail: edreform@uark.edu