Distributing Teacher Talent Equitably:
Colorado

Teacher and Principal Evaluation Policy

Goal

The state should publicly report districts' distribution of teacher talent among schools to identify inequities in schools serving disadvantaged children. This goal was reorganized in 2021.

Meets goal
Suggested Citation:
National Council on Teacher Quality. (2021). Distributing Teacher Talent Equitably: Colorado results. State Teacher Policy Database. [Data set].
Retrieved from: https://www.nctq.org/yearbook/state/CO-Distributing-Teacher-Talent-Equitably-95

Analysis of Colorado's policies

School-level data about teacher performance: Colorado provides teacher effectiveness data at the school, district, and state levels on its School View dashboard These data also show how those numbers change over time. The state's School View and Educator View dashboards both provide a gap analysis that reports a specific metric for each district in each student demographic group. The metric is based on the gaps between the percentage of effective teachers teaching in schools rated high or low poverty, as well as those teaching in schools with high or low numbers of ELL and minority students.

Research-based factors: Colorado's Educator View dashboard provides the percentage of effective teachers by experience levels at the school and district level. The state's School View and Educator View dashboards provides district-level data on the percentage of effective teachers teaching in schools rated high or low poverty, as well as those teaching in schools with high or low numbers of ELL and minority students.
Colorado does not provide additional school-level data that includes factors such as:

  • The percentage of teachers on emergency credentials; and
  • The teacher absenteeism rate.

Citation

Recommendations for Colorado

Publish other data that facilitate comparisons across schools.
While Colorado meets this goal, the state should consider ways to build upon their data systems and add other research-based factors such as: teacher absenteeism rate and the percentage of teachers on emergency credentials.

State response to our analysis

Colorado was helpful in providing NCTQ with facts necessary for this analysis. The state noted that teacher effectiveness disaggregated by percentage of ELL students, minority students, and students participating in the free/reduced-price lunch program are reported to all superintendents and school districts on the secure password-protected site to which they have access and which is listed at the bottom of our educator effectiveness website. These disaggregated data are available on that site for all schools and districts and for all years. The department makes this level of detail available to all districts and superintendents for purposes of continuous improvement and planning.


Updated: March 2021

How we graded

7F: Distributing Teacher Talent Equitably 

  • Teacher Performance Data: The state should make aggregate school-level data about teacher effectiveness publicly available, consistent with applicable privacy constraints.
  • Research-based factors: The state should make publicly available for each school, consistent with applicable privacy constraints, research-based factors associated with teacher effectiveness, such as:
    • Percentage of first- and second-year teachers
    • Teacher absenteeism rate
    • Percentage of teachers on emergency credentials
    • Percentage of effective teachers, disaggregated by school, student subgroup, and teaching area
Teacher Performance Data
Three-quarters of the total goal score is earned based on the following: 

  • Three-quarters credit: The state will earn three-quarters of a point if it makes aggregate school-level data on teacher effectiveness publicly available, consistent with applicable privacy constraints.
  • One-quarter credit: The state will be eligible for one-quarter of a point if data on teacher effectiveness is publicly reported only at the district level, consistent with applicable privacy constraints.
Research-based factors:
One-quarter of the total goal score is earned based on the following: 

  • One-quarter credit: The state will earn one-quarter of a point if it provides, for each individual school, consistent with applicable privacy constraints, at least one research-based factor, such as: the percentage of first- and second-year teachers employed as teachers of record; teacher absenteeism; the percentage of emergency credentialed teachers; the percentage of effective teachers disaggregated by student subgroup, school, and teaching area.

Research rationale

Distribution data on teachers across schools should show more than just teachers' years of experience and highly qualified status. Transparency is one of the most important tools states have to promote the equitable distribution of teachers within and across higher and lower-need schools and districts.[1] States generally publicly report little more than what is mandated by federal requirements, which highlight years of experience and highly-qualified status. However, while teaching experience matters, the benefits of experience are largely accumulated within the first few years of teaching.[2] School districts that try to equalize experience among all schools are overestimating its impact. There is no reason why a school with many teachers with only three or five years' experience cannot outperform a school with teachers who have an average of more than 10 years' experience.

For this reason, states need to report data that are more informative about a school's teachers. As more states require evaluation systems based primarily on teacher effectiveness, the most important distribution data that a state can make available is school-level data about teacher performance. This is not to say that individual teacher ratings should be reported, but school level data would shine an important light on whether all students have access to effective teachers.

In addition to performance data, states and districts should also track and report school-level teacher absenteeism rates. When a teacher misses ten or more days of school, the decline in student achievement is often proportionate to the differences in achievement seen between students taught by a new teacher compared to those taught by a teacher with two to three years of experience. Further, studies have found that teachers serving low income and minority students have higher absence rates, on average, which may contribute to the achievement gap. In fact, it is well-documented that these averages are not representative of the bulk of teachers, as 16 percent of teachers account for almost one-third of teacher absences.[3]

States can also provide meaningful information by using an index for quantifying important teacher credentials found to correlate with student achievement. A good example of a strong index is the academic capital index developed by the Illinois Education Research Council, incorporating teachers' average SAT or ACT scores, the percentage of teachers failing basic skills licensure test at least once, the percentage of teachers on emergency credentials, average selectivity of teachers' undergraduate colleges, and the percentage of new teachers.[4] These factors are complicated, so the state should install a system that translates them into something more easily understood, such as a color-coded matrix indicating a high or low score for a school.

States need to report data at the level of the individual school. Only by achieving greater stability in the staffing of individual schools can districts achieve the nation's goal of more equitable distribution of teacher quality. A strong reporting system reflecting effectiveness data and the index described above, as well as data on teacher attrition, teacher absenteeism, and teacher credentials, can lend much-needed transparency to those factors that contribute to staffing instability and inequity.

The lack of such data feeds a misconception that all high-poverty schools are similarly unable to retain staff because of their demographics. Yet, staff stability actually varies considerably across schools with similar numbers of poor and/or minority children. Within-district comparisons are crucial in order to control for as many elements specific to a district as possible, such as a collective bargaining agreement (or the district's personnel policies) and the amount of resources.


[1] For comprehensive review of the literature on teacher quality and distribution, see: Rice, J. K. (2010). The impact of teacher experience: Examining the evidence and policy implications (Brief No. 11).  National Center for Analysis of Longitudinal Data in Education Research. Retrieved from http://www.urban.org/uploadedpdf/1001455-impact-teacher-experience.pdf; For more about how poor and minority children do not get their fair share of high-quality teachers, see: Feng, L., & Sass, T. R. (2017). Teacher quality and teacher mobility. Education Finance and Policy, 12(3), 396-418. Retrieved from http://www.mitpressjournals.org/doi/abs/10.1162/EDFP_a_00214?journalCode=edfp; Sass, T. R., Hannaway, J., Xu, Z., Figlio, D. N., & Feng, L. (2012). Value added of teachers in high-poverty schools and lower poverty schools. Journal of Urban Economics, 72(2), 104-122.; Peske, H. G., & Haycock, K. (2006). Teaching inequality: How poor and minority students are shortchanged on teacher quality: A report and recommendations by the Education Trust. Education Trust. Retrieved from
http://www.edtrust.org/dc/press-room/press-release/teaching-inequality-how-poor-and-minority-students-are-shortchanged-on-t; Education Trust also produced an analysis of the first set of state Equity Plans that pointed out the inadequacies of most states' data systems to produce reliable information about teacher qualifications and experience levels in schools disaggregated by poverty and racial composition of schools. Although almost all states were required to resubmit their plans and earned approval for them, many of the shortcomings of state data systems remained. For example, few states are equipped to identify by school, teachers' years of experience, meaning they cannot identify the ratio of new teachers to the full school staff. See: Education Trust. (2006). Missing the mark: States' teacher equity plans fall short. Retrieved from  https://edtrust.org/resource/missing-the-mark-states-teacher-equity-plans-fall-short/
[2] For more about teachers' effectiveness in the early years of teaching, see: Gordon, R., Kane, T. J., & Staiger, D. O. (2006). Identifying effective teachers using performance on the job (The Hamilton Project Policy Brief No. 2006-01). Brookings Institution. Retrieved from http://www.brookings.edu/views/papers/200604hamilton_1.pdf; See also: Rice, J. K. (2003). Teacher quality: Understanding the effectiveness of teacher attributes. Washington, DC: Economic Policy Institute.
[3] Nithya, J., Waymack, N., & Zielaski, D. (2014, June). Roll call: The importance of teacher attendance. National Council on Teacher Quality. Retrieved from https://www.nctq.org/dmsView/RollCall_TeacherAttendance
[4] For an example of a teacher quality index, see: White, B. R., Presley, J. B., & DeAngelis, K. J. (2008). Leveling up: Narrowing the teacher academic capital gap in Illinois. Illinois Education Research Council. Retrieved from http://files.eric.ed.gov/fulltext/ED502243.pdf