Why teaching experience really matters
Bill Gates, who appears to be running for shadow education secretary, just urged states and school districts to pay teachers according to “value-added based” merit systems that inevitably use standardized test scores to judge how well a teacher is doing, despite criticisms that there is no evidence such systems work.
Experience in teaching doesn’t matter much, nor do advanced education degrees, Gates said in a speech to the Council of Chief State School Officers' annual policy forum in Louisville on Friday.
Education Secretary Arne Duncan made the same argument about advanced education degrees two days earlier in a speech, and many times previously had backed eliminating experience as a criterion for judging and compensating teachers.
(In their speeches this week, both men called for districts to consider raising class size. A coincidence, no doubt.)
Actually, experience in the classroom does matter.
By Matthew Di Carlo
The topic of teacher experience is getting a lot of attention in education debates. In part, this makes sense, since experience (years of service) does play several important roles in education policy, including teachers’ raises and transfer/layoff policies.
Usually, experience is discussed in terms of its relationship to performance –whether more experienced teachers produce larger student test score gains than less experienced teachers. There is a pretty impressive body of research on this topic, the findings of which are sometimes used to argue for policy changes that eliminate the role of experience in salary and other employment policies. Proponents of these changes often argue that experience is only weakly related to performance, and therefore shouldn’t be used in determining salary and other conditions of work. It is not unusual to hear people say that experience doesn’t matter at all.
As is often the case when empirical research finds its way into policy debates, the “weakly related” characterization of the findings on the experience/achievement relationship borders on oversimplification, while the claim that experience doesn’t matter is flat-out wrong. The relationship is substantial but context-dependent, and blanket statements about it often hide as much as they reveal.
The dozens of analyses of teacher experience show that it matters a great deal in the early years on the job (also see here, here, here and here). There is general consensus that the returns to experience are strongest in the first year of teaching. Then the rate of improvement starts to level off quickly – usually stagnating within about 4-5 years (time frames vary a bit). After that, most teachers tend to remain relatively stable in terms of their effects on student test scores (though a very large proportion leaves the profession before that point).
But these overall findings ignore the fact that the experience/achievement relationship differs a great deal by context. For instance, the returns to experience appear to vary by where teachers work. The relationship is more consistent among elementary school teachers (especially compared with those in high schools). The effect of experience on teacher productivity may also be mediated by the quality of their peers in the same school – i.e., that novice teachers with more effective peers in the same school do better.
Similarly, there is evidence that experience matters less – or less consistently – in poorer schools (also see here). There are several plausible explanations for this discrepancy, such as the possibility that teachers in poorer schools burn out more rapidly, or that there are difficulties in teaching lower-income children that are harder to adjust to.
The experience factor not only varies by where you teach, but also by what you teach. Math teachers seem to improve more quickly (and consistently) than reading teachers, while newer evidence suggests that the same is true for teachers who remain in the same grade for multiple years.
Finally, it bears mentioning the obvious point that the effect of teacher experience might be totally different if we were able to look at outcomes other than test scores. The idea that experience doesn’t matter after five or so years incorrectly implies that test scores are the only relevant outcome. Nobody believes that is the case. (And, for what it’s worth, teachers with whom I’ve spoken find the idea that they stop improving after four or five years laughable.)
Teachers who produce test score gains are not always the same ones who are effective at imparting other types of skills. It seems quite plausible (if not probable) that teachers do exhibit longer-term improvement in their students’ learning other skills, such as social/behavioral skills, that elude standardized tests. Let’s also keep in mind that it remains an open question whether the returns to experience follow a similar pattern among teachers not in tested grades or subjects (which is roughly three in four teachers).
That said, experience is actually one of the very few observable teacher characteristics that is consistently correlated with achievement, and its effect is among the strongest, especially for some sub-groups, such as elementary school and math teachers.
Even those who think the magnitude of these returns is not commensurate with the role of experience in education policy cannot dispute that it is still a proven signal of quality, at least during the early years of teachers’ careers. And it is virtually certain that teachers also improve in other ways that don’t show up in their students’ test scores.
So, unless we are going to design employment policies based strictly on test scores (which is both ridiculous and logistically impossible), we might recalibrate these policies to exploit the findings above, including using other measures along with experience, restructuring salary schedules, keeping teachers in the same grade over multiple years, or paying more attention to the important role of peers in shaping teachers’ learning curves.
Let’s tone down the rhetoric, and try not to throw out the baby with the bathwater.
Follow my blog every day by bookmarking washingtonpost.com/answersheet. And for admissions advice, college news and links to campus papers, please check out our Higher Education page at washingtonpost.com/higher-ed Bookmark it!
| November 20, 2010; 12:46 PM ET
Categories: Guest Bloggers, Matthew Di Carlo, Teacher assessment, Teachers | Tags: arne duncan, bill gates, class size, does experience matter, education department, education secretary duncan, lowering class size, raising class size, research on class size, research on teaching experience, school reform, schools, shankar blog, standardized tests, teacher experience, teacher pay, teacher quality, teacher salaries, teachers, teaching experience, value added
Save & Share: Previous: The Matthew Effect, Plinko, and the achievement gap
Next: Testing scandal claims Atlanta schools superintendent
Posted by: mmccabe4724 | November 20, 2010 1:13 PM | Report abuse
Posted by: ilcn | November 20, 2010 1:14 PM | Report abuse
Posted by: PLMichaelsArtist-at-Large | November 20, 2010 1:16 PM | Report abuse
Posted by: bpeterson1931 | November 20, 2010 1:20 PM | Report abuse
Posted by: ilcn | November 20, 2010 1:24 PM | Report abuse
Posted by: mmccabe4724 | November 20, 2010 1:49 PM | Report abuse
Posted by: showmethedata | November 20, 2010 1:56 PM | Report abuse
Posted by: stevendphoto | November 20, 2010 2:19 PM | Report abuse
Posted by: axolotl | November 20, 2010 2:21 PM | Report abuse
Posted by: mmccabe4724 | November 20, 2010 2:29 PM | Report abuse
Posted by: ilcn | November 20, 2010 2:48 PM | Report abuse
Posted by: teacher39years | November 20, 2010 3:46 PM | Report abuse
Posted by: PLMichaelsArtist-at-Large | November 20, 2010 4:12 PM | Report abuse
Posted by: core4all | November 20, 2010 5:23 PM | Report abuse
Posted by: stevendphoto | November 20, 2010 5:52 PM | Report abuse
Posted by: musiclady | November 20, 2010 7:33 PM | Report abuse
Posted by: rabraning | November 20, 2010 9:32 PM | Report abuse
Posted by: stevendphoto | November 20, 2010 11:00 PM | Report abuse
Posted by: efavorite | November 21, 2010 12:36 AM | Report abuse
Posted by: thetensionmakesitwork | November 21, 2010 6:07 AM | Report abuse
Posted by: HSTchr | November 21, 2010 7:16 AM | Report abuse
Posted by: ananna | November 21, 2010 11:18 AM | Report abuse
Posted by: buckbuck11 | November 21, 2010 11:58 AM | Report abuse
Posted by: ilcn | November 21, 2010 1:24 PM | Report abuse
Posted by: stevendphoto | November 21, 2010 3:15 PM | Report abuse
Posted by: ilcn | November 21, 2010 5:17 PM | Report abuse
Posted by: efavorite | November 21, 2010 5:17 PM | Report abuse
Posted by: lacy41 | November 21, 2010 9:09 PM | Report abuse
Posted by: southsidemike1 | November 22, 2010 3:06 PM | Report abuse
Posted by: islandoak | November 22, 2010 3:26 PM | Report abuse
Posted by: southsidemike1 | November 22, 2010 3:32 PM | Report abuse
Posted by: southsidemike1 | November 22, 2010 3:33 PM | Report abuse
Posted by: acasey3 | November 23, 2010 4:03 PM | Report abuse
Posted by: acasey3 | November 23, 2010 4:04 PM | Report abuse
The comments to this entry are closed.