View in EDS

The Effects of Comprehensive Educator Evaluation and Pay Reform on Achievement. Working Paper No. 281-0323

Saved in:
Bibliographic Details
Title: The Effects of Comprehensive Educator Evaluation and Pay Reform on Achievement. Working Paper No. 281-0323
Language: English
Authors: Hanushek, Eric, Luo, Jin, Morgan, Andrew, Nguyen, Minh, Ost, Ben, Rivkin, Steven, Shakeel, Ayman, National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research
Source: National Center for Analysis of Longitudinal Data in Education Research (CALDER). 2023.
Availability: National Center for Analysis of Longitudinal Data in Education Research. American Institutes for Research, 1000 Thomas Jefferson Street NW, Washington, DC 20007. Tel: 202-403-5796; Fax: 202-403-6783; e-mail: info@caldercenter.org; Web site: https://caldercenter.org
Peer Reviewed: N
Page Count: 47
Publication Date: 2023
Sponsoring Agency: Laura and John Arnold Foundation
Document Type: Reports - Research
Descriptors: Teacher Evaluation, Comprehensive Programs, Educational Change, Teacher Salaries, Academic Achievement, Teacher Effectiveness, Mathematics Achievement, Reading Achievement, Educational Quality, Educational Improvement, Principals, Outcomes of Education
Geographic Terms: Texas
Abstract: A fundamental question for education policy is whether outcomes-based accountability including comprehensive educator evaluations and a closer relationship between effectiveness and compensation improves the quality of instruction and raises achievement. We use synthetic control methods to study the comprehensive teacher and principal evaluation and compensation systems introduced in the Dallas Independent School District (Dallas ISD) in 2013 for principals and 2015 for teachers. Under this far-reaching reform, educator evaluations that are used to support teacher growth and determine salary depend on a combination of supervisor evaluations, student achievement, and student or family survey responses. The reform replaced salary scales based on experience and educational attainment with those based on evaluation scores, a radical departure from decades of rigid salary schedules. The synthetic control estimates reveal positive and significant effects of the reforms on math and reading achievement that increase over time. From 2015 through 2019, the average achievement for the synthetic control district fluctuates narrowly between -0.27 s.d. and -0.3 s.d., while the Dallas ISD average increases steadily from -0.28 s.d. in 2015 to -0.08 s.d. in 2019, the final year of the sample. Though the increase for reading is roughly half as large, it is also highly significant. [This research was supported by grants from the CALDER Research Network.]
Abstractor: As Provided
Entry Date: 2023
Accession Number: ED627968
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED627968
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED627968
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Effects of Comprehensive Educator Evaluation and Pay Reform on Achievement. Working Paper No. 281-0323
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Hanushek%2C+Eric%22">Hanushek, Eric</searchLink><br /><searchLink fieldCode="AR" term="%22Luo%2C+Jin%22">Luo, Jin</searchLink><br /><searchLink fieldCode="AR" term="%22Morgan%2C+Andrew%22">Morgan, Andrew</searchLink><br /><searchLink fieldCode="AR" term="%22Nguyen%2C+Minh%22">Nguyen, Minh</searchLink><br /><searchLink fieldCode="AR" term="%22Ost%2C+Ben%22">Ost, Ben</searchLink><br /><searchLink fieldCode="AR" term="%22Rivkin%2C+Steven%22">Rivkin, Steven</searchLink><br /><searchLink fieldCode="AR" term="%22Shakeel%2C+Ayman%22">Shakeel, Ayman</searchLink><br /><searchLink fieldCode="AR" term="%22National+Center+for+Analysis+of+Longitudinal+Data+in+Education+Research+%28CALDER%29+at+American+Institutes+for+Research%22">National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22National+Center+for+Analysis+of+Longitudinal+Data+in+Education+Research+%28CALDER%29%22"><i>National Center for Analysis of Longitudinal Data in Education Research (CALDER)</i></searchLink>. 2023.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: National Center for Analysis of Longitudinal Data in Education Research. American Institutes for Research, 1000 Thomas Jefferson Street NW, Washington, DC 20007. Tel: 202-403-5796; Fax: 202-403-6783; e-mail: info@caldercenter.org; Web site: https://caldercenter.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 47
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Laura and John Arnold Foundation
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Teacher+Evaluation%22">Teacher Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Comprehensive+Programs%22">Comprehensive Programs</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Change%22">Educational Change</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Salaries%22">Teacher Salaries</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+Achievement%22">Academic Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Effectiveness%22">Teacher Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Achievement%22">Mathematics Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Achievement%22">Reading Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Quality%22">Educational Quality</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Improvement%22">Educational Improvement</searchLink><br /><searchLink fieldCode="DE" term="%22Principals%22">Principals</searchLink><br /><searchLink fieldCode="DE" term="%22Outcomes+of+Education%22">Outcomes of Education</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Texas%22">Texas</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: A fundamental question for education policy is whether outcomes-based accountability including comprehensive educator evaluations and a closer relationship between effectiveness and compensation improves the quality of instruction and raises achievement. We use synthetic control methods to study the comprehensive teacher and principal evaluation and compensation systems introduced in the Dallas Independent School District (Dallas ISD) in 2013 for principals and 2015 for teachers. Under this far-reaching reform, educator evaluations that are used to support teacher growth and determine salary depend on a combination of supervisor evaluations, student achievement, and student or family survey responses. The reform replaced salary scales based on experience and educational attainment with those based on evaluation scores, a radical departure from decades of rigid salary schedules. The synthetic control estimates reveal positive and significant effects of the reforms on math and reading achievement that increase over time. From 2015 through 2019, the average achievement for the synthetic control district fluctuates narrowly between -0.27 s.d. and -0.3 s.d., while the Dallas ISD average increases steadily from -0.28 s.d. in 2015 to -0.08 s.d. in 2019, the final year of the sample. Though the increase for reading is roughly half as large, it is also highly significant. [This research was supported by grants from the CALDER Research Network.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED627968
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED627968
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 47
    Subjects:
      – SubjectFull: Teacher Evaluation
        Type: general
      – SubjectFull: Comprehensive Programs
        Type: general
      – SubjectFull: Educational Change
        Type: general
      – SubjectFull: Teacher Salaries
        Type: general
      – SubjectFull: Academic Achievement
        Type: general
      – SubjectFull: Teacher Effectiveness
        Type: general
      – SubjectFull: Mathematics Achievement
        Type: general
      – SubjectFull: Reading Achievement
        Type: general
      – SubjectFull: Educational Quality
        Type: general
      – SubjectFull: Educational Improvement
        Type: general
      – SubjectFull: Principals
        Type: general
      – SubjectFull: Outcomes of Education
        Type: general
      – SubjectFull: Texas
        Type: general
    Titles:
      – TitleFull: The Effects of Comprehensive Educator Evaluation and Pay Reform on Achievement. Working Paper No. 281-0323
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research
      – PersonEntity:
          Name:
            NameFull: Hanushek, Eric
      – PersonEntity:
          Name:
            NameFull: Luo, Jin
      – PersonEntity:
          Name:
            NameFull: Morgan, Andrew
      – PersonEntity:
          Name:
            NameFull: Nguyen, Minh
      – PersonEntity:
          Name:
            NameFull: Ost, Ben
      – PersonEntity:
          Name:
            NameFull: Rivkin, Steven
      – PersonEntity:
          Name:
            NameFull: Shakeel, Ayman
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 03
              Type: published
              Y: 2023
          Titles:
            – TitleFull: National Center for Analysis of Longitudinal Data in Education Research (CALDER)
              Type: main
ResultId 1