View in EDS

Putting School Surveys to the Test. Discussion Paper #2025.02

Saved in:
Bibliographic Details
Title: Putting School Surveys to the Test. Discussion Paper #2025.02
Language: English
Authors: Joshua Angrist, Peter Hull, Russell Legate-Yang, Parag A. Pathak, Christopher R. Walters, Massachusetts Institute of Technology (MIT), Blueprint Labs, National Bureau of Economic Research (NBER)
Source: Blueprint Labs. 2025.
Availability: Blueprint Labs. 30 Wadsworth Street, Cambridge, MA 02142. e-mail: contact@mitblueprintlabs.org; Web site: https://blueprintlabs.mit.edu/
Peer Reviewed: N
Page Count: 55
Publication Date: 2025
Sponsoring Agency: Bill and Melinda Gates Foundation
Document Type: Reports - Research
Education Level: Junior High Schools
Middle Schools
Secondary Education
High Schools
Higher Education
Postsecondary Education
Descriptors: School Districts, School Surveys, Learner Engagement, School Effectiveness, Comparative Analysis, Validity, Value Added Models, High School Graduates, College Attendance, Outcomes of Education, Achievement Tests, Scores, Advanced Placement, Prediction, Public Schools, Middle Schools, High Schools
Geographic Terms: New York (New York)
Abstract: School districts increasingly gauge school quality with surveys that ask about school climate and student engagement. We use data from New York City's middle and high schools to compare the long-run predictive validity of surveys with that of conventional test score value-added models (VAMs). Our analysis leverages the New York school match, which includes an element of random assignment, to validate a wide range of school quality estimates. We contrast the predictiveness of survey- and test-based measures for school effects on consequential outcomes related to high school graduation and college enrollment. Survey data generate better predictions of school impacts on high school graduation than test scores. But school effects on advanced high school diplomas and college attainment are better predicted by test score VAMs than surveys. We quantify the practical value of test-based and survey-based school quality measures by simulating the effects of access to one or both types of information for parents. Parents interested in boosting their children's college attainment benefit more from test score value-added than from survey data. [Additional funding provided by the Paul & Daisy Soros Fellowship.]
Abstractor: As Provided
Entry Date: 2025
Access URL: https://blueprintcdn.com/wp-content/uploads/2025/04/Blueprint-Discussion-Paper-2025.02-Angrist_Hull_Legate-Yang_Pathak_Walters.pdf
Accession Number: ED674496
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: ED674496
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Putting School Surveys to the Test. Discussion Paper #2025.02
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Joshua+Angrist%22">Joshua Angrist</searchLink><br /><searchLink fieldCode="AR" term="%22Peter+Hull%22">Peter Hull</searchLink><br /><searchLink fieldCode="AR" term="%22Russell+Legate-Yang%22">Russell Legate-Yang</searchLink><br /><searchLink fieldCode="AR" term="%22Parag+A%2E+Pathak%22">Parag A. Pathak</searchLink><br /><searchLink fieldCode="AR" term="%22Christopher+R%2E+Walters%22">Christopher R. Walters</searchLink><br /><searchLink fieldCode="AR" term="%22Massachusetts+Institute+of+Technology+%28MIT%29%2C+Blueprint+Labs%22">Massachusetts Institute of Technology (MIT), Blueprint Labs</searchLink><br /><searchLink fieldCode="AR" term="%22National+Bureau+of+Economic+Research+%28NBER%29%22">National Bureau of Economic Research (NBER)</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Blueprint+Labs%22"><i>Blueprint Labs</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Blueprint Labs. 30 Wadsworth Street, Cambridge, MA 02142. e-mail: contact@mitblueprintlabs.org; Web site: https://blueprintlabs.mit.edu/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 55
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Bill and Melinda Gates Foundation
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Junior+High+Schools%22">Junior High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22School+Districts%22">School Districts</searchLink><br /><searchLink fieldCode="DE" term="%22School+Surveys%22">School Surveys</searchLink><br /><searchLink fieldCode="DE" term="%22Learner+Engagement%22">Learner Engagement</searchLink><br /><searchLink fieldCode="DE" term="%22School+Effectiveness%22">School Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Validity%22">Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Value+Added+Models%22">Value Added Models</searchLink><br /><searchLink fieldCode="DE" term="%22High+School+Graduates%22">High School Graduates</searchLink><br /><searchLink fieldCode="DE" term="%22College+Attendance%22">College Attendance</searchLink><br /><searchLink fieldCode="DE" term="%22Outcomes+of+Education%22">Outcomes of Education</searchLink><br /><searchLink fieldCode="DE" term="%22Achievement+Tests%22">Achievement Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Advanced+Placement%22">Advanced Placement</searchLink><br /><searchLink fieldCode="DE" term="%22Prediction%22">Prediction</searchLink><br /><searchLink fieldCode="DE" term="%22Public+Schools%22">Public Schools</searchLink><br /><searchLink fieldCode="DE" term="%22Middle+Schools%22">Middle Schools</searchLink><br /><searchLink fieldCode="DE" term="%22High+Schools%22">High Schools</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22New+York+%28New+York%29%22">New York (New York)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: School districts increasingly gauge school quality with surveys that ask about school climate and student engagement. We use data from New York City's middle and high schools to compare the long-run predictive validity of surveys with that of conventional test score value-added models (VAMs). Our analysis leverages the New York school match, which includes an element of random assignment, to validate a wide range of school quality estimates. We contrast the predictiveness of survey- and test-based measures for school effects on consequential outcomes related to high school graduation and college enrollment. Survey data generate better predictions of school impacts on high school graduation than test scores. But school effects on advanced high school diplomas and college attainment are better predicted by test score VAMs than surveys. We quantify the practical value of test-based and survey-based school quality measures by simulating the effects of access to one or both types of information for parents. Parents interested in boosting their children's college attainment benefit more from test score value-added than from survey data. [Additional funding provided by the Paul & Daisy Soros Fellowship.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="https://blueprintcdn.com/wp-content/uploads/2025/04/Blueprint-Discussion-Paper-2025.02-Angrist_Hull_Legate-Yang_Pathak_Walters.pdf" linkWindow="_blank">https://blueprintcdn.com/wp-content/uploads/2025/04/Blueprint-Discussion-Paper-2025.02-Angrist_Hull_Legate-Yang_Pathak_Walters.pdf</link>
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED674496
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED674496
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 55
    Subjects:
      – SubjectFull: School Districts
        Type: general
      – SubjectFull: School Surveys
        Type: general
      – SubjectFull: Learner Engagement
        Type: general
      – SubjectFull: School Effectiveness
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Validity
        Type: general
      – SubjectFull: Value Added Models
        Type: general
      – SubjectFull: High School Graduates
        Type: general
      – SubjectFull: College Attendance
        Type: general
      – SubjectFull: Outcomes of Education
        Type: general
      – SubjectFull: Achievement Tests
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Advanced Placement
        Type: general
      – SubjectFull: Prediction
        Type: general
      – SubjectFull: Public Schools
        Type: general
      – SubjectFull: Middle Schools
        Type: general
      – SubjectFull: High Schools
        Type: general
      – SubjectFull: New York (New York)
        Type: general
    Titles:
      – TitleFull: Putting School Surveys to the Test. Discussion Paper #2025.02
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Massachusetts Institute of Technology (MIT), Blueprint Labs
      – PersonEntity:
          Name:
            NameFull: National Bureau of Economic Research (NBER)
      – PersonEntity:
          Name:
            NameFull: Joshua Angrist
      – PersonEntity:
          Name:
            NameFull: Peter Hull
      – PersonEntity:
          Name:
            NameFull: Russell Legate-Yang
      – PersonEntity:
          Name:
            NameFull: Parag A. Pathak
      – PersonEntity:
          Name:
            NameFull: Christopher R. Walters
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 04
              M: 04
              Type: published
              Y: 2025
          Titles:
            – TitleFull: Blueprint Labs
              Type: main
ResultId 1