View in EDS

Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence. EdWorkingPaper No. 23-726

Saved in:
Bibliographic Details
Title: Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence. EdWorkingPaper No. 23-726
Language: English
Authors: Christina Weiland, Rebecca Unterman, Susan Dynarski, Rachel Abenavoli, Howard Bloom, Breno Braga, Anne-Marie Faria, Erica Greenberg, Brian Jacob, Jane Arnold Lincove, Karen Manship, Meghan McCormick, Luke Miratrix, Tomás E. Monarrez, Pamela Morris-Perez, Anna Shapiro, Jon Valant, Lindsay Weixler, Annenberg Institute for School Reform at Brown University
Source: Annenberg Institute for School Reform at Brown University. 2023.
Availability: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
Peer Reviewed: N
Page Count: 58
Publication Date: 2023
Sponsoring Agency: Institute of Education Sciences (ED)
Arnold Ventures
Heising-Simons Foundation
Spencer Foundation
Document Type: Reports - Descriptive
Education Level: Early Childhood Education
Preschool Education
Descriptors: Early Childhood Education, Program Evaluation, Evaluation Methods, Admission (School), Competitive Selection, Educational Research, Research Methodology, Montessori Schools, Montessori Method, Preschool Education, Educational Quality, Research Design
Geographic Terms: Massachusetts (Boston), District of Columbia, Louisiana (New Orleans), New York (New York)
Abstract: Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. Our collaborative network of five research teams applying this design in early education and methods experts has identified six challenges that need to be carefully considered in this next context: (1) available baseline covariates may not be very rich; (2) limited data on the counterfactual; (3) limited and inconsistent outcome data; (4) weakened internal validity due to attrition; (5) constrained external validity due to who competes for oversubscribed programs; and (6) difficulties answering site-level questions with child-level randomization. We offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2025
Accession Number: ED672221
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED672221
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED672221
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence. EdWorkingPaper No. 23-726
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Christina+Weiland%22">Christina Weiland</searchLink><br /><searchLink fieldCode="AR" term="%22Rebecca+Unterman%22">Rebecca Unterman</searchLink><br /><searchLink fieldCode="AR" term="%22Susan+Dynarski%22">Susan Dynarski</searchLink><br /><searchLink fieldCode="AR" term="%22Rachel+Abenavoli%22">Rachel Abenavoli</searchLink><br /><searchLink fieldCode="AR" term="%22Howard+Bloom%22">Howard Bloom</searchLink><br /><searchLink fieldCode="AR" term="%22Breno+Braga%22">Breno Braga</searchLink><br /><searchLink fieldCode="AR" term="%22Anne-Marie+Faria%22">Anne-Marie Faria</searchLink><br /><searchLink fieldCode="AR" term="%22Erica+Greenberg%22">Erica Greenberg</searchLink><br /><searchLink fieldCode="AR" term="%22Brian+Jacob%22">Brian Jacob</searchLink><br /><searchLink fieldCode="AR" term="%22Jane+Arnold+Lincove%22">Jane Arnold Lincove</searchLink><br /><searchLink fieldCode="AR" term="%22Karen+Manship%22">Karen Manship</searchLink><br /><searchLink fieldCode="AR" term="%22Meghan+McCormick%22">Meghan McCormick</searchLink><br /><searchLink fieldCode="AR" term="%22Luke+Miratrix%22">Luke Miratrix</searchLink><br /><searchLink fieldCode="AR" term="%22Tomás+E%2E+Monarrez%22">Tomás E. Monarrez</searchLink><br /><searchLink fieldCode="AR" term="%22Pamela+Morris-Perez%22">Pamela Morris-Perez</searchLink><br /><searchLink fieldCode="AR" term="%22Anna+Shapiro%22">Anna Shapiro</searchLink><br /><searchLink fieldCode="AR" term="%22Jon+Valant%22">Jon Valant</searchLink><br /><searchLink fieldCode="AR" term="%22Lindsay+Weixler%22">Lindsay Weixler</searchLink><br /><searchLink fieldCode="AR" term="%22Annenberg+Institute+for+School+Reform+at+Brown+University%22">Annenberg Institute for School Reform at Brown University</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Annenberg+Institute+for+School+Reform+at+Brown+University%22"><i>Annenberg Institute for School Reform at Brown University</i></searchLink>. 2023.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 58
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)<br />Arnold Ventures<br />Heising-Simons Foundation<br />Spencer Foundation
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Descriptive
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Preschool+Education%22">Preschool Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Evaluation%22">Program Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Admission+%28School%29%22">Admission (School)</searchLink><br /><searchLink fieldCode="DE" term="%22Competitive+Selection%22">Competitive Selection</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Research%22">Educational Research</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Methodology%22">Research Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Montessori+Schools%22">Montessori Schools</searchLink><br /><searchLink fieldCode="DE" term="%22Montessori+Method%22">Montessori Method</searchLink><br /><searchLink fieldCode="DE" term="%22Preschool+Education%22">Preschool Education</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Quality%22">Educational Quality</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Design%22">Research Design</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Massachusetts+%28Boston%29%22">Massachusetts (Boston)</searchLink><br /><searchLink fieldCode="DE" term="%22District+of+Columbia%22">District of Columbia</searchLink><br /><searchLink fieldCode="DE" term="%22Louisiana+%28New+Orleans%29%22">Louisiana (New Orleans)</searchLink><br /><searchLink fieldCode="DE" term="%22New+York+%28New+York%29%22">New York (New York)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. Our collaborative network of five research teams applying this design in early education and methods experts has identified six challenges that need to be carefully considered in this next context: (1) available baseline covariates may not be very rich; (2) limited data on the counterfactual; (3) limited and inconsistent outcome data; (4) weakened internal validity due to attrition; (5) constrained external validity due to who competes for oversubscribed programs; and (6) difficulties answering site-level questions with child-level randomization. We offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED672221
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED672221
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 58
    Subjects:
      – SubjectFull: Early Childhood Education
        Type: general
      – SubjectFull: Program Evaluation
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Admission (School)
        Type: general
      – SubjectFull: Competitive Selection
        Type: general
      – SubjectFull: Educational Research
        Type: general
      – SubjectFull: Research Methodology
        Type: general
      – SubjectFull: Montessori Schools
        Type: general
      – SubjectFull: Montessori Method
        Type: general
      – SubjectFull: Preschool Education
        Type: general
      – SubjectFull: Educational Quality
        Type: general
      – SubjectFull: Research Design
        Type: general
      – SubjectFull: Massachusetts (Boston)
        Type: general
      – SubjectFull: District of Columbia
        Type: general
      – SubjectFull: Louisiana (New Orleans)
        Type: general
      – SubjectFull: New York (New York)
        Type: general
    Titles:
      – TitleFull: Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence. EdWorkingPaper No. 23-726
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Annenberg Institute for School Reform at Brown University
      – PersonEntity:
          Name:
            NameFull: Christina Weiland
      – PersonEntity:
          Name:
            NameFull: Rebecca Unterman
      – PersonEntity:
          Name:
            NameFull: Susan Dynarski
      – PersonEntity:
          Name:
            NameFull: Rachel Abenavoli
      – PersonEntity:
          Name:
            NameFull: Howard Bloom
      – PersonEntity:
          Name:
            NameFull: Breno Braga
      – PersonEntity:
          Name:
            NameFull: Anne-Marie Faria
      – PersonEntity:
          Name:
            NameFull: Erica Greenberg
      – PersonEntity:
          Name:
            NameFull: Brian Jacob
      – PersonEntity:
          Name:
            NameFull: Jane Arnold Lincove
      – PersonEntity:
          Name:
            NameFull: Karen Manship
      – PersonEntity:
          Name:
            NameFull: Meghan McCormick
      – PersonEntity:
          Name:
            NameFull: Luke Miratrix
      – PersonEntity:
          Name:
            NameFull: Tomás E. Monarrez
      – PersonEntity:
          Name:
            NameFull: Pamela Morris-Perez
      – PersonEntity:
          Name:
            NameFull: Anna Shapiro
      – PersonEntity:
          Name:
            NameFull: Jon Valant
      – PersonEntity:
          Name:
            NameFull: Lindsay Weixler
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 02
              Type: published
              Y: 2023
          Titles:
            – TitleFull: Annenberg Institute for School Reform at Brown University
              Type: main
ResultId 1