View in EDS

Program Evaluation for Augustine Literacy Project-Charlotte. CEME Technical Report. CEMETR-2025-02

Saved in:
Bibliographic Details
Title: Program Evaluation for Augustine Literacy Project-Charlotte. CEME Technical Report. CEMETR-2025-02
Language: English
Authors: Qiao Liu, Carl D. Westine, Richard Lambert, University of North Carolina at Charlotte, Center for Educational Measurement and Evaluation (CEME)
Source: Center for Educational Measurement and Evaluation. 2025.
Availability: Center for Educational Measurement and Evaluation. Department of Educational Leadership, UNC Charlotte, 9201 University City Blvd., Charlotte, NC 28223. Tel: 704-687-8867; Fax: 704-687-1629; e-mail: ceme-coed@uncc.edu; Web site: https://ceme.charlotte.edu/
Peer Reviewed: N
Page Count: 32
Publication Date: 2025
Document Type: Reports - Research
Education Level: Elementary Education
Early Childhood Education
Grade 1
Primary Education
Grade 2
Descriptors: Emergent Literacy, Tutoring, Elementary School Students, Program Effectiveness, Grade 1, Grade 2, Literacy Education, Academic Achievement, Risk, Program Implementation
Geographic Terms: North Carolina (Charlotte)
Assessment and Survey Identifiers: Dynamic Indicators of Basic Early Literacy Skills (DIBELS)
Abstract: The evaluation examined the effectiveness of the Augustine Literacy Project-Charlotte (ALP) tutoring in improving early literacy skills among students in early elementary grades. This tutoring program is based on the Orton-Gillingham approach and utilizes volunteer tutors meeting twice per week for 45 minutes with students from under resourced schools in Charlotte, NC. Specific attention was placed upon assessing effects associated with cumulative technology and data-driven program enhancement efforts to improve training and promote standardization during tutor sessions, which were realized in year three. Administrative datasets were obtained from 19 Charlotte-Mecklenburg elementary schools over three academic years (2021-22, 2022-23, and 2023-24). At baseline, students who received ALP tutoring (treatment group) differed from non-participating peers (untreated group) in both demographic characteristics and initial literacy (i.e., DIBELS) scores. To address these pre-existing differences, propensity score matching (PSM) was employed to create statistically comparable groups for outcome analysis. Overall, students who received ALP tutoring demonstrated greater gains in literacy skills as measured by DIBELS composite scores than their matched peers. Positive effects, though not always statistically significant, were consistently observed among first-grade students across all three years. For second graders, positive treatment effects were evident in two of the three years. Furthermore, during the 2023-2024 academic year when ALP operated with enhanced tutor training, implementation guidelines, and progress monitoring, participation in ALP was associated with enhanced outcomes for students: both first and second graders in the ALP group showed statistically significant literacy gains compared to their matched counterparts, and there were substantial increases in the percentage of students who were performing at or above grade level in reading skills by the end of the academic year.
Abstractor: ERIC
Entry Date: 2026
Accession Number: ED679449
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED679449
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED679449
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Program Evaluation for Augustine Literacy Project-Charlotte. CEME Technical Report. CEMETR-2025-02
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Qiao+Liu%22">Qiao Liu</searchLink><br /><searchLink fieldCode="AR" term="%22Carl+D%2E+Westine%22">Carl D. Westine</searchLink><br /><searchLink fieldCode="AR" term="%22Richard+Lambert%22">Richard Lambert</searchLink><br /><searchLink fieldCode="AR" term="%22University+of+North+Carolina+at+Charlotte%2C+Center+for+Educational+Measurement+and+Evaluation+%28CEME%29%22">University of North Carolina at Charlotte, Center for Educational Measurement and Evaluation (CEME)</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Center+for+Educational+Measurement+and+Evaluation%22"><i>Center for Educational Measurement and Evaluation</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Center for Educational Measurement and Evaluation. Department of Educational Leadership, UNC Charlotte, 9201 University City Blvd., Charlotte, NC 28223. Tel: 704-687-8867; Fax: 704-687-1629; e-mail: ceme-coed@uncc.edu; Web site: https://ceme.charlotte.edu/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 32
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+1%22">Grade 1</searchLink><br /><searchLink fieldCode="EL" term="%22Primary+Education%22">Primary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+2%22">Grade 2</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Emergent+Literacy%22">Emergent Literacy</searchLink><br /><searchLink fieldCode="DE" term="%22Tutoring%22">Tutoring</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Effectiveness%22">Program Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+1%22">Grade 1</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+2%22">Grade 2</searchLink><br /><searchLink fieldCode="DE" term="%22Literacy+Education%22">Literacy Education</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+Achievement%22">Academic Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Risk%22">Risk</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Implementation%22">Program Implementation</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22North+Carolina+%28Charlotte%29%22">North Carolina (Charlotte)</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Dynamic+Indicators+of+Basic+Early+Literacy+Skills+%28DIBELS%29%22">Dynamic Indicators of Basic Early Literacy Skills (DIBELS)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The evaluation examined the effectiveness of the Augustine Literacy Project-Charlotte (ALP) tutoring in improving early literacy skills among students in early elementary grades. This tutoring program is based on the Orton-Gillingham approach and utilizes volunteer tutors meeting twice per week for 45 minutes with students from under resourced schools in Charlotte, NC. Specific attention was placed upon assessing effects associated with cumulative technology and data-driven program enhancement efforts to improve training and promote standardization during tutor sessions, which were realized in year three. Administrative datasets were obtained from 19 Charlotte-Mecklenburg elementary schools over three academic years (2021-22, 2022-23, and 2023-24). At baseline, students who received ALP tutoring (treatment group) differed from non-participating peers (untreated group) in both demographic characteristics and initial literacy (i.e., DIBELS) scores. To address these pre-existing differences, propensity score matching (PSM) was employed to create statistically comparable groups for outcome analysis. Overall, students who received ALP tutoring demonstrated greater gains in literacy skills as measured by DIBELS composite scores than their matched peers. Positive effects, though not always statistically significant, were consistently observed among first-grade students across all three years. For second graders, positive treatment effects were evident in two of the three years. Furthermore, during the 2023-2024 academic year when ALP operated with enhanced tutor training, implementation guidelines, and progress monitoring, participation in ALP was associated with enhanced outcomes for students: both first and second graders in the ALP group showed statistically significant literacy gains compared to their matched counterparts, and there were substantial increases in the percentage of students who were performing at or above grade level in reading skills by the end of the academic year.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED679449
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED679449
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 32
    Subjects:
      – SubjectFull: Emergent Literacy
        Type: general
      – SubjectFull: Tutoring
        Type: general
      – SubjectFull: Elementary School Students
        Type: general
      – SubjectFull: Program Effectiveness
        Type: general
      – SubjectFull: Grade 1
        Type: general
      – SubjectFull: Grade 2
        Type: general
      – SubjectFull: Literacy Education
        Type: general
      – SubjectFull: Academic Achievement
        Type: general
      – SubjectFull: Risk
        Type: general
      – SubjectFull: Program Implementation
        Type: general
      – SubjectFull: North Carolina (Charlotte)
        Type: general
      – SubjectFull: Dynamic Indicators of Basic Early Literacy Skills (DIBELS)
        Type: general
    Titles:
      – TitleFull: Program Evaluation for Augustine Literacy Project-Charlotte. CEME Technical Report. CEMETR-2025-02
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: University of North Carolina at Charlotte, Center for Educational Measurement and Evaluation (CEME)
      – PersonEntity:
          Name:
            NameFull: Qiao Liu
      – PersonEntity:
          Name:
            NameFull: Carl D. Westine
      – PersonEntity:
          Name:
            NameFull: Richard Lambert
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2025
          Titles:
            – TitleFull: Center for Educational Measurement and Evaluation
              Type: main
ResultId 1