View in EDS

Randomized-Control Efficacy Study of IXL Math in Holland Public Schools

Saved in:
Bibliographic Details
Title: Randomized-Control Efficacy Study of IXL Math in Holland Public Schools
Language: English
Authors: Susan Copeland, Michael A. Cook, Ashley A. Grant, Steven M. Ross, Johns Hopkins University, Center for Research and Reform in Education (CRRE)
Source: Center for Research and Reform in Education. 2023.
Availability: Johns Hopkins Center for Research and Reform in Education, 300 East Joppa Road Suite 500, Baltimore, MD 21286. Tel: 410-616-2338; Fax: 410-324-4444; Web site: https://education.jhu.edu/crre/
Peer Reviewed: N
Page Count: 39
Publication Date: 2023
Document Type: Reports - Research
Tests/Questionnaires
Education Level: Elementary Education
Early Childhood Education
Grade 3
Primary Education
Grade 4
Intermediate Grades
Grade 5
Middle Schools
Descriptors: Elementary School Students, Grade 3, Grade 4, Grade 5, Mathematics Education, Electronic Learning, Learning Management Systems, Academic Achievement, Teacher Attitudes, Learner Engagement, Barriers
Geographic Terms: Michigan
Abstract: The purpose of this study was to examine the efficacy of IXL Math in an elementary school context, using a randomized-control trial (RCT). This study examined mathematics achievement trajectories of 545 Grades 3-5 students across four elementary schools in a small Michigan school district during the 2022-23 school year. Teachers were randomly selected to use IXL Math (treatment condition) or business-as-usual instruction (control condition) for the winter and spring of the 2022-23 school year. Outcome variables included spring 2023 Renaissance Star mathematics scores (progress monitoring) and spring 2023 M-STEP mathematics scores (state test scores). Prior achievement variables included winter 2023 Renaissance Star mathematics scores and spring 2022 M-STEP mathematics scores. Treatment teachers were also administered a survey focusing on teacher experiences with and reactions to the IXL Math program. District-wide, nine of 11 treatment teachers volunteered to complete the survey. Hierarchical linear modeling (HLM) with students nested within teachers was used to complete the main impact analyses, while quantitative survey data were analyzed descriptively, and open-ended items were analyzed qualitatively. The results of the main impact analyses showed a significant positive impact of IXL Math on student mathematics achievement, with treatment students gaining approximately 10-points more on the Renaissance Star mathematics assessment than did control students. The effect size of this impact was 0.13 SDs, indicating a small-to-moderate practical impact of IXL Math on student mathematics achievement. Subgroup analyses showed that IXL Math had additional significant positive impacts on Hispanic, special education, ELL, and free and reduced meal (FARMS) students, with the magnitudes of these impacts ranging from 13-17 points. In addition, teacher perceptions of IXL Math were generally very positive, especially in relation to professional development and overall program perceptions. In all, the results of this study provide evidence supporting efficacy of IXL Math in improving student mathematics achievement, especially for student subgroups that historically had started at lower performance levels.
Abstractor: As Provided
Entry Date: 2024
Accession Number: ED641940
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED641940
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED641940
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Randomized-Control Efficacy Study of IXL Math in Holland Public Schools
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Susan+Copeland%22">Susan Copeland</searchLink><br /><searchLink fieldCode="AR" term="%22Michael+A%2E+Cook%22">Michael A. Cook</searchLink><br /><searchLink fieldCode="AR" term="%22Ashley+A%2E+Grant%22">Ashley A. Grant</searchLink><br /><searchLink fieldCode="AR" term="%22Steven+M%2E+Ross%22">Steven M. Ross</searchLink><br /><searchLink fieldCode="AR" term="%22Johns+Hopkins+University%2C+Center+for+Research+and+Reform+in+Education+%28CRRE%29%22">Johns Hopkins University, Center for Research and Reform in Education (CRRE)</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Center+for+Research+and+Reform+in+Education%22"><i>Center for Research and Reform in Education</i></searchLink>. 2023.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Johns Hopkins Center for Research and Reform in Education, 300 East Joppa Road Suite 500, Baltimore, MD 21286. Tel: 410-616-2338; Fax: 410-324-4444; Web site: https://education.jhu.edu/crre/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 39
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research<br />Tests/Questionnaires
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+3%22">Grade 3</searchLink><br /><searchLink fieldCode="EL" term="%22Primary+Education%22">Primary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+4%22">Grade 4</searchLink><br /><searchLink fieldCode="EL" term="%22Intermediate+Grades%22">Intermediate Grades</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+5%22">Grade 5</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+3%22">Grade 3</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+4%22">Grade 4</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+5%22">Grade 5</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Education%22">Mathematics Education</searchLink><br /><searchLink fieldCode="DE" term="%22Electronic+Learning%22">Electronic Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Management+Systems%22">Learning Management Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+Achievement%22">Academic Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Attitudes%22">Teacher Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Learner+Engagement%22">Learner Engagement</searchLink><br /><searchLink fieldCode="DE" term="%22Barriers%22">Barriers</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Michigan%22">Michigan</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The purpose of this study was to examine the efficacy of IXL Math in an elementary school context, using a randomized-control trial (RCT). This study examined mathematics achievement trajectories of 545 Grades 3-5 students across four elementary schools in a small Michigan school district during the 2022-23 school year. Teachers were randomly selected to use IXL Math (treatment condition) or business-as-usual instruction (control condition) for the winter and spring of the 2022-23 school year. Outcome variables included spring 2023 Renaissance Star mathematics scores (progress monitoring) and spring 2023 M-STEP mathematics scores (state test scores). Prior achievement variables included winter 2023 Renaissance Star mathematics scores and spring 2022 M-STEP mathematics scores. Treatment teachers were also administered a survey focusing on teacher experiences with and reactions to the IXL Math program. District-wide, nine of 11 treatment teachers volunteered to complete the survey. Hierarchical linear modeling (HLM) with students nested within teachers was used to complete the main impact analyses, while quantitative survey data were analyzed descriptively, and open-ended items were analyzed qualitatively. The results of the main impact analyses showed a significant positive impact of IXL Math on student mathematics achievement, with treatment students gaining approximately 10-points more on the Renaissance Star mathematics assessment than did control students. The effect size of this impact was 0.13 SDs, indicating a small-to-moderate practical impact of IXL Math on student mathematics achievement. Subgroup analyses showed that IXL Math had additional significant positive impacts on Hispanic, special education, ELL, and free and reduced meal (FARMS) students, with the magnitudes of these impacts ranging from 13-17 points. In addition, teacher perceptions of IXL Math were generally very positive, especially in relation to professional development and overall program perceptions. In all, the results of this study provide evidence supporting efficacy of IXL Math in improving student mathematics achievement, especially for student subgroups that historically had started at lower performance levels.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED641940
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED641940
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 39
    Subjects:
      – SubjectFull: Elementary School Students
        Type: general
      – SubjectFull: Grade 3
        Type: general
      – SubjectFull: Grade 4
        Type: general
      – SubjectFull: Grade 5
        Type: general
      – SubjectFull: Mathematics Education
        Type: general
      – SubjectFull: Electronic Learning
        Type: general
      – SubjectFull: Learning Management Systems
        Type: general
      – SubjectFull: Academic Achievement
        Type: general
      – SubjectFull: Teacher Attitudes
        Type: general
      – SubjectFull: Learner Engagement
        Type: general
      – SubjectFull: Barriers
        Type: general
      – SubjectFull: Michigan
        Type: general
    Titles:
      – TitleFull: Randomized-Control Efficacy Study of IXL Math in Holland Public Schools
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Johns Hopkins University, Center for Research and Reform in Education (CRRE)
      – PersonEntity:
          Name:
            NameFull: Susan Copeland
      – PersonEntity:
          Name:
            NameFull: Michael A. Cook
      – PersonEntity:
          Name:
            NameFull: Ashley A. Grant
      – PersonEntity:
          Name:
            NameFull: Steven M. Ross
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2023
          Titles:
            – TitleFull: Center for Research and Reform in Education
              Type: main
ResultId 1