Running Out of Time: Leveraging Process Data to Identify Students Who May Benefit from Extended Time.
Saved in:
| Title: | Running Out of Time: Leveraging Process Data to Identify Students Who May Benefit from Extended Time. |
|---|---|
| Authors: | Ogut, Burhan1 bogut@air.org, Circi, Ruhan1 rcirci@air.org, Huo, Huade1 hhuo@air.org, Hicks, Juanita1 hhicks@air.org, Yin, Michelle2 michelle.yin@northwestern.edu |
| Source: | International Electronic Journal of Elementary Education. Mar2025, Vol. 17 Issue 2, p253-266. 14p. |
| Subject Terms: | *Limited English-proficient students, *Behavioral assessment, *Eighth grade (Education), *Educational equalization, *Students with disabilities |
| Abstract: | This study explored the effectiveness of extended time (ET) accommodations in the 2017 NAEP Grade 8 Mathematics assessment to enhance educational equity. Analyzing NAEP process data through an XGBoost model, we examined if early interactions with assessment items could predict students' likelihood of requiring ET by identifying those who received a timeout message. The findings revealed that 72% of students with disabilities (SWDs) granted ET did not use it fully, while about 24% of students lacking ET were still actively engaged when timed out, indicating a considerable unmet need for ET. The model demonstrated high accuracy and recall in predicting the necessity for ET based on early test behaviors, with minimal influence from background variables such as eligibility for free lunch, English Language Learner (ELL) status, and disability status. These results underscore the potential of utilizing early assessment behaviors as reliable predictors for ET needs, advocating for the integration of predictive models into digital testing systems. Such an approach could enable real-time analysis and adjustments, thereby promoting a fairer assessment process where all students have the opportunity to fully demonstrate their knowledge. [ABSTRACT FROM AUTHOR] |
| Copyright of International Electronic Journal of Elementary Education is the property of International Electronic Journal of Elementary Education and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 184588943 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Running Out of Time: Leveraging Process Data to Identify Students Who May Benefit from Extended Time. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Ogut%2C+Burhan%22">Ogut, Burhan</searchLink><relatesTo>1</relatesTo><i> bogut@air.org</i><br /><searchLink fieldCode="AR" term="%22Circi%2C+Ruhan%22">Circi, Ruhan</searchLink><relatesTo>1</relatesTo><i> rcirci@air.org</i><br /><searchLink fieldCode="AR" term="%22Huo%2C+Huade%22">Huo, Huade</searchLink><relatesTo>1</relatesTo><i> hhuo@air.org</i><br /><searchLink fieldCode="AR" term="%22Hicks%2C+Juanita%22">Hicks, Juanita</searchLink><relatesTo>1</relatesTo><i> hhicks@air.org</i><br /><searchLink fieldCode="AR" term="%22Yin%2C+Michelle%22">Yin, Michelle</searchLink><relatesTo>2</relatesTo><i> michelle.yin@northwestern.edu</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Electronic+Journal+of+Elementary+Education%22">International Electronic Journal of Elementary Education</searchLink>. Mar2025, Vol. 17 Issue 2, p253-266. 14p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Limited+English-proficient+students%22">Limited English-proficient students</searchLink><br />*<searchLink fieldCode="DE" term="%22Behavioral+assessment%22">Behavioral assessment</searchLink><br />*<searchLink fieldCode="DE" term="%22Eighth+grade+%28Education%29%22">Eighth grade (Education)</searchLink><br />*<searchLink fieldCode="DE" term="%22Educational+equalization%22">Educational equalization</searchLink><br />*<searchLink fieldCode="DE" term="%22Students+with+disabilities%22">Students with disabilities</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: This study explored the effectiveness of extended time (ET) accommodations in the 2017 NAEP Grade 8 Mathematics assessment to enhance educational equity. Analyzing NAEP process data through an XGBoost model, we examined if early interactions with assessment items could predict students' likelihood of requiring ET by identifying those who received a timeout message. The findings revealed that 72% of students with disabilities (SWDs) granted ET did not use it fully, while about 24% of students lacking ET were still actively engaged when timed out, indicating a considerable unmet need for ET. The model demonstrated high accuracy and recall in predicting the necessity for ET based on early test behaviors, with minimal influence from background variables such as eligibility for free lunch, English Language Learner (ELL) status, and disability status. These results underscore the potential of utilizing early assessment behaviors as reliable predictors for ET needs, advocating for the integration of predictive models into digital testing systems. Such an approach could enable real-time analysis and adjustments, thereby promoting a fairer assessment process where all students have the opportunity to fully demonstrate their knowledge. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Electronic Journal of Elementary Education is the property of International Electronic Journal of Elementary Education and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=184588943 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.26822/iejee.2025.376 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 253 Subjects: – SubjectFull: Limited English-proficient students Type: general – SubjectFull: Behavioral assessment Type: general – SubjectFull: Eighth grade (Education) Type: general – SubjectFull: Educational equalization Type: general – SubjectFull: Students with disabilities Type: general Titles: – TitleFull: Running Out of Time: Leveraging Process Data to Identify Students Who May Benefit from Extended Time. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Ogut, Burhan – PersonEntity: Name: NameFull: Circi, Ruhan – PersonEntity: Name: NameFull: Huo, Huade – PersonEntity: Name: NameFull: Hicks, Juanita – PersonEntity: Name: NameFull: Yin, Michelle IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 03 Text: Mar2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 13079298 Numbering: – Type: volume Value: 17 – Type: issue Value: 2 Titles: – TitleFull: International Electronic Journal of Elementary Education Type: main |
| ResultId | 1 |
