Student Usage Predicts Treatment Effect Heterogeneity in the Cognitive Tutor Algebra I Program
Saved in:
| Title: | Student Usage Predicts Treatment Effect Heterogeneity in the Cognitive Tutor Algebra I Program |
|---|---|
| Language: | English |
| Authors: | Sales, Adam C., Wilks, Asa, Pane, John F. |
| Source: | International Educational Data Mining Society. 2016. |
| Availability: | International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: http://www.educationaldatamining.org |
| Peer Reviewed: | Y |
| Page Count: | 8 |
| Publication Date: | 2016 |
| Sponsoring Agency: | National Science Foundation (NSF) Institute of Education Sciences (ED) |
| Contract Number: | DRL1420374 R305B100012 |
| Document Type: | Speeches/Meeting Papers Reports - Research |
| Education Level: | High Schools Secondary Education Middle Schools Junior High Schools |
| Descriptors: | Algebra, Mathematics Instruction, Educational Technology, Technology Uses in Education, Intelligent Tutoring Systems, High School Students, Secondary School Mathematics, Program Effectiveness, Middle School Students |
| Abstract: | The Cognitive Tutor Algebra I (CTAI) curriculum, which includes both textbook and online components, has been shown to boost student learning by about 0.2 standard deviations in a randomized effectiveness trial. Students who were assigned to the experimental condition varied substantially in how, and how much, the used the online component of CTAI, but original analyses of the experimental data focused on estimating average effects, and did not examine whether the CTAI treatment effect varied by the amount of style of usage. This study leverages log data from the experiment to present a more nuanced analysis. It uses the framework of Principal Stratification, which estimates the varying CTAI treatment effect as a function of "potential" usage--either how students used the program, or how they would have used it had they been assigned to the treatment condition. With experimental data, Principal Stratification does not require that we assume that all relevant variables have been measured. With this framework, we find that students who receive a medium amount of assistance from the software (in the form of hints and error feedback) experience the largest effects, with lower effects for students who receive a lot or a little; and evidence that students who do not follow the curriculum order experience smaller treatment effects. [For the full proceedings, see ED592609.] |
| Abstractor: | As Provided |
| IES Funded: | Yes |
| Entry Date: | 2019 |
| Accession Number: | ED592734 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED592734 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: ED592734 AccessLevel: 3 PubType: Conference PubTypeId: conference PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Student Usage Predicts Treatment Effect Heterogeneity in the Cognitive Tutor Algebra I Program – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Sales%2C+Adam+C%2E%22">Sales, Adam C.</searchLink><br /><searchLink fieldCode="AR" term="%22Wilks%2C+Asa%22">Wilks, Asa</searchLink><br /><searchLink fieldCode="AR" term="%22Pane%2C+John+F%2E%22">Pane, John F.</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22International+Educational+Data+Mining+Society%22"><i>International Educational Data Mining Society</i></searchLink>. 2016. – Name: Avail Label: Availability Group: Avail Data: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: http://www.educationaldatamining.org – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 8 – Name: DatePubCY Label: Publication Date Group: Date Data: 2016 – Name: SourceSuprt Label: Sponsoring Agency Group: SrcSuprt Data: National Science Foundation (NSF)<br />Institute of Education Sciences (ED) – Name: NumberContract Label: Contract Number Group: NumCntrct Data: DRL1420374<br />R305B100012 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Speeches/Meeting Papers<br />Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Junior+High+Schools%22">Junior High Schools</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Algebra%22">Algebra</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Instruction%22">Mathematics Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Technology%22">Educational Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Intelligent+Tutoring+Systems%22">Intelligent Tutoring Systems</searchLink><br /><searchLink fieldCode="DE" term="%22High+School+Students%22">High School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Mathematics%22">Secondary School Mathematics</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Effectiveness%22">Program Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Middle+School+Students%22">Middle School Students</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The Cognitive Tutor Algebra I (CTAI) curriculum, which includes both textbook and online components, has been shown to boost student learning by about 0.2 standard deviations in a randomized effectiveness trial. Students who were assigned to the experimental condition varied substantially in how, and how much, the used the online component of CTAI, but original analyses of the experimental data focused on estimating average effects, and did not examine whether the CTAI treatment effect varied by the amount of style of usage. This study leverages log data from the experiment to present a more nuanced analysis. It uses the framework of Principal Stratification, which estimates the varying CTAI treatment effect as a function of "potential" usage--either how students used the program, or how they would have used it had they been assigned to the treatment condition. With experimental data, Principal Stratification does not require that we assume that all relevant variables have been measured. With this framework, we find that students who receive a medium amount of assistance from the software (in the form of hints and error feedback) experience the largest effects, with lower effects for students who receive a lot or a little; and evidence that students who do not follow the curriculum order experience smaller treatment effects. [For the full proceedings, see ED592609.] – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: CodeSource Label: IES Funded Group: SrcInfo Data: Yes – Name: DateEntry Label: Entry Date Group: Date Data: 2019 – Name: AN Label: Accession Number Group: ID Data: ED592734 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED592734 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 8 Subjects: – SubjectFull: Algebra Type: general – SubjectFull: Mathematics Instruction Type: general – SubjectFull: Educational Technology Type: general – SubjectFull: Technology Uses in Education Type: general – SubjectFull: Intelligent Tutoring Systems Type: general – SubjectFull: High School Students Type: general – SubjectFull: Secondary School Mathematics Type: general – SubjectFull: Program Effectiveness Type: general – SubjectFull: Middle School Students Type: general Titles: – TitleFull: Student Usage Predicts Treatment Effect Heterogeneity in the Cognitive Tutor Algebra I Program Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Sales, Adam C. – PersonEntity: Name: NameFull: Wilks, Asa – PersonEntity: Name: NameFull: Pane, John F. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2016 Titles: – TitleFull: International Educational Data Mining Society Type: main |
| ResultId | 1 |
