View in EDS

LOOL: Towards Personalization with Flexible & Robust Estimation of Heterogeneous Treatment Effects

Saved in:
Bibliographic Details
Title: LOOL: Towards Personalization with Flexible & Robust Estimation of Heterogeneous Treatment Effects
Language: English
Authors: Duy M. Pham, Kirk P. Vanacore, Adam C. Sales, Johann A. Gagnon-Bartsch
Source: International Educational Data Mining Society. 2024.
Availability: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Peer Reviewed: Y
Page Count: 9
Publication Date: 2024
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305D210031
Document Type: Speeches/Meeting Papers
Reports - Research
Education Level: Junior High Schools
Middle Schools
Secondary Education
Descriptors: Middle School Students, Middle School Teachers, Middle School Mathematics, Algebra, Mathematics Instruction, Individualized Instruction, Educational Technology, Student Characteristics, Prior Learning, English (Second Language), Computer Assisted Instruction
Abstract: Effective personalization of education requires knowing how each student will perform under certain conditions, given their specific characteristics. Thus, the demand for interpretable and precise estimation of heterogeneous treatment effects is ever-present. This paper outlines a new approach to this problem based on the Leave-One-Out Potential Outcomes (LOOP) Estimator, which unbiasedly estimates individual treatment effects (ITE) from experiments. By regressing these estimates on a set of moderators, we obtain parameterized and easily interpretable estimates of conditional average treatment effects (CATE) that allow us to understand which individuals will likely benefit from each condition. We implement this approach with real-world data from an efficacy study that included four experimental conditions for instructing middle-school algebra. Our models indicate that treatment effect heterogeneity is significantly associated with students' prior subject knowledge and whether English is their native language. We then discuss possibilities for applications to enhance personalized assignments. [For the complete proceedings, see ED675485.]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2025
Accession Number: ED675644
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED675644
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED675644
AccessLevel: 3
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: LOOL: Towards Personalization with Flexible & Robust Estimation of Heterogeneous Treatment Effects
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Duy+M%2E+Pham%22">Duy M. Pham</searchLink><br /><searchLink fieldCode="AR" term="%22Kirk+P%2E+Vanacore%22">Kirk P. Vanacore</searchLink><br /><searchLink fieldCode="AR" term="%22Adam+C%2E+Sales%22">Adam C. Sales</searchLink><br /><searchLink fieldCode="AR" term="%22Johann+A%2E+Gagnon-Bartsch%22">Johann A. Gagnon-Bartsch</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Educational+Data+Mining+Society%22"><i>International Educational Data Mining Society</i></searchLink>. 2024.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 9
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R305D210031
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Speeches/Meeting Papers<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Junior+High+Schools%22">Junior High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Middle+School+Students%22">Middle School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Middle+School+Teachers%22">Middle School Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Middle+School+Mathematics%22">Middle School Mathematics</searchLink><br /><searchLink fieldCode="DE" term="%22Algebra%22">Algebra</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Instruction%22">Mathematics Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Individualized+Instruction%22">Individualized Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Technology%22">Educational Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Characteristics%22">Student Characteristics</searchLink><br /><searchLink fieldCode="DE" term="%22Prior+Learning%22">Prior Learning</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Instruction%22">Computer Assisted Instruction</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Effective personalization of education requires knowing how each student will perform under certain conditions, given their specific characteristics. Thus, the demand for interpretable and precise estimation of heterogeneous treatment effects is ever-present. This paper outlines a new approach to this problem based on the Leave-One-Out Potential Outcomes (LOOP) Estimator, which unbiasedly estimates individual treatment effects (ITE) from experiments. By regressing these estimates on a set of moderators, we obtain parameterized and easily interpretable estimates of conditional average treatment effects (CATE) that allow us to understand which individuals will likely benefit from each condition. We implement this approach with real-world data from an efficacy study that included four experimental conditions for instructing middle-school algebra. Our models indicate that treatment effect heterogeneity is significantly associated with students' prior subject knowledge and whether English is their native language. We then discuss possibilities for applications to enhance personalized assignments. [For the complete proceedings, see ED675485.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED675644
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED675644
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 9
    Subjects:
      – SubjectFull: Middle School Students
        Type: general
      – SubjectFull: Middle School Teachers
        Type: general
      – SubjectFull: Middle School Mathematics
        Type: general
      – SubjectFull: Algebra
        Type: general
      – SubjectFull: Mathematics Instruction
        Type: general
      – SubjectFull: Individualized Instruction
        Type: general
      – SubjectFull: Educational Technology
        Type: general
      – SubjectFull: Student Characteristics
        Type: general
      – SubjectFull: Prior Learning
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Computer Assisted Instruction
        Type: general
    Titles:
      – TitleFull: LOOL: Towards Personalization with Flexible & Robust Estimation of Heterogeneous Treatment Effects
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Duy M. Pham
      – PersonEntity:
          Name:
            NameFull: Kirk P. Vanacore
      – PersonEntity:
          Name:
            NameFull: Adam C. Sales
      – PersonEntity:
          Name:
            NameFull: Johann A. Gagnon-Bartsch
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Titles:
            – TitleFull: International Educational Data Mining Society
              Type: main
ResultId 1