Automatic Interpretable Personalized Learning

Saved in:
Bibliographic Details
Title: Automatic Interpretable Personalized Learning
Language: English
Authors: Prihar, Ethan, Haim, Aaron, Sales, Adam, Heffernan, Neil
Source: Grantee Submission. 2022.
Peer Reviewed: Y
Page Count: 11
Publication Date: 2022
Sponsoring Agency: National Science Foundation (NSF)
Institute of Education Sciences (ED)
Office of Elementary and Secondary Education (OESE) (ED), Education Innovation and Research (EIR)
Office of Naval Research (ONR) (DOD)
Contract Number: 2118725
2118904
1950683
1917808
1931523
1940236
1917713
1903304
1822830
1759229
1724889
1636782
1535428
R305N210049
R305D210031
R305A170137
R305A170243
R305A180401
R305A120125
U411B190024
N000141812768
R305A170641
Document Type: Speeches/Meeting Papers
Reports - Research
Descriptors: Individualized Instruction, Educational Technology, Technology Uses in Education, Electronic Learning, Instructional Effectiveness, Simulation, Educational Environment, Teaching Methods
DOI: 10.1145/3491140.3528267
Abstract: Personalized learning stems from the idea that students benefit from instructional material tailored to their needs. Many online learning platforms purport to implement some form of personalized learning, often through on-demand tutoring or self-paced instruction, but to our knowledge none have a way to automatically explore for specific opportunities to personalize students' education nor a transparent way to identify the effects of personalization on specific groups of students. In this work we present the Automatic Personalized Learning Service (APLS). The APLS uses multi-armed bandit algorithms to recommend the most effective support to each student that requests assistance when completing their online work, and is currently used by ASSISTments, an online learning platform. The first empirical study of the APLS found that Beta-Bernoulli Thompson Sampling, a popular and effective multi-armed bandit algorithm, was only slightly more capable of selecting helpful support than randomly selecting from the relevant support options. Therefore, we also present Decision Tree Thompson Sampling (DTTS), a novel contextual multi-armed bandit algorithm that integrates the transparency and interpretability of decision trees into Thomson sampling. In simulation, DTTS overcame the challenges of recommending support within an online learning platform and was able to increase students' learning by as much as 10% more than the current algorithm used by the APLS. We demonstrate that DTTS is able to identify qualitative interactions that not only help determine the most effective support for students, but that also generalize well to new students, problems, and support content. The APLS using DTTS is now being deployed at scale within ASSISTments and is a promising tool for all educational learning platforms. [This paper was published in: "Proceedings of the Ninth ACM Conference on Learning @ Scale (L@S '22), June 1-3, 2022, New York City, NY, USA," ACM, 2022.]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2022
Accession Number: ED619825
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED619825
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED619825
AccessLevel: 3
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Automatic Interpretable Personalized Learning
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Prihar%2C+Ethan%22">Prihar, Ethan</searchLink><br /><searchLink fieldCode="AR" term="%22Haim%2C+Aaron%22">Haim, Aaron</searchLink><br /><searchLink fieldCode="AR" term="%22Sales%2C+Adam%22">Sales, Adam</searchLink><br /><searchLink fieldCode="AR" term="%22Heffernan%2C+Neil%22">Heffernan, Neil</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Grantee+Submission%22"><i>Grantee Submission</i></searchLink>. 2022.
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 11
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Science Foundation (NSF)<br />Institute of Education Sciences (ED)<br />Office of Elementary and Secondary Education (OESE) (ED), Education Innovation and Research (EIR)<br />Office of Naval Research (ONR) (DOD)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: 2118725<br />2118904<br />1950683<br />1917808<br />1931523<br />1940236<br />1917713<br />1903304<br />1822830<br />1759229<br />1724889<br />1636782<br />1535428<br />R305N210049<br />R305D210031<br />R305A170137<br />R305A170243<br />R305A180401<br />R305A120125<br />U411B190024<br />N000141812768<br />R305A170641
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Speeches/Meeting Papers<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Individualized+Instruction%22">Individualized Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Technology%22">Educational Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Electronic+Learning%22">Electronic Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Effectiveness%22">Instructional Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Simulation%22">Simulation</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Environment%22">Educational Environment</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1145/3491140.3528267
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Personalized learning stems from the idea that students benefit from instructional material tailored to their needs. Many online learning platforms purport to implement some form of personalized learning, often through on-demand tutoring or self-paced instruction, but to our knowledge none have a way to automatically explore for specific opportunities to personalize students' education nor a transparent way to identify the effects of personalization on specific groups of students. In this work we present the Automatic Personalized Learning Service (APLS). The APLS uses multi-armed bandit algorithms to recommend the most effective support to each student that requests assistance when completing their online work, and is currently used by ASSISTments, an online learning platform. The first empirical study of the APLS found that Beta-Bernoulli Thompson Sampling, a popular and effective multi-armed bandit algorithm, was only slightly more capable of selecting helpful support than randomly selecting from the relevant support options. Therefore, we also present Decision Tree Thompson Sampling (DTTS), a novel contextual multi-armed bandit algorithm that integrates the transparency and interpretability of decision trees into Thomson sampling. In simulation, DTTS overcame the challenges of recommending support within an online learning platform and was able to increase students' learning by as much as 10% more than the current algorithm used by the APLS. We demonstrate that DTTS is able to identify qualitative interactions that not only help determine the most effective support for students, but that also generalize well to new students, problems, and support content. The APLS using DTTS is now being deployed at scale within ASSISTments and is a promising tool for all educational learning platforms. [This paper was published in: "Proceedings of the Ninth ACM Conference on Learning @ Scale (L@S '22), June 1-3, 2022, New York City, NY, USA," ACM, 2022.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED619825
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED619825
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1145/3491140.3528267
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 11
    Subjects:
      – SubjectFull: Individualized Instruction
        Type: general
      – SubjectFull: Educational Technology
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Electronic Learning
        Type: general
      – SubjectFull: Instructional Effectiveness
        Type: general
      – SubjectFull: Simulation
        Type: general
      – SubjectFull: Educational Environment
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
    Titles:
      – TitleFull: Automatic Interpretable Personalized Learning
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Prihar, Ethan
      – PersonEntity:
          Name:
            NameFull: Haim, Aaron
      – PersonEntity:
          Name:
            NameFull: Sales, Adam
      – PersonEntity:
          Name:
            NameFull: Heffernan, Neil
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 2022
          Titles:
            – TitleFull: Grantee Submission
              Type: main
ResultId 1