Tracing Systematic Errors to Personalize Recommendations in Single Digit Multiplication and Beyond

Saved in:
Bibliographic Details
Title: Tracing Systematic Errors to Personalize Recommendations in Single Digit Multiplication and Beyond
Language: English
Authors: Savi, Alexander O. (ORCID 0000-0002-9271-7476), Deonovic, Benjamin E., Bolsinova, Maria, van der Maas, Han L. J., Maris, Gunter K. J.
Source: Journal of Educational Data Mining. 2021 13(4):1-30.
Availability: International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: https://jedm.educationaldatamining.org/index.php/JEDM
Peer Reviewed: Y
Page Count: 30
Publication Date: 2021
Document Type: Journal Articles
Reports - Research
Descriptors: Learning Processes, Cognitive Processes, Error Patterns, Models, Probability, Multiplication, Learning Analytics, Graphs, Computer Assisted Testing, Mathematics Tests, Arithmetic, Foreign Countries, Data Analysis
Geographic Terms: Netherlands
ISSN: 2157-2100
Abstract: In learning, errors are ubiquitous and inevitable. As these errors may signal otherwise latent cognitive processes, tutors--and students alike--can greatly benefit from the information they provide. In this paper, we introduce and evaluate the Systematic Error Tracing (SET) model that identifies the possible causes of systematically observed errors in domains where items are susceptible to most or all causes and errors can be explained by multiple causes. We apply the model to single-digit multiplication, a domain that is very suitable for the model, is well-studied, and allows us to analyze over 25,000 error responses from 335 learners. The model, derived from the Ising model popular in physics, makes use of a bigraph that links errors to causes. The error responses were taken from Math Garden, a computerized adaptive practice environment for arithmetic that is widely used in the Netherlands. We discuss and evaluate various model configurations with respect to the ranking of recommendations and calibration of probability estimates. The results show that the SET model outranks a majority vote baseline model when more than a single recommendation is considered. Finally, we contrast the SET model to similar approaches and discuss limitations and implications.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1337524
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1337524
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1337524
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Tracing Systematic Errors to Personalize Recommendations in Single Digit Multiplication and Beyond
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Savi%2C+Alexander+O%2E%22">Savi, Alexander O.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-9271-7476">0000-0002-9271-7476</externalLink>)<br /><searchLink fieldCode="AR" term="%22Deonovic%2C+Benjamin+E%2E%22">Deonovic, Benjamin E.</searchLink><br /><searchLink fieldCode="AR" term="%22Bolsinova%2C+Maria%22">Bolsinova, Maria</searchLink><br /><searchLink fieldCode="AR" term="%22van+der+Maas%2C+Han+L%2E+J%2E%22">van der Maas, Han L. J.</searchLink><br /><searchLink fieldCode="AR" term="%22Maris%2C+Gunter+K%2E+J%2E%22">Maris, Gunter K. J.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Educational+Data+Mining%22"><i>Journal of Educational Data Mining</i></searchLink>. 2021 13(4):1-30.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: https://jedm.educationaldatamining.org/index.php/JEDM
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 30
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2021
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Learning+Processes%22">Learning Processes</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Processes%22">Cognitive Processes</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Patterns%22">Error Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Models%22">Models</searchLink><br /><searchLink fieldCode="DE" term="%22Probability%22">Probability</searchLink><br /><searchLink fieldCode="DE" term="%22Multiplication%22">Multiplication</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Analytics%22">Learning Analytics</searchLink><br /><searchLink fieldCode="DE" term="%22Graphs%22">Graphs</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Tests%22">Mathematics Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Arithmetic%22">Arithmetic</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Analysis%22">Data Analysis</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Netherlands%22">Netherlands</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2157-2100
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In learning, errors are ubiquitous and inevitable. As these errors may signal otherwise latent cognitive processes, tutors--and students alike--can greatly benefit from the information they provide. In this paper, we introduce and evaluate the Systematic Error Tracing (SET) model that identifies the possible causes of systematically observed errors in domains where items are susceptible to most or all causes and errors can be explained by multiple causes. We apply the model to single-digit multiplication, a domain that is very suitable for the model, is well-studied, and allows us to analyze over 25,000 error responses from 335 learners. The model, derived from the Ising model popular in physics, makes use of a bigraph that links errors to causes. The error responses were taken from Math Garden, a computerized adaptive practice environment for arithmetic that is widely used in the Netherlands. We discuss and evaluate various model configurations with respect to the ranking of recommendations and calibration of probability estimates. The results show that the SET model outranks a majority vote baseline model when more than a single recommendation is considered. Finally, we contrast the SET model to similar approaches and discuss limitations and implications.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1337524
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1337524
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 30
        StartPage: 1
    Subjects:
      – SubjectFull: Learning Processes
        Type: general
      – SubjectFull: Cognitive Processes
        Type: general
      – SubjectFull: Error Patterns
        Type: general
      – SubjectFull: Models
        Type: general
      – SubjectFull: Probability
        Type: general
      – SubjectFull: Multiplication
        Type: general
      – SubjectFull: Learning Analytics
        Type: general
      – SubjectFull: Graphs
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Mathematics Tests
        Type: general
      – SubjectFull: Arithmetic
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Data Analysis
        Type: general
      – SubjectFull: Netherlands
        Type: general
    Titles:
      – TitleFull: Tracing Systematic Errors to Personalize Recommendations in Single Digit Multiplication and Beyond
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Savi, Alexander O.
      – PersonEntity:
          Name:
            NameFull: Deonovic, Benjamin E.
      – PersonEntity:
          Name:
            NameFull: Bolsinova, Maria
      – PersonEntity:
          Name:
            NameFull: van der Maas, Han L. J.
      – PersonEntity:
          Name:
            NameFull: Maris, Gunter K. J.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2021
          Identifiers:
            – Type: issn-electronic
              Value: 2157-2100
          Numbering:
            – Type: volume
              Value: 13
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Journal of Educational Data Mining
              Type: main
ResultId 1