View in EDS

Fairness of Bayesian Knowledge Tracing for Math Learners of Different Reading Ability

Saved in:
Bibliographic Details
Title: Fairness of Bayesian Knowledge Tracing for Math Learners of Different Reading Ability
Language: English
Authors: Frank Stinar, HaeJin Lee, Clara Belitz, Nidhi Nasiar, Stephen E. Fancsali, Steve Ritter, Husni Almoubayy, Ryan S. Baker, Jaclyn Ocumpaugh, Nigel Bosch
Source: International Educational Data Mining Society. 2025.
Availability: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Peer Reviewed: Y
Page Count: 12
Publication Date: 2025
Sponsoring Agency: National Science Foundation (NSF)
Contract Number: 2000638
Document Type: Speeches/Meeting Papers
Reports - Research
Descriptors: Mathematics Education, Bayesian Statistics, Reading Ability, Information Management, Technology Uses in Education, Individualized Instruction, Reading Achievement, Bias, Reading Comprehension, Transfer of Training
Abstract: Students' reading ability affects their outcomes in learning software even outside of reading education, such as in math education, which can result in unexpected and inequitable outcomes. We analyze an adaptive learning software using Bayesian Knowledge Tracing (BKT) to understand how the fairness of the software is impacted when reading ability is not modeled. We tested BKT model fairness by comparing two years of data from 8,549 students who were classified as either 'emerging' or 'non-emerging' readers (i.e., a measure of reading ability). We found that while BKT was unbiased on average in terms of equal predictive accuracy across groups, specific skills within the adaptive learning software exhibited bias related to reading level. Additionally, there were differences between the first-answer mastery rates of the emerging and non-emerging readers (M=0.687 and M=0.776, difference CI=[0.075, 0.095]), indicating that emerging reader status is predictive of mastery. Our findings demonstrate significant group differences in BKT models regarding reading ability, exhibiting that it is important to consider--and perhaps even model--reading as a separate skill that differentially influences students' outcomes. [For the complete proceedings, see ED675583.]
Abstractor: As Provided
Entry Date: 2025
Accession Number: ED675619
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED675619
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED675619
AccessLevel: 3
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Fairness of Bayesian Knowledge Tracing for Math Learners of Different Reading Ability
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Frank+Stinar%22">Frank Stinar</searchLink><br /><searchLink fieldCode="AR" term="%22HaeJin+Lee%22">HaeJin Lee</searchLink><br /><searchLink fieldCode="AR" term="%22Clara+Belitz%22">Clara Belitz</searchLink><br /><searchLink fieldCode="AR" term="%22Nidhi+Nasiar%22">Nidhi Nasiar</searchLink><br /><searchLink fieldCode="AR" term="%22Stephen+E%2E+Fancsali%22">Stephen E. Fancsali</searchLink><br /><searchLink fieldCode="AR" term="%22Steve+Ritter%22">Steve Ritter</searchLink><br /><searchLink fieldCode="AR" term="%22Husni+Almoubayy%22">Husni Almoubayy</searchLink><br /><searchLink fieldCode="AR" term="%22Ryan+S%2E+Baker%22">Ryan S. Baker</searchLink><br /><searchLink fieldCode="AR" term="%22Jaclyn+Ocumpaugh%22">Jaclyn Ocumpaugh</searchLink><br /><searchLink fieldCode="AR" term="%22Nigel+Bosch%22">Nigel Bosch</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Educational+Data+Mining+Society%22"><i>International Educational Data Mining Society</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 12
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Science Foundation (NSF)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: 2000638
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Speeches/Meeting Papers<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Mathematics+Education%22">Mathematics Education</searchLink><br /><searchLink fieldCode="DE" term="%22Bayesian+Statistics%22">Bayesian Statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Ability%22">Reading Ability</searchLink><br /><searchLink fieldCode="DE" term="%22Information+Management%22">Information Management</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Individualized+Instruction%22">Individualized Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Achievement%22">Reading Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Bias%22">Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Comprehension%22">Reading Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Transfer+of+Training%22">Transfer of Training</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Students' reading ability affects their outcomes in learning software even outside of reading education, such as in math education, which can result in unexpected and inequitable outcomes. We analyze an adaptive learning software using Bayesian Knowledge Tracing (BKT) to understand how the fairness of the software is impacted when reading ability is not modeled. We tested BKT model fairness by comparing two years of data from 8,549 students who were classified as either 'emerging' or 'non-emerging' readers (i.e., a measure of reading ability). We found that while BKT was unbiased on average in terms of equal predictive accuracy across groups, specific skills within the adaptive learning software exhibited bias related to reading level. Additionally, there were differences between the first-answer mastery rates of the emerging and non-emerging readers (M=0.687 and M=0.776, difference CI=[0.075, 0.095]), indicating that emerging reader status is predictive of mastery. Our findings demonstrate significant group differences in BKT models regarding reading ability, exhibiting that it is important to consider--and perhaps even model--reading as a separate skill that differentially influences students' outcomes. [For the complete proceedings, see ED675583.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED675619
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED675619
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 12
    Subjects:
      – SubjectFull: Mathematics Education
        Type: general
      – SubjectFull: Bayesian Statistics
        Type: general
      – SubjectFull: Reading Ability
        Type: general
      – SubjectFull: Information Management
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Individualized Instruction
        Type: general
      – SubjectFull: Reading Achievement
        Type: general
      – SubjectFull: Bias
        Type: general
      – SubjectFull: Reading Comprehension
        Type: general
      – SubjectFull: Transfer of Training
        Type: general
    Titles:
      – TitleFull: Fairness of Bayesian Knowledge Tracing for Math Learners of Different Reading Ability
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Frank Stinar
      – PersonEntity:
          Name:
            NameFull: HaeJin Lee
      – PersonEntity:
          Name:
            NameFull: Clara Belitz
      – PersonEntity:
          Name:
            NameFull: Nidhi Nasiar
      – PersonEntity:
          Name:
            NameFull: Stephen E. Fancsali
      – PersonEntity:
          Name:
            NameFull: Steve Ritter
      – PersonEntity:
          Name:
            NameFull: Husni Almoubayy
      – PersonEntity:
          Name:
            NameFull: Ryan S. Baker
      – PersonEntity:
          Name:
            NameFull: Jaclyn Ocumpaugh
      – PersonEntity:
          Name:
            NameFull: Nigel Bosch
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Titles:
            – TitleFull: International Educational Data Mining Society
              Type: main
ResultId 1