View in EDS

How Much Mastery Is Enough Mastery? The Relationship between Mastery in a Lesson and the Performance on the Subsequent Lesson

Saved in:
Bibliographic Details
Title: How Much Mastery Is Enough Mastery? The Relationship between Mastery in a Lesson and the Performance on the Subsequent Lesson
Language: English
Authors: Jiayi Zhang, Kirk Vanacore, Ryan S. Baker, Nabil Ch, Caitlin Mills, Owen Henkel
Source: International Educational Data Mining Society. 2025.
Availability: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Peer Reviewed: Y
Page Count: 7
Publication Date: 2025
Document Type: Speeches/Meeting Papers
Reports - Research
Education Level: Elementary Education
Junior High Schools
Middle Schools
Secondary Education
Descriptors: Elementary School Students, Junior High School Students, Mastery Learning, Teaching Methods, Competence, Bayesian Statistics, Artificial Intelligence, Mathematics Skills, Educational Technology, Electronic Learning, Skill Development
Abstract: Mastery learning -- requiring students to achieve proficiency in a topic before advancing -- is a well-established and effective teaching method. Digital learning systems support this approach by personalizing content sequences, enabling students to focus on practicing topics they have not yet mastered. To achieve this, digital learning systems use knowledge tracing models, such as Bayesian Knowledge Tracing (BKT), to estimate students' knowledge. The estimation is often converted into a binary indicator reflecting whether mastery has been achieved based on a predefined threshold (e.g. 0.95). Determining optimal thresholds is critical. While prior studies have identified thresholds to prevent over-practice on the same skill, it is equally important to examine how a student's degree of mastery predicts future learning on other skills, where prior mastery may facilitate acquiring new skills. The current study explores this relationship using data from Rori, an online tutoring system for foundational math skills. Using BKT, we categorized students' knowledge estimates at the end of each lesson (lesson N) into eight mastery levels and analyzed how the current mastery level is associated with students' future learning, measured by their performance, early and final knowledge estimates, and learning in the subsequent lesson (lesson N+1). Results indicate that while the widely adopted threshold of 0.95 remains relevant, higher thresholds, such as 0.98, yield additional benefits, including improved performance and learning in subsequent lessons. These findings provide empirical insights for designing adaptive learning technologies that enhance personalization, efficiency, and support for future learning. [For the complete proceedings, see ED675583.]
Abstractor: As Provided
Entry Date: 2025
Accession Number: ED675652
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED675652
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED675652
AccessLevel: 3
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: How Much Mastery Is Enough Mastery? The Relationship between Mastery in a Lesson and the Performance on the Subsequent Lesson
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Jiayi+Zhang%22">Jiayi Zhang</searchLink><br /><searchLink fieldCode="AR" term="%22Kirk+Vanacore%22">Kirk Vanacore</searchLink><br /><searchLink fieldCode="AR" term="%22Ryan+S%2E+Baker%22">Ryan S. Baker</searchLink><br /><searchLink fieldCode="AR" term="%22Nabil+Ch%22">Nabil Ch</searchLink><br /><searchLink fieldCode="AR" term="%22Caitlin+Mills%22">Caitlin Mills</searchLink><br /><searchLink fieldCode="AR" term="%22Owen+Henkel%22">Owen Henkel</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Educational+Data+Mining+Society%22"><i>International Educational Data Mining Society</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 7
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Speeches/Meeting Papers<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Junior+High+Schools%22">Junior High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Junior+High+School+Students%22">Junior High School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Mastery+Learning%22">Mastery Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Competence%22">Competence</searchLink><br /><searchLink fieldCode="DE" term="%22Bayesian+Statistics%22">Bayesian Statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Skills%22">Mathematics Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Technology%22">Educational Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Electronic+Learning%22">Electronic Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Skill+Development%22">Skill Development</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Mastery learning -- requiring students to achieve proficiency in a topic before advancing -- is a well-established and effective teaching method. Digital learning systems support this approach by personalizing content sequences, enabling students to focus on practicing topics they have not yet mastered. To achieve this, digital learning systems use knowledge tracing models, such as Bayesian Knowledge Tracing (BKT), to estimate students' knowledge. The estimation is often converted into a binary indicator reflecting whether mastery has been achieved based on a predefined threshold (e.g. 0.95). Determining optimal thresholds is critical. While prior studies have identified thresholds to prevent over-practice on the same skill, it is equally important to examine how a student's degree of mastery predicts future learning on other skills, where prior mastery may facilitate acquiring new skills. The current study explores this relationship using data from Rori, an online tutoring system for foundational math skills. Using BKT, we categorized students' knowledge estimates at the end of each lesson (lesson N) into eight mastery levels and analyzed how the current mastery level is associated with students' future learning, measured by their performance, early and final knowledge estimates, and learning in the subsequent lesson (lesson N+1). Results indicate that while the widely adopted threshold of 0.95 remains relevant, higher thresholds, such as 0.98, yield additional benefits, including improved performance and learning in subsequent lessons. These findings provide empirical insights for designing adaptive learning technologies that enhance personalization, efficiency, and support for future learning. [For the complete proceedings, see ED675583.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED675652
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED675652
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 7
    Subjects:
      – SubjectFull: Elementary School Students
        Type: general
      – SubjectFull: Junior High School Students
        Type: general
      – SubjectFull: Mastery Learning
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Competence
        Type: general
      – SubjectFull: Bayesian Statistics
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Mathematics Skills
        Type: general
      – SubjectFull: Educational Technology
        Type: general
      – SubjectFull: Electronic Learning
        Type: general
      – SubjectFull: Skill Development
        Type: general
    Titles:
      – TitleFull: How Much Mastery Is Enough Mastery? The Relationship between Mastery in a Lesson and the Performance on the Subsequent Lesson
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Jiayi Zhang
      – PersonEntity:
          Name:
            NameFull: Kirk Vanacore
      – PersonEntity:
          Name:
            NameFull: Ryan S. Baker
      – PersonEntity:
          Name:
            NameFull: Nabil Ch
      – PersonEntity:
          Name:
            NameFull: Caitlin Mills
      – PersonEntity:
          Name:
            NameFull: Owen Henkel
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Titles:
            – TitleFull: International Educational Data Mining Society
              Type: main
ResultId 1