Automated Identification of Logical Errors in Programs: Advancing Scalable Analysis of Student Misconceptions

Saved in:
Bibliographic Details
Title: Automated Identification of Logical Errors in Programs: Advancing Scalable Analysis of Student Misconceptions
Language: English
Authors: Muntasir Hoq, Ananya Rao, Reisha Jaishankar, Krish Piryani, Nithya Janapati, Jessica Vandenberg, Bradford Mott, Narges Norouzi, James Lester, Bita Akram
Source: International Educational Data Mining Society. 2025.
Availability: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Peer Reviewed: Y
Page Count: 14
Publication Date: 2025
Sponsoring Agency: National Science Foundation (NSF), Division of Undergraduate Education (DUE)
Contract Number: 2236195
2331965
Document Type: Speeches/Meeting Papers
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Computer Science Education, Programming, Misconceptions, Error Patterns, Coding, College Students, Grades (Scholastic), Prediction
Abstract: In Computer Science (CS) education, understanding factors contributing to students' programming difficulties is crucial for effective learning support. By identifying specific issues students face, educators can provide targeted assistance to help them overcome obstacles and improve learning outcomes. While identifying sources of struggle, such as misconceptions, in real-time can be challenging in current educational practices, analyzing logical errors in students' code can offer valuable insights. This paper presents a scalable framework for automatically detecting logical errors in students' programming solutions. Our framework is based on an explainable Abstract Syntax Tree (AST) embedding model, the Subtree-based Attention Neural Network (SANN), that identifies the structural components of programs containing logical errors. We conducted a series of experiments to evaluate its effectiveness, and the results suggest that our framework can accurately capture students' logical errors and, more importantly, provide us with deeper insights into their learning processes, offering a valuable tool for enhancing programming education. [For the complete proceedings, see ED675583.]
Abstractor: As Provided
Entry Date: 2025
Accession Number: ED675600
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED675600
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED675600
AccessLevel: 3
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Automated Identification of Logical Errors in Programs: Advancing Scalable Analysis of Student Misconceptions
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Muntasir+Hoq%22">Muntasir Hoq</searchLink><br /><searchLink fieldCode="AR" term="%22Ananya+Rao%22">Ananya Rao</searchLink><br /><searchLink fieldCode="AR" term="%22Reisha+Jaishankar%22">Reisha Jaishankar</searchLink><br /><searchLink fieldCode="AR" term="%22Krish+Piryani%22">Krish Piryani</searchLink><br /><searchLink fieldCode="AR" term="%22Nithya+Janapati%22">Nithya Janapati</searchLink><br /><searchLink fieldCode="AR" term="%22Jessica+Vandenberg%22">Jessica Vandenberg</searchLink><br /><searchLink fieldCode="AR" term="%22Bradford+Mott%22">Bradford Mott</searchLink><br /><searchLink fieldCode="AR" term="%22Narges+Norouzi%22">Narges Norouzi</searchLink><br /><searchLink fieldCode="AR" term="%22James+Lester%22">James Lester</searchLink><br /><searchLink fieldCode="AR" term="%22Bita+Akram%22">Bita Akram</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Educational+Data+Mining+Society%22"><i>International Educational Data Mining Society</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 14
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Science Foundation (NSF), Division of Undergraduate Education (DUE)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: 2236195<br />2331965
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Speeches/Meeting Papers<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Science+Education%22">Computer Science Education</searchLink><br /><searchLink fieldCode="DE" term="%22Programming%22">Programming</searchLink><br /><searchLink fieldCode="DE" term="%22Misconceptions%22">Misconceptions</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Patterns%22">Error Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Coding%22">Coding</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Grades+%28Scholastic%29%22">Grades (Scholastic)</searchLink><br /><searchLink fieldCode="DE" term="%22Prediction%22">Prediction</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In Computer Science (CS) education, understanding factors contributing to students' programming difficulties is crucial for effective learning support. By identifying specific issues students face, educators can provide targeted assistance to help them overcome obstacles and improve learning outcomes. While identifying sources of struggle, such as misconceptions, in real-time can be challenging in current educational practices, analyzing logical errors in students' code can offer valuable insights. This paper presents a scalable framework for automatically detecting logical errors in students' programming solutions. Our framework is based on an explainable Abstract Syntax Tree (AST) embedding model, the Subtree-based Attention Neural Network (SANN), that identifies the structural components of programs containing logical errors. We conducted a series of experiments to evaluate its effectiveness, and the results suggest that our framework can accurately capture students' logical errors and, more importantly, provide us with deeper insights into their learning processes, offering a valuable tool for enhancing programming education. [For the complete proceedings, see ED675583.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED675600
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED675600
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
    Subjects:
      – SubjectFull: Computer Science Education
        Type: general
      – SubjectFull: Programming
        Type: general
      – SubjectFull: Misconceptions
        Type: general
      – SubjectFull: Error Patterns
        Type: general
      – SubjectFull: Coding
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Grades (Scholastic)
        Type: general
      – SubjectFull: Prediction
        Type: general
    Titles:
      – TitleFull: Automated Identification of Logical Errors in Programs: Advancing Scalable Analysis of Student Misconceptions
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Muntasir Hoq
      – PersonEntity:
          Name:
            NameFull: Ananya Rao
      – PersonEntity:
          Name:
            NameFull: Reisha Jaishankar
      – PersonEntity:
          Name:
            NameFull: Krish Piryani
      – PersonEntity:
          Name:
            NameFull: Nithya Janapati
      – PersonEntity:
          Name:
            NameFull: Jessica Vandenberg
      – PersonEntity:
          Name:
            NameFull: Bradford Mott
      – PersonEntity:
          Name:
            NameFull: Narges Norouzi
      – PersonEntity:
          Name:
            NameFull: James Lester
      – PersonEntity:
          Name:
            NameFull: Bita Akram
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Titles:
            – TitleFull: International Educational Data Mining Society
              Type: main
ResultId 1