Improving Comprehension: Intelligent Tutoring System Explaining the Domain Rules When Students Break Them

Saved in:
Bibliographic Details
Title: Improving Comprehension: Intelligent Tutoring System Explaining the Domain Rules When Students Break Them
Authors: Sychev, Oleg (ORCID 0000-0002-7296-2538), Penskoy, Nikita (ORCID 0000-0002-4443-3399), Anikin, Anton (ORCID 0000-0003-0661-4284), Denisov, Mikhail (ORCID 0000-0002-1216-610X), Prokudin, Artem (ORCID 0000-0002-0694-0808)
Source: Education Sciences. 2021 11.
Availability: MDPI AG. Klybeckstrasse 64, 4057 Basel, Switzerland. e-mail: education@mdpi.com; e-mail: indexing@mdpi.com; Web site: https://www.mdpi.com/journal/education
Peer Reviewed: Y
Page Count: 26
Publication Date: 2021
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Intelligent Tutoring Systems, Comprehension, Undergraduate Students, Computer Science Education, Programming, Computer Software Evaluation
ISSN: 2227-7102
Abstract: Intelligent tutoring systems have become increasingly common in assisting students but are often aimed at isolated subject-domain tasks without creating a scaffolding system from lower- to higher-level cognitive skills, with low-level skills often neglected. We designed and developed an intelligent tutoring system, CompPrehension, which aims to improve the comprehension level of Bloom's taxonomy. The system features plug-in-based architecture, easily adding new subject domains and learning strategies. It uses formal models and software reasoners to solve the problems and judge the answers, and generates explanatory feedback about the broken domain rules and follow-up questions to stimulate the students' thinking. We developed two subject domain models: an Expressions domain for teaching the expression order of evaluation, and a Control Flow Statements domain for code-tracing tasks. The chief novelty of our research is that the developed models are capable of automatic problem classification, determining the knowledge required to solve them and so the pedagogical conditions to use the problem without human participation. More than 100 undergraduate first-year Computer Science students took part in evaluating the system. The results in both subject domains show medium but statistically significant learning gains after using the system for a few days; students with worse previous knowledge gained more. In the Control Flow Statements domain, the number of completed questions correlates positively with the post-test grades and learning gains. The students' survey showed a slightly positive perception of the system.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1321294
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1321294
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1321294
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Improving Comprehension: Intelligent Tutoring System Explaining the Domain Rules When Students Break Them
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Sychev%2C+Oleg%22">Sychev, Oleg</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7296-2538">0000-0002-7296-2538</externalLink>)<br /><searchLink fieldCode="AR" term="%22Penskoy%2C+Nikita%22">Penskoy, Nikita</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-4443-3399">0000-0002-4443-3399</externalLink>)<br /><searchLink fieldCode="AR" term="%22Anikin%2C+Anton%22">Anikin, Anton</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-0661-4284">0000-0003-0661-4284</externalLink>)<br /><searchLink fieldCode="AR" term="%22Denisov%2C+Mikhail%22">Denisov, Mikhail</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-1216-610X">0000-0002-1216-610X</externalLink>)<br /><searchLink fieldCode="AR" term="%22Prokudin%2C+Artem%22">Prokudin, Artem</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-0694-0808">0000-0002-0694-0808</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Education+Sciences%22"><i>Education Sciences</i></searchLink>. 2021 11.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: MDPI AG. Klybeckstrasse 64, 4057 Basel, Switzerland. e-mail: education@mdpi.com; e-mail: indexing@mdpi.com; Web site: https://www.mdpi.com/journal/education
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 26
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2021
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Intelligent+Tutoring+Systems%22">Intelligent Tutoring Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Comprehension%22">Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Science+Education%22">Computer Science Education</searchLink><br /><searchLink fieldCode="DE" term="%22Programming%22">Programming</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software+Evaluation%22">Computer Software Evaluation</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2227-7102
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Intelligent tutoring systems have become increasingly common in assisting students but are often aimed at isolated subject-domain tasks without creating a scaffolding system from lower- to higher-level cognitive skills, with low-level skills often neglected. We designed and developed an intelligent tutoring system, CompPrehension, which aims to improve the comprehension level of Bloom's taxonomy. The system features plug-in-based architecture, easily adding new subject domains and learning strategies. It uses formal models and software reasoners to solve the problems and judge the answers, and generates explanatory feedback about the broken domain rules and follow-up questions to stimulate the students' thinking. We developed two subject domain models: an Expressions domain for teaching the expression order of evaluation, and a Control Flow Statements domain for code-tracing tasks. The chief novelty of our research is that the developed models are capable of automatic problem classification, determining the knowledge required to solve them and so the pedagogical conditions to use the problem without human participation. More than 100 undergraduate first-year Computer Science students took part in evaluating the system. The results in both subject domains show medium but statistically significant learning gains after using the system for a few days; students with worse previous knowledge gained more. In the Control Flow Statements domain, the number of completed questions correlates positively with the post-test grades and learning gains. The students' survey showed a slightly positive perception of the system.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1321294
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1321294
RecordInfo BibRecord:
  BibEntity:
    PhysicalDescription:
      Pagination:
        PageCount: 26
    Subjects:
      – SubjectFull: Intelligent Tutoring Systems
        Type: general
      – SubjectFull: Comprehension
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
      – SubjectFull: Computer Science Education
        Type: general
      – SubjectFull: Programming
        Type: general
      – SubjectFull: Computer Software Evaluation
        Type: general
    Titles:
      – TitleFull: Improving Comprehension: Intelligent Tutoring System Explaining the Domain Rules When Students Break Them
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Sychev, Oleg
      – PersonEntity:
          Name:
            NameFull: Penskoy, Nikita
      – PersonEntity:
          Name:
            NameFull: Anikin, Anton
      – PersonEntity:
          Name:
            NameFull: Denisov, Mikhail
      – PersonEntity:
          Name:
            NameFull: Prokudin, Artem
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2021
          Identifiers:
            – Type: issn-electronic
              Value: 2227-7102
          Numbering:
            – Type: volume
              Value: 11
          Titles:
            – TitleFull: Education Sciences
              Type: main
ResultId 1