Improving Comprehension: Intelligent Tutoring System Explaining the Domain Rules When Students Break Them

Saved in:
Bibliographic Details
Title: Improving Comprehension: Intelligent Tutoring System Explaining the Domain Rules When Students Break Them
Authors: Sychev, Oleg (ORCID 0000-0002-7296-2538), Penskoy, Nikita (ORCID 0000-0002-4443-3399), Anikin, Anton (ORCID 0000-0003-0661-4284), Denisov, Mikhail (ORCID 0000-0002-1216-610X), Prokudin, Artem (ORCID 0000-0002-0694-0808)
Source: Education Sciences. 2021 11.
Availability: MDPI AG. Klybeckstrasse 64, 4057 Basel, Switzerland. e-mail: education@mdpi.com; e-mail: indexing@mdpi.com; Web site: https://www.mdpi.com/journal/education
Peer Reviewed: Y
Page Count: 26
Publication Date: 2021
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Intelligent Tutoring Systems, Comprehension, Undergraduate Students, Computer Science Education, Programming, Computer Software Evaluation
ISSN: 2227-7102
Abstract: Intelligent tutoring systems have become increasingly common in assisting students but are often aimed at isolated subject-domain tasks without creating a scaffolding system from lower- to higher-level cognitive skills, with low-level skills often neglected. We designed and developed an intelligent tutoring system, CompPrehension, which aims to improve the comprehension level of Bloom's taxonomy. The system features plug-in-based architecture, easily adding new subject domains and learning strategies. It uses formal models and software reasoners to solve the problems and judge the answers, and generates explanatory feedback about the broken domain rules and follow-up questions to stimulate the students' thinking. We developed two subject domain models: an Expressions domain for teaching the expression order of evaluation, and a Control Flow Statements domain for code-tracing tasks. The chief novelty of our research is that the developed models are capable of automatic problem classification, determining the knowledge required to solve them and so the pedagogical conditions to use the problem without human participation. More than 100 undergraduate first-year Computer Science students took part in evaluating the system. The results in both subject domains show medium but statistically significant learning gains after using the system for a few days; students with worse previous knowledge gained more. In the Control Flow Statements domain, the number of completed questions correlates positively with the post-test grades and learning gains. The students' survey showed a slightly positive perception of the system.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1321294
Database: ERIC
Description
Abstract:Intelligent tutoring systems have become increasingly common in assisting students but are often aimed at isolated subject-domain tasks without creating a scaffolding system from lower- to higher-level cognitive skills, with low-level skills often neglected. We designed and developed an intelligent tutoring system, CompPrehension, which aims to improve the comprehension level of Bloom's taxonomy. The system features plug-in-based architecture, easily adding new subject domains and learning strategies. It uses formal models and software reasoners to solve the problems and judge the answers, and generates explanatory feedback about the broken domain rules and follow-up questions to stimulate the students' thinking. We developed two subject domain models: an Expressions domain for teaching the expression order of evaluation, and a Control Flow Statements domain for code-tracing tasks. The chief novelty of our research is that the developed models are capable of automatic problem classification, determining the knowledge required to solve them and so the pedagogical conditions to use the problem without human participation. More than 100 undergraduate first-year Computer Science students took part in evaluating the system. The results in both subject domains show medium but statistically significant learning gains after using the system for a few days; students with worse previous knowledge gained more. In the Control Flow Statements domain, the number of completed questions correlates positively with the post-test grades and learning gains. The students' survey showed a slightly positive perception of the system.
ISSN:2227-7102