View in EDS

Comparing Lesson Plan-Driven and Ask-Me-Anything Chatbots: Teaching a UNIX Shell Course

Saved in:
Bibliographic Details
Title: Comparing Lesson Plan-Driven and Ask-Me-Anything Chatbots: Teaching a UNIX Shell Course
Language: English
Authors: Jose Berengueres
Source: Discover Education. 2025 4.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 23
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Descriptors: Lesson Plans, Artificial Intelligence, Technology Uses in Education, Natural Language Processing, Computer Software, Discovery Learning, Scores, Tutors
DOI: 10.1007/s44217-025-00492-9
ISSN: 2731-5525
Abstract: GPT-based models have enabled the creation of natural language chatbots that support both Inquiry-Based and Structured Learning approaches. This study offers a direct comparison of these two paradigms within a UNIX Shell scripting course by means of two chatbots: a Lesson Plan-Driven chatbot that ensures all students cover the same topics systematically, and an Ask-Me-Anything (AMA) chatbot more suited to exploratory learning. We compared two particular chatbots--Harvard's CS50 (as an AMA chatbot) and OS315 (ours), as a lesson plan-driven chatbot--through four surveys. Results show a Net Promoter Score (NPS) of + 45 CI[25, 66] (N = 55) for the least performing lesson plan-driven chatbot and + 35 CI[11, 58.5] (N = 40) for the AMA chatbot. The majority of students favored a blend of human and chatbot instruction. Additionally, we discuss factors such as cost, accessibility, and why the same chatbot architecture, when applied to a Data Visualization course yields a lower NPS of + 9 CI[-6, + 23].
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1469585
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1469585
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Comparing Lesson Plan-Driven and Ask-Me-Anything Chatbots: Teaching a UNIX Shell Course
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Jose+Berengueres%22">Jose Berengueres</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Discover+Education%22"><i>Discover Education</i></searchLink>. 2025 4.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 23
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Lesson+Plans%22">Lesson Plans</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+Language+Processing%22">Natural Language Processing</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software%22">Computer Software</searchLink><br /><searchLink fieldCode="DE" term="%22Discovery+Learning%22">Discovery Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Tutors%22">Tutors</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s44217-025-00492-9
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2731-5525
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: GPT-based models have enabled the creation of natural language chatbots that support both Inquiry-Based and Structured Learning approaches. This study offers a direct comparison of these two paradigms within a UNIX Shell scripting course by means of two chatbots: a Lesson Plan-Driven chatbot that ensures all students cover the same topics systematically, and an Ask-Me-Anything (AMA) chatbot more suited to exploratory learning. We compared two particular chatbots--Harvard's CS50 (as an AMA chatbot) and OS315 (ours), as a lesson plan-driven chatbot--through four surveys. Results show a Net Promoter Score (NPS) of + 45 CI[25, 66] (N = 55) for the least performing lesson plan-driven chatbot and + 35 CI[11, 58.5] (N = 40) for the AMA chatbot. The majority of students favored a blend of human and chatbot instruction. Additionally, we discuss factors such as cost, accessibility, and why the same chatbot architecture, when applied to a Data Visualization course yields a lower NPS of + 9 CI[-6, + 23].
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1469585
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1469585
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s44217-025-00492-9
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 23
    Subjects:
      – SubjectFull: Lesson Plans
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Natural Language Processing
        Type: general
      – SubjectFull: Computer Software
        Type: general
      – SubjectFull: Discovery Learning
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Tutors
        Type: general
    Titles:
      – TitleFull: Comparing Lesson Plan-Driven and Ask-Me-Anything Chatbots: Teaching a UNIX Shell Course
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Jose Berengueres
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2731-5525
          Numbering:
            – Type: volume
              Value: 4
          Titles:
            – TitleFull: Discover Education
              Type: main
ResultId 1