Comparing Lesson Plan-Driven and Ask-Me-Anything Chatbots: Teaching a UNIX Shell Course
Saved in:
| Title: | Comparing Lesson Plan-Driven and Ask-Me-Anything Chatbots: Teaching a UNIX Shell Course |
|---|---|
| Language: | English |
| Authors: | Jose Berengueres |
| Source: | Discover Education. 2025 4. |
| Availability: | Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/ |
| Peer Reviewed: | Y |
| Page Count: | 23 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Lesson Plans, Artificial Intelligence, Technology Uses in Education, Natural Language Processing, Computer Software, Discovery Learning, Scores, Tutors |
| DOI: | 10.1007/s44217-025-00492-9 |
| ISSN: | 2731-5525 |
| Abstract: | GPT-based models have enabled the creation of natural language chatbots that support both Inquiry-Based and Structured Learning approaches. This study offers a direct comparison of these two paradigms within a UNIX Shell scripting course by means of two chatbots: a Lesson Plan-Driven chatbot that ensures all students cover the same topics systematically, and an Ask-Me-Anything (AMA) chatbot more suited to exploratory learning. We compared two particular chatbots--Harvard's CS50 (as an AMA chatbot) and OS315 (ours), as a lesson plan-driven chatbot--through four surveys. Results show a Net Promoter Score (NPS) of + 45 CI[25, 66] (N = 55) for the least performing lesson plan-driven chatbot and + 35 CI[11, 58.5] (N = 40) for the AMA chatbot. The majority of students favored a blend of human and chatbot instruction. Additionally, we discuss factors such as cost, accessibility, and why the same chatbot architecture, when applied to a Data Visualization course yields a lower NPS of + 9 CI[-6, + 23]. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1469585 |
| Database: | ERIC |
| Abstract: | GPT-based models have enabled the creation of natural language chatbots that support both Inquiry-Based and Structured Learning approaches. This study offers a direct comparison of these two paradigms within a UNIX Shell scripting course by means of two chatbots: a Lesson Plan-Driven chatbot that ensures all students cover the same topics systematically, and an Ask-Me-Anything (AMA) chatbot more suited to exploratory learning. We compared two particular chatbots--Harvard's CS50 (as an AMA chatbot) and OS315 (ours), as a lesson plan-driven chatbot--through four surveys. Results show a Net Promoter Score (NPS) of + 45 CI[25, 66] (N = 55) for the least performing lesson plan-driven chatbot and + 35 CI[11, 58.5] (N = 40) for the AMA chatbot. The majority of students favored a blend of human and chatbot instruction. Additionally, we discuss factors such as cost, accessibility, and why the same chatbot architecture, when applied to a Data Visualization course yields a lower NPS of + 9 CI[-6, + 23]. |
|---|---|
| ISSN: | 2731-5525 |
| DOI: | 10.1007/s44217-025-00492-9 |
