The Effect of Feedback on Informative Text Writing: AI or Teacher?

Saved in:
Bibliographic Details
Title: The Effect of Feedback on Informative Text Writing: AI or Teacher?
Language: English
Authors: Mehmi Baz (ORCID 0000-0002-6847-5657), Sevil Hasirci Aksoy (ORCID 0000-0003-1041-7558)
Source: Open Praxis. 2025 17(3):611-631.
Availability: International Council for Open and Distance Education. Lilleakerveien 23, 0283 Oslo, Norway. Tel: +47-22-06-26-30; Fax: +47-22-06-26-31; e-mail: icde@icde.org; Web site: https://openpraxis.org/
Peer Reviewed: Y
Page Count: 21
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Junior High Schools
Middle Schools
Secondary Education
Descriptors: Feedback (Response), Writing Evaluation, Expository Writing, Artificial Intelligence, Technology Uses in Education, Computer Mediated Communication, Written Language, Writing Improvement, Formative Evaluation, Instructional Effectiveness, Middle School Students, Foreign Countries, Middle School Teachers
Geographic Terms: Turkey
ISSN: 1369-9997
2304-070X
Abstract: This study was conducted to examine the effects of feedback provided by a generative AI chatbot trained by the researcher and feedback given by a teacher on students' achievement and retention in informative text writing.In this context, a convergent parallel mixed-methods approach was adopted. The research was conducted with two groups at the fifth-grade middle school level, comprising experimental and control groups. For eight weeks, the chatbot provided feedback on the texts of students in the experimental group through the researcher, while the teacher provided feedback on the texts of students in the control group. To measure students' informative text writing performance, the Informative Text Writing Performance Assessment Scale developed by Hamzadayi and Dölek (2022) was utilized. Findings indicated that feedback provided by both the AI chatbot and the teacher contributed to improvements in students' informative text writing performance. However, it was determined that such improvement persisted significantly only within the teacher-feedback group. Based on this finding, it was concluded that while chatbot feedback was as effective as teacher feedback in improving writing performance, it did not exhibit comparable long-term retention effects. When comparing the content of feedback provided, it was observed that the chatbot's feedback was quantitatively more extensive than that of the teacher. Conversely, teacher feedback was superior regarding affective components and question-oriented feedback. Consequently, generative AI tools hold significant potential for reducing teachers' cognitive workload in writing instruction by providing supplementary and innovative feedback methods.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1481272
Database: ERIC
Description
Abstract:This study was conducted to examine the effects of feedback provided by a generative AI chatbot trained by the researcher and feedback given by a teacher on students' achievement and retention in informative text writing.In this context, a convergent parallel mixed-methods approach was adopted. The research was conducted with two groups at the fifth-grade middle school level, comprising experimental and control groups. For eight weeks, the chatbot provided feedback on the texts of students in the experimental group through the researcher, while the teacher provided feedback on the texts of students in the control group. To measure students' informative text writing performance, the Informative Text Writing Performance Assessment Scale developed by Hamzadayi and Dölek (2022) was utilized. Findings indicated that feedback provided by both the AI chatbot and the teacher contributed to improvements in students' informative text writing performance. However, it was determined that such improvement persisted significantly only within the teacher-feedback group. Based on this finding, it was concluded that while chatbot feedback was as effective as teacher feedback in improving writing performance, it did not exhibit comparable long-term retention effects. When comparing the content of feedback provided, it was observed that the chatbot's feedback was quantitatively more extensive than that of the teacher. Conversely, teacher feedback was superior regarding affective components and question-oriented feedback. Consequently, generative AI tools hold significant potential for reducing teachers' cognitive workload in writing instruction by providing supplementary and innovative feedback methods.
ISSN:1369-9997
2304-070X