Presentation, Expectations, and Experience: Sources of Student Perceptions of Automated Writing Evaluation

Saved in:
Bibliographic Details
Title: Presentation, Expectations, and Experience: Sources of Student Perceptions of Automated Writing Evaluation
Language: English
Authors: Roscoe, Rod D., Wilson, Joshua, Johnson, Adam C., Mayra, Christopher R.
Source: Grantee Submission. 2017 70.
Peer Reviewed: Y
Page Count: 15
Publication Date: 2017
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305A120707
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Student Attitudes, Writing Instruction, Writing Evaluation, Feedback (Response), Accuracy, Computer Software, Essays, Scoring, Revision (Written Composition), Teaching Methods, Undergraduate Students, Introductory Courses, Psychology, Prediction
DOI: 10.1016/j.chb.2016.12.076
ISSN: 0747-5632
Abstract: Automated writing evaluation (AWE) is a popular form of educational technology designed to supplement writing instruction and feedback, yet research on the effectiveness of AWE has observed mixed findings. The current study considered how students' perceptions of automated essay scoring and feedback influenced their writing performance, revising behaviors, and future intentions toward the technology. The manner in which the software was presented--claims about the accuracy and quality of the automated scoring and feedback--were modestly related to students' expectations and perceptions. However, students' direct experiences with the software were most strongly associated with their perceptions. Importantly, students' perceptions seemed to have minimal impact on their "in the moment" use of the software to write and revise successfully. Students revised and improved their essays regardless of their positive or negative views of the system. However, positive and negative perceptions significantly predicted future intentions to use the software again or to recommend the software to a friend. Implications for AWE design, implementation, and evaluation are discussed.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2022
Accession Number: ED616595
Database: ERIC
Description
Abstract:Automated writing evaluation (AWE) is a popular form of educational technology designed to supplement writing instruction and feedback, yet research on the effectiveness of AWE has observed mixed findings. The current study considered how students' perceptions of automated essay scoring and feedback influenced their writing performance, revising behaviors, and future intentions toward the technology. The manner in which the software was presented--claims about the accuracy and quality of the automated scoring and feedback--were modestly related to students' expectations and perceptions. However, students' direct experiences with the software were most strongly associated with their perceptions. Importantly, students' perceptions seemed to have minimal impact on their "in the moment" use of the software to write and revise successfully. Students revised and improved their essays regardless of their positive or negative views of the system. However, positive and negative perceptions significantly predicted future intentions to use the software again or to recommend the software to a friend. Implications for AWE design, implementation, and evaluation are discussed.
ISSN:0747-5632
DOI:10.1016/j.chb.2016.12.076