Assessing Second Language Writing without Technology: A First-Year University Study

Saved in:
Bibliographic Details
Title: Assessing Second Language Writing without Technology: A First-Year University Study
Language: English
Authors: Maryam BoJulaia (ORCID 0000-0002-6833-0220), Dana Alzahid (ORCID 0009-0003-0268-3853), Maura A. E. Pilotti (ORCID 0000-0001-7955-680X), Arifi Wak (ORCID 0000-0003-1222-0978)
Source: International Society for Technology, Education, and Science. 2025.
Availability: International Society for Technology, Education, and Science. 944 Maysey Drive, San Antonio, TX 78227. Tel: 515-294-1075; Fax: 515-294-1003; email: istesoffice@gmail.com; Web site: http://www.istes.org
Peer Reviewed: Y
Page Count: 10
Publication Date: 2025
Document Type: Speeches/Meeting Papers
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: College Freshmen, English (Second Language), Second Language Learning, Writing (Composition), Writing Skills, Achievement Tests, Sentence Structure, Sentences, Prediction, Gamification, Educational Games
Abstract: In higher education, easy-to-administer diagnostic measures of second-language students' writing are in high demand. Asking such students to write essays is not only time-consuming but also likely to induce anxiety, which interferes with the accurate assessment of their competencies. The present study examined whether a game requiring sentences to be combined or built can adequately predict the quantity and quality of second-language learners' writing. At the start of the semester, 300 undergraduate students who were enrolled in a communication course completed a sentence-combination task and a sentence-building task modeled after those of the Wechsler Individual Achievement Test-Third Edition (WIAT-III). Specifically, participants (a) combined two or three brief sentences into one without altering the overall meaning (sentence-combination task) or (b) created sentences that contained a particular function word (i.e., article or preposition; sentence-building task). One week later, participants were given 10 minutes to write independently an essay on a common topic in a Unicode text file. Sentences were scored for grammatical, spelling, and semantic errors. Instead, essays were assessed by estimating the learners' effort (i.e., number of words and sentences written) and writing quality (e.g., use of academic vocabulary, syntactic complexity, and lexical cohesion). The sentence-building task was overall a better predictor of effort and academic vocabulary (a quality measure). However, neither sentence-building nor sentence-combination performance predicted the syntactic complexity or lexical cohesion of students' essays. In sum, sentence-level games represent enjoyable and time-saving diagnostic tools useful for capturing students' effort devoted to the activity of writing. However, they fail to apprehend more complex properties of their writing. Alternative time-saving diagnostic techniques are suggested. [For the complete proceedings, see ED678959.]
Abstractor: As Provided
Entry Date: 2026
Accession Number: ED678960
Database: ERIC
Description
Abstract:In higher education, easy-to-administer diagnostic measures of second-language students' writing are in high demand. Asking such students to write essays is not only time-consuming but also likely to induce anxiety, which interferes with the accurate assessment of their competencies. The present study examined whether a game requiring sentences to be combined or built can adequately predict the quantity and quality of second-language learners' writing. At the start of the semester, 300 undergraduate students who were enrolled in a communication course completed a sentence-combination task and a sentence-building task modeled after those of the Wechsler Individual Achievement Test-Third Edition (WIAT-III). Specifically, participants (a) combined two or three brief sentences into one without altering the overall meaning (sentence-combination task) or (b) created sentences that contained a particular function word (i.e., article or preposition; sentence-building task). One week later, participants were given 10 minutes to write independently an essay on a common topic in a Unicode text file. Sentences were scored for grammatical, spelling, and semantic errors. Instead, essays were assessed by estimating the learners' effort (i.e., number of words and sentences written) and writing quality (e.g., use of academic vocabulary, syntactic complexity, and lexical cohesion). The sentence-building task was overall a better predictor of effort and academic vocabulary (a quality measure). However, neither sentence-building nor sentence-combination performance predicted the syntactic complexity or lexical cohesion of students' essays. In sum, sentence-level games represent enjoyable and time-saving diagnostic tools useful for capturing students' effort devoted to the activity of writing. However, they fail to apprehend more complex properties of their writing. Alternative time-saving diagnostic techniques are suggested. [For the complete proceedings, see ED678959.]