Universal Tools Activation in English Language Proficiency Assessments: A Comparison of Grades 1-12 English Learners with and without Disabilities

Saved in:
Bibliographic Details
Title: Universal Tools Activation in English Language Proficiency Assessments: A Comparison of Grades 1-12 English Learners with and without Disabilities
Language: English
Authors: Kim, Ahyoung Alicia (ORCID 0000-0001-7857-0503), Yumsek, Meltem, Kemp, Jason A. (ORCID 0000-0001-5676-4526), Chapman, Mark, Cook, H. Gary
Source: Language Testing. 2023 40(4):877-903.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Peer Reviewed: Y
Page Count: 27
Publication Date: 2023
Document Type: Journal Articles
Reports - Research
Education Level: Elementary Education
Early Childhood Education
Grade 1
Primary Education
Grade 2
Descriptors: English (Second Language), Second Language Learning, Second Language Instruction, Students with Disabilities, Language Tests, Language Skills, English Language Learners, Access to Education, Elementary School Students, Grade 1, Grade 2, Student Attitudes, Testing, Computer Assisted Testing, Comparative Analysis, Testing Accommodations
DOI: 10.1177/02655322221149009
ISSN: 0265-5322
1477-0946
Abstract: English learners (ELs) comprise approximately 10% of kindergarten to Grade 12 students in US public schools, with about 15% of ELs identified as having disabilities. English language proficiency (ELP) assessments must adhere to universal design principles and incorporate universal tools, designed to increase accessibility for all ELs, including those with disabilities. This two-phase mixed methods study examined the extent Grades 1-12 ELs with and without disabilities activated universal tools during an online ELP assessment: Color Overlay, Color Contrast, Help Tools, Line Guide, Highlighter, Magnifier, and Sticky Notes. In Phase 1, analyses were conducted on 1.25 million students' test and telemetry data (record of keystrokes and clicks). Phase 2 involved interviewing 55 ELs after test administration. Findings show that ELs activated the Line Guide, Highlighter, and Magnifier more frequently than others. The tool activation rate was higher in listening and reading domains than in speaking and writing. A significantly higher percentage of ELs with disabilities activated the tools than ELs without disabilities, but effect sizes were small; interview findings further revealed students' rationale for tool use. Results indicate differences in ELs' activation of universal tools depending on their disability category and language domain, providing evidence for the usefulness of these tools.
Abstractor: As Provided
Entry Date: 2023
Accession Number: EJ1396122
Database: ERIC
Description
Abstract:English learners (ELs) comprise approximately 10% of kindergarten to Grade 12 students in US public schools, with about 15% of ELs identified as having disabilities. English language proficiency (ELP) assessments must adhere to universal design principles and incorporate universal tools, designed to increase accessibility for all ELs, including those with disabilities. This two-phase mixed methods study examined the extent Grades 1-12 ELs with and without disabilities activated universal tools during an online ELP assessment: Color Overlay, Color Contrast, Help Tools, Line Guide, Highlighter, Magnifier, and Sticky Notes. In Phase 1, analyses were conducted on 1.25 million students' test and telemetry data (record of keystrokes and clicks). Phase 2 involved interviewing 55 ELs after test administration. Findings show that ELs activated the Line Guide, Highlighter, and Magnifier more frequently than others. The tool activation rate was higher in listening and reading domains than in speaking and writing. A significantly higher percentage of ELs with disabilities activated the tools than ELs without disabilities, but effect sizes were small; interview findings further revealed students' rationale for tool use. Results indicate differences in ELs' activation of universal tools depending on their disability category and language domain, providing evidence for the usefulness of these tools.
ISSN:0265-5322
1477-0946
DOI:10.1177/02655322221149009