Using the ACTFL OPIc to Assess Proficiency and Monitor Progress in a Tertiary Foreign Languages Program

Saved in:
Bibliographic Details
Title: Using the ACTFL OPIc to Assess Proficiency and Monitor Progress in a Tertiary Foreign Languages Program
Language: English
Authors: Isbell, Daniel R. (ORCID 0000-0001-5850-8809), Winke, Paula, Gass, Susan M.
Source: Language Testing. Jul 2019 36(3):439-465.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 27
Publication Date: 2019
Sponsoring Agency: National Security Education Program (NSEP)
Contract Number: 0054MSU22PI280PO2
Document Type: Journal Articles
Reports - Research
Tests/Questionnaires
Education Level: Higher Education
Postsecondary Education
Descriptors: Oral Language, Language Proficiency, Second Language Learning, Language Tests, French, Spanish, Russian, Learning Experience, Learning Motivation, Chinese, Second Language Instruction, Scores, Computer Assisted Testing, Student Characteristics, Longitudinal Studies, College Students, Program Evaluation
Assessment and Survey Identifiers: ACTFL Oral Proficiency Interview
DOI: 10.1177/0265532218798139
ISSN: 0265-5322
Abstract: Language tests are useful for many purposes, including monitoring language learning progress and evaluating language programs. This study investigated the interpretations and usefulness of the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview -- Computer (OPIc) scores across four languages at a large US public university, focusing on (1) the influence of learner backgrounds on oral proficiency variation and growth and (2) patterns in growth across languages. Two years of OPIc score data from 814 students studying Chinese (n = 143), French (n = 251), Spanish (n = 374), and Russian (n = 46) were collected, together with survey data on language learning experiences and motivation. Each participant had two to four OPIc scores. A growth curve analysis using mixed-effect modeling revealed that language learning experience and motivation explained approximately 43% of variation in initial proficiency and 23% of variation in rates of change over time. The target language had no unique effects on initial proficiency or change over time. On average, learners gained roughly one-third of an ACTFL sublevel per semester of study (while controlling for differences in their backgrounds). Findings are informative for appropriate interpretations and uses of OPIc scores in tertiary educational settings, but also question individual growth-tracking suitability on a semester-by-semester basis.
Abstractor: As Provided
Entry Date: 2019
Accession Number: EJ1219446
Database: ERIC
Description
Abstract:Language tests are useful for many purposes, including monitoring language learning progress and evaluating language programs. This study investigated the interpretations and usefulness of the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview -- Computer (OPIc) scores across four languages at a large US public university, focusing on (1) the influence of learner backgrounds on oral proficiency variation and growth and (2) patterns in growth across languages. Two years of OPIc score data from 814 students studying Chinese (n = 143), French (n = 251), Spanish (n = 374), and Russian (n = 46) were collected, together with survey data on language learning experiences and motivation. Each participant had two to four OPIc scores. A growth curve analysis using mixed-effect modeling revealed that language learning experience and motivation explained approximately 43% of variation in initial proficiency and 23% of variation in rates of change over time. The target language had no unique effects on initial proficiency or change over time. On average, learners gained roughly one-third of an ACTFL sublevel per semester of study (while controlling for differences in their backgrounds). Findings are informative for appropriate interpretations and uses of OPIc scores in tertiary educational settings, but also question individual growth-tracking suitability on a semester-by-semester basis.
ISSN:0265-5322
DOI:10.1177/0265532218798139