Can the Oral Proficiency Interview -- Computer (ACTFL OPIc) Be Used Instead of the Oral Proficiency Interview (ACTFL OPI)? An Aligned Rank Transform (ART) Analysis
Saved in:
| Title: | Can the Oral Proficiency Interview -- Computer (ACTFL OPIc) Be Used Instead of the Oral Proficiency Interview (ACTFL OPI)? An Aligned Rank Transform (ART) Analysis |
|---|---|
| Language: | English |
| Authors: | Troy L. Cox (ORCID |
| Source: | Foreign Language Annals. 2025 58(2):300-325. |
| Availability: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: | Y |
| Page Count: | 26 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Oral Language, Language Proficiency, Interviews, Computer Uses in Education, College Students, Second Language Learning, Spanish, Gender Differences, Age Differences, Scores, Testing, Test Reliability, Language Tests, Test Bias |
| Assessment and Survey Identifiers: | ACTFL Oral Proficiency Interview |
| DOI: | 10.1111/flan.12804 |
| ISSN: | 0015-718X 1944-9720 |
| Abstract: | This study investigated the differences between the ACTFL Oral Proficiency Interview (OPI) and the ACTFL Oral Proficiency Interview - Computer (OPIc) among Spanish learners at a U.S. university. Participants (N = 154) were randomly assigned to take both tests in a counterbalanced order to mitigate test order effects. Data were analyzed using an aligned rank transform (ART) analysis, focusing on variables such as gender, age, language courses, missionary experience, and self-assessed Spanish ability. Results showed a strong correlation between ACTFL OPI and ACTFL OPIc ratings ([tau] = 0.79, p < 0.001), though ACTFL OPIc ratings were slightly higher on average. No significant order effects were found, indicating the order of test administration did not influence ratings. The reliability of both tests was confirmed, and no significant biases were detected. The findings suggest that both ACTFL OPI and ACTFL OPIc are effective, holistic measures of Spanish oral proficiency, with ACTFL OPIc offering a slight advantage in rating outcomes. Pedagogically, this suggests flexibility in test choice without compromising assessment integrity. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1477432 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | This study investigated the differences between the ACTFL Oral Proficiency Interview (OPI) and the ACTFL Oral Proficiency Interview - Computer (OPIc) among Spanish learners at a U.S. university. Participants (N = 154) were randomly assigned to take both tests in a counterbalanced order to mitigate test order effects. Data were analyzed using an aligned rank transform (ART) analysis, focusing on variables such as gender, age, language courses, missionary experience, and self-assessed Spanish ability. Results showed a strong correlation between ACTFL OPI and ACTFL OPIc ratings ([tau] = 0.79, p < 0.001), though ACTFL OPIc ratings were slightly higher on average. No significant order effects were found, indicating the order of test administration did not influence ratings. The reliability of both tests was confirmed, and no significant biases were detected. The findings suggest that both ACTFL OPI and ACTFL OPIc are effective, holistic measures of Spanish oral proficiency, with ACTFL OPIc offering a slight advantage in rating outcomes. Pedagogically, this suggests flexibility in test choice without compromising assessment integrity. |
|---|---|
| ISSN: | 0015-718X 1944-9720 |
| DOI: | 10.1111/flan.12804 |
