Using the ACTFL OPIc to Assess Proficiency and Monitor Progress in a Tertiary Foreign Languages Program

Saved in:
Bibliographic Details
Title: Using the ACTFL OPIc to Assess Proficiency and Monitor Progress in a Tertiary Foreign Languages Program
Language: English
Authors: Isbell, Daniel R. (ORCID 0000-0001-5850-8809), Winke, Paula, Gass, Susan M.
Source: Language Testing. Jul 2019 36(3):439-465.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 27
Publication Date: 2019
Sponsoring Agency: National Security Education Program (NSEP)
Contract Number: 0054MSU22PI280PO2
Document Type: Journal Articles
Reports - Research
Tests/Questionnaires
Education Level: Higher Education
Postsecondary Education
Descriptors: Oral Language, Language Proficiency, Second Language Learning, Language Tests, French, Spanish, Russian, Learning Experience, Learning Motivation, Chinese, Second Language Instruction, Scores, Computer Assisted Testing, Student Characteristics, Longitudinal Studies, College Students, Program Evaluation
Assessment and Survey Identifiers: ACTFL Oral Proficiency Interview
DOI: 10.1177/0265532218798139
ISSN: 0265-5322
Abstract: Language tests are useful for many purposes, including monitoring language learning progress and evaluating language programs. This study investigated the interpretations and usefulness of the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview -- Computer (OPIc) scores across four languages at a large US public university, focusing on (1) the influence of learner backgrounds on oral proficiency variation and growth and (2) patterns in growth across languages. Two years of OPIc score data from 814 students studying Chinese (n = 143), French (n = 251), Spanish (n = 374), and Russian (n = 46) were collected, together with survey data on language learning experiences and motivation. Each participant had two to four OPIc scores. A growth curve analysis using mixed-effect modeling revealed that language learning experience and motivation explained approximately 43% of variation in initial proficiency and 23% of variation in rates of change over time. The target language had no unique effects on initial proficiency or change over time. On average, learners gained roughly one-third of an ACTFL sublevel per semester of study (while controlling for differences in their backgrounds). Findings are informative for appropriate interpretations and uses of OPIc scores in tertiary educational settings, but also question individual growth-tracking suitability on a semester-by-semester basis.
Abstractor: As Provided
Entry Date: 2019
Accession Number: EJ1219446
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1219446
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Using the ACTFL OPIc to Assess Proficiency and Monitor Progress in a Tertiary Foreign Languages Program
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Isbell%2C+Daniel+R%2E%22">Isbell, Daniel R.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-5850-8809">0000-0001-5850-8809</externalLink>)<br /><searchLink fieldCode="AR" term="%22Winke%2C+Paula%22">Winke, Paula</searchLink><br /><searchLink fieldCode="AR" term="%22Gass%2C+Susan+M%2E%22">Gass, Susan M.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Language+Testing%22"><i>Language Testing</i></searchLink>. Jul 2019 36(3):439-465.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 27
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2019
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Security Education Program (NSEP)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: 0054MSU22PI280PO2
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research<br />Tests/Questionnaires
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Oral+Language%22">Oral Language</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Proficiency%22">Language Proficiency</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Tests%22">Language Tests</searchLink><br /><searchLink fieldCode="DE" term="%22French%22">French</searchLink><br /><searchLink fieldCode="DE" term="%22Spanish%22">Spanish</searchLink><br /><searchLink fieldCode="DE" term="%22Russian%22">Russian</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Experience%22">Learning Experience</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Motivation%22">Learning Motivation</searchLink><br /><searchLink fieldCode="DE" term="%22Chinese%22">Chinese</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Instruction%22">Second Language Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Characteristics%22">Student Characteristics</searchLink><br /><searchLink fieldCode="DE" term="%22Longitudinal+Studies%22">Longitudinal Studies</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Evaluation%22">Program Evaluation</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22ACTFL+Oral+Proficiency+Interview%22">ACTFL Oral Proficiency Interview</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/0265532218798139
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0265-5322
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Language tests are useful for many purposes, including monitoring language learning progress and evaluating language programs. This study investigated the interpretations and usefulness of the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview -- Computer (OPIc) scores across four languages at a large US public university, focusing on (1) the influence of learner backgrounds on oral proficiency variation and growth and (2) patterns in growth across languages. Two years of OPIc score data from 814 students studying Chinese (n = 143), French (n = 251), Spanish (n = 374), and Russian (n = 46) were collected, together with survey data on language learning experiences and motivation. Each participant had two to four OPIc scores. A growth curve analysis using mixed-effect modeling revealed that language learning experience and motivation explained approximately 43% of variation in initial proficiency and 23% of variation in rates of change over time. The target language had no unique effects on initial proficiency or change over time. On average, learners gained roughly one-third of an ACTFL sublevel per semester of study (while controlling for differences in their backgrounds). Findings are informative for appropriate interpretations and uses of OPIc scores in tertiary educational settings, but also question individual growth-tracking suitability on a semester-by-semester basis.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2019
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1219446
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1219446
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/0265532218798139
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 27
        StartPage: 439
    Subjects:
      – SubjectFull: Oral Language
        Type: general
      – SubjectFull: Language Proficiency
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Language Tests
        Type: general
      – SubjectFull: French
        Type: general
      – SubjectFull: Spanish
        Type: general
      – SubjectFull: Russian
        Type: general
      – SubjectFull: Learning Experience
        Type: general
      – SubjectFull: Learning Motivation
        Type: general
      – SubjectFull: Chinese
        Type: general
      – SubjectFull: Second Language Instruction
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Student Characteristics
        Type: general
      – SubjectFull: Longitudinal Studies
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Program Evaluation
        Type: general
      – SubjectFull: ACTFL Oral Proficiency Interview
        Type: general
    Titles:
      – TitleFull: Using the ACTFL OPIc to Assess Proficiency and Monitor Progress in a Tertiary Foreign Languages Program
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Isbell, Daniel R.
      – PersonEntity:
          Name:
            NameFull: Winke, Paula
      – PersonEntity:
          Name:
            NameFull: Gass, Susan M.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Type: published
              Y: 2019
          Identifiers:
            – Type: issn-print
              Value: 0265-5322
          Numbering:
            – Type: volume
              Value: 36
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Language Testing
              Type: main
ResultId 1