Lessons Learned in Designing and Implementing a Computer-Adaptive Test for English

Saved in:
Bibliographic Details
Title: Lessons Learned in Designing and Implementing a Computer-Adaptive Test for English
Language: English
Authors: Burston, Jack, Neophytou, Maro
Source: The EUROCALL Review. Sep 2014 22(2):19-25.
Availability: European Association for Computer-Assisted Language Learning (EUROCALL). EUROCALL Headquarters, School of Modern Languages, University of Ulster, Cromore Road, Coleraine BT52 1SA, Northern Ireland, UK. Tel: +34-67-943-1283; Web site: http://www.eurocall-languages.org/publications/review
Peer Reviewed: Y
Page Count: 7
Publication Date: 2014
Document Type: Journal Articles
Reports - Evaluative
Descriptors: English (Second Language), Second Language Instruction, Second Language Learning, Computer Assisted Instruction, Computer Assisted Testing, Test Construction, Student Placement, Language Teachers, Multimedia Materials, Databases, Difficulty Level, Foreign Countries
Geographic Terms: Cyprus
ISSN: 1695-2618
Abstract: This paper describes the lessons learned in designing and implementing a computer-adaptive test (CAT) for English. The early identification of students with weak L2 English proficiency is of critical importance in university settings that have compulsory English language course graduation requirements. The most efficient means of diagnosing the L2 English ability of incoming students is by means of a computer-based test since such evaluation can be administered quickly, automatically corrected, and the outcome known as soon as the test is completed. While the option of using a commercial CAT is available to institutions with the ability to pay substantial annual fees, or the means of passing these expenses on to their students, language instructors without these resources can only avail themselves of the advantages of CAT evaluation by creating their own tests. As is demonstrated by the E-CAT project described in this paper, this is a viable alternative even for those lacking any computer programing expertise. However, language teaching experience and testing expertise are critical to such an undertaking, which requires considerable effort and, above all, collaborative teamwork to succeed. A number of practical skills are also required. Firstly, the operation of a CAT authoring programme must be learned. Once this is done, test makers must master the art of creating a question database and assigning difficulty levels to test items. Lastly, if multimedia resources are to be exploited in a CAT, test creators need to be able to locate suitable copyright-free resources and re-edit them as needed.
Abstractor: As Provided
Number of References: 4
Entry Date: 2015
Accession Number: EJ1055210
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1055210
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1055210
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Lessons Learned in Designing and Implementing a Computer-Adaptive Test for English
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Burston%2C+Jack%22">Burston, Jack</searchLink><br /><searchLink fieldCode="AR" term="%22Neophytou%2C+Maro%22">Neophytou, Maro</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22The+EUROCALL+Review%22"><i>The EUROCALL Review</i></searchLink>. Sep 2014 22(2):19-25.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: European Association for Computer-Assisted Language Learning (EUROCALL). EUROCALL Headquarters, School of Modern Languages, University of Ulster, Cromore Road, Coleraine BT52 1SA, Northern Ireland, UK. Tel: +34-67-943-1283; Web site: http://www.eurocall-languages.org/publications/review
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 7
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2014
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Evaluative
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Instruction%22">Second Language Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Instruction%22">Computer Assisted Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Placement%22">Student Placement</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Teachers%22">Language Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Multimedia+Materials%22">Multimedia Materials</searchLink><br /><searchLink fieldCode="DE" term="%22Databases%22">Databases</searchLink><br /><searchLink fieldCode="DE" term="%22Difficulty+Level%22">Difficulty Level</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Cyprus%22">Cyprus</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1695-2618
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This paper describes the lessons learned in designing and implementing a computer-adaptive test (CAT) for English. The early identification of students with weak L2 English proficiency is of critical importance in university settings that have compulsory English language course graduation requirements. The most efficient means of diagnosing the L2 English ability of incoming students is by means of a computer-based test since such evaluation can be administered quickly, automatically corrected, and the outcome known as soon as the test is completed. While the option of using a commercial CAT is available to institutions with the ability to pay substantial annual fees, or the means of passing these expenses on to their students, language instructors without these resources can only avail themselves of the advantages of CAT evaluation by creating their own tests. As is demonstrated by the E-CAT project described in this paper, this is a viable alternative even for those lacking any computer programing expertise. However, language teaching experience and testing expertise are critical to such an undertaking, which requires considerable effort and, above all, collaborative teamwork to succeed. A number of practical skills are also required. Firstly, the operation of a CAT authoring programme must be learned. Once this is done, test makers must master the art of creating a question database and assigning difficulty levels to test items. Lastly, if multimedia resources are to be exploited in a CAT, test creators need to be able to locate suitable copyright-free resources and re-edit them as needed.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 4
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2015
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1055210
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1055210
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 7
        StartPage: 19
    Subjects:
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Second Language Instruction
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Computer Assisted Instruction
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Student Placement
        Type: general
      – SubjectFull: Language Teachers
        Type: general
      – SubjectFull: Multimedia Materials
        Type: general
      – SubjectFull: Databases
        Type: general
      – SubjectFull: Difficulty Level
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Cyprus
        Type: general
    Titles:
      – TitleFull: Lessons Learned in Designing and Implementing a Computer-Adaptive Test for English
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Burston, Jack
      – PersonEntity:
          Name:
            NameFull: Neophytou, Maro
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Type: published
              Y: 2014
          Identifiers:
            – Type: issn-electronic
              Value: 1695-2618
          Numbering:
            – Type: volume
              Value: 22
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: The EUROCALL Review
              Type: main
ResultId 1