View in EDS

Establishing a Fair Cut Score for an In-House English Test: A Case Study on Integrating Two Standard-Setting Methods

Saved in:
Bibliographic Details
Title: Establishing a Fair Cut Score for an In-House English Test: A Case Study on Integrating Two Standard-Setting Methods
Language: English
Authors: Suthathip Thirakunkovit (ORCID 0000-0002-3502-6046)
Source: Language Testing in Asia. 2025 15.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 22
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Cutting Scores, Culture Fair Tests, Language Tests, Test Construction, Teaching Methods, Second Language Learning, Second Language Instruction, English (Second Language), Standard Setting, Universities, Language Proficiency, Comparative Analysis, Decision Making, Educational Testing, Psychological Testing
DOI: 10.1186/s40468-025-00348-x
ISSN: 2229-0443
Abstract: Establishing a cut score is a crucial aspect of the test development process since the selected cut score has the potential to impact students' performance outcomes and shape instructional strategies within the classroom. Therefore, it is vital for those involved in test development to set a cut score that is both fair and justifiable. This cut score should not only mirror the desired proficiency in language but also align with the Standards for Educational and Psychological Testing. The researcher aims to investigate whether the current passing score of an in-house developed English Language Test accurately represents the minimum competence for B2 learners and to determine whether the current cut scores should be adjusted according to the recommended scores derived from two standard-setting methods. In this study, the researcher uses a combination of two standard-setting methods--Angoff and Bookmark Methods--for establishing a sensible cut score for an in-house English language test called the MU-ELT (M University-English Language Test). Training and operational procedures for each method are described in detail along with comparative results. The results suggest that adjusting the current cut score is more feasible using both methods, with a preference for the Bookmark Method. Ultimately, the researcher hopes that this study can serve as a case study for providing any test developers and institutions with instructions on how to determine a cut score that comes from sound educational decision making.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1461613
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1461613
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Establishing a Fair Cut Score for an In-House English Test: A Case Study on Integrating Two Standard-Setting Methods
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Suthathip+Thirakunkovit%22">Suthathip Thirakunkovit</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-3502-6046">0000-0002-3502-6046</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Language+Testing+in+Asia%22"><i>Language Testing in Asia</i></searchLink>. 2025 15.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 22
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Cutting+Scores%22">Cutting Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Culture+Fair+Tests%22">Culture Fair Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Tests%22">Language Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Instruction%22">Second Language Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Standard+Setting%22">Standard Setting</searchLink><br /><searchLink fieldCode="DE" term="%22Universities%22">Universities</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Proficiency%22">Language Proficiency</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Decision+Making%22">Decision Making</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Testing%22">Educational Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Psychological+Testing%22">Psychological Testing</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1186/s40468-025-00348-x
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2229-0443
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Establishing a cut score is a crucial aspect of the test development process since the selected cut score has the potential to impact students' performance outcomes and shape instructional strategies within the classroom. Therefore, it is vital for those involved in test development to set a cut score that is both fair and justifiable. This cut score should not only mirror the desired proficiency in language but also align with the Standards for Educational and Psychological Testing. The researcher aims to investigate whether the current passing score of an in-house developed English Language Test accurately represents the minimum competence for B2 learners and to determine whether the current cut scores should be adjusted according to the recommended scores derived from two standard-setting methods. In this study, the researcher uses a combination of two standard-setting methods--Angoff and Bookmark Methods--for establishing a sensible cut score for an in-house English language test called the MU-ELT (M University-English Language Test). Training and operational procedures for each method are described in detail along with comparative results. The results suggest that adjusting the current cut score is more feasible using both methods, with a preference for the Bookmark Method. Ultimately, the researcher hopes that this study can serve as a case study for providing any test developers and institutions with instructions on how to determine a cut score that comes from sound educational decision making.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1461613
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1461613
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1186/s40468-025-00348-x
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 22
    Subjects:
      – SubjectFull: Cutting Scores
        Type: general
      – SubjectFull: Culture Fair Tests
        Type: general
      – SubjectFull: Language Tests
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Second Language Instruction
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Standard Setting
        Type: general
      – SubjectFull: Universities
        Type: general
      – SubjectFull: Language Proficiency
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Decision Making
        Type: general
      – SubjectFull: Educational Testing
        Type: general
      – SubjectFull: Psychological Testing
        Type: general
    Titles:
      – TitleFull: Establishing a Fair Cut Score for an In-House English Test: A Case Study on Integrating Two Standard-Setting Methods
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Suthathip Thirakunkovit
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2229-0443
          Numbering:
            – Type: volume
              Value: 15
          Titles:
            – TitleFull: Language Testing in Asia
              Type: main
ResultId 1