Validity of score interpretations on an online English placement writing test.
Saved in:
| Title: | Validity of score interpretations on an online English placement writing test. |
|---|---|
| Authors: | Choi, Yun Deok1 yundeokchoi@cnu.ac.kr |
| Source: | Language Testing in Asia. 9/15/2022, Vol. 12 Issue 1, p1-21. 21p. |
| Subject Terms: | *Placement testing, *Evaluation, *English as a foreign language, *Rating of students, Writing ability testing |
| Abstract: | A much-debated question in the L2 assessment field is if computer familiarity should be considered a potential source of construct-irrelevant variance in computer-based writing (CBW) tests. This study aims to make a partial validity argument for an online source-based writing test (OSWT) designed for English placement testing (EPT), focusing on the explanation inference. Score interpretations on the OWST are proposed and supporting evidence is sought in terms of test-takers' self-confidence in and preferences for CBW tests (two interrelated aspects of computer familiarity) and L2 writing ability. Ninety-seven ESL students demonstrating two different levels (higher and lower levels) of L2 writing ability studying at a US university completed the OSWT and an online questionnaire asking about their attitudes towards CBW tests. A series of statistical and thematic analyses revealed that most of the test-takers held self-confidence in and preferences for CBW tests for reasons related to previous CBW experience (e.g., familiarity with CBW, useful tools/functions available on computers) regardless of L2 writing ability. The higher-level test-takers obtained significantly higher scores on the OSWT than their lower-level counterparts. Test-takers' preferences were a significant predictor of the OSWT scores only in the higher-level group. The findings largely support the validity of proposed score interpretations on the OSWT. Implications are discussed in terms of test fairness and the construct of CBW tests. [ABSTRACT FROM AUTHOR] |
| Copyright of Language Testing in Asia is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 159103077 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Validity of score interpretations on an online English placement writing test. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Choi%2C+Yun+Deok%22">Choi, Yun Deok</searchLink><relatesTo>1</relatesTo><i> yundeokchoi@cnu.ac.kr</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Language+Testing+in+Asia%22">Language Testing in Asia</searchLink>. 9/15/2022, Vol. 12 Issue 1, p1-21. 21p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Placement+testing%22">Placement testing</searchLink><br />*<searchLink fieldCode="DE" term="%22Evaluation%22">Evaluation</searchLink><br />*<searchLink fieldCode="DE" term="%22English+as+a+foreign+language%22">English as a foreign language</searchLink><br />*<searchLink fieldCode="DE" term="%22Rating+of+students%22">Rating of students</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+ability+testing%22">Writing ability testing</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: A much-debated question in the L2 assessment field is if computer familiarity should be considered a potential source of construct-irrelevant variance in computer-based writing (CBW) tests. This study aims to make a partial validity argument for an online source-based writing test (OSWT) designed for English placement testing (EPT), focusing on the explanation inference. Score interpretations on the OWST are proposed and supporting evidence is sought in terms of test-takers' self-confidence in and preferences for CBW tests (two interrelated aspects of computer familiarity) and L2 writing ability. Ninety-seven ESL students demonstrating two different levels (higher and lower levels) of L2 writing ability studying at a US university completed the OSWT and an online questionnaire asking about their attitudes towards CBW tests. A series of statistical and thematic analyses revealed that most of the test-takers held self-confidence in and preferences for CBW tests for reasons related to previous CBW experience (e.g., familiarity with CBW, useful tools/functions available on computers) regardless of L2 writing ability. The higher-level test-takers obtained significantly higher scores on the OSWT than their lower-level counterparts. Test-takers' preferences were a significant predictor of the OSWT scores only in the higher-level group. The findings largely support the validity of proposed score interpretations on the OSWT. Implications are discussed in terms of test fairness and the construct of CBW tests. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Language Testing in Asia is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=159103077 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1186/s40468-022-00187-0 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 21 StartPage: 1 Subjects: – SubjectFull: Placement testing Type: general – SubjectFull: Evaluation Type: general – SubjectFull: English as a foreign language Type: general – SubjectFull: Rating of students Type: general – SubjectFull: Writing ability testing Type: general Titles: – TitleFull: Validity of score interpretations on an online English placement writing test. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Choi, Yun Deok IsPartOfRelationships: – BibEntity: Dates: – D: 15 M: 09 Text: 9/15/2022 Type: published Y: 2022 Identifiers: – Type: issn-print Value: 22290443 Numbering: – Type: volume Value: 12 – Type: issue Value: 1 Titles: – TitleFull: Language Testing in Asia Type: main |
| ResultId | 1 |
