Exploring the Validity of the Advanced Placement (AP) Japanese Computer-Simulated Interpersonal Speaking Task: Domain Definition Inference.
Saved in:
| Title: | Exploring the Validity of the Advanced Placement (AP) Japanese Computer-Simulated Interpersonal Speaking Task: Domain Definition Inference. |
|---|---|
| Authors: | Suzumura-Smith, Nana |
| Source: | Japanese Language & Literature. Apr2026, Vol. 60 Issue 1, p83-137. 55p. |
| Subject Terms: | *Language ability testing, *Test validity, *Advanced placement programs (Education), *Language ability |
| Abstract: | This study examined the domain definition inference for the AP Japanese exam, which aims to measure language proficiency in situations reflecting real life. For the domain definition inference, this exam attempts to claim that (a) features of examinee performance that provide evidence of language proficiency have been identified, and (b) the assessment tasks are relevant to and representative of the real-life domain. Focusing on the computer-simulated conversation task of the AP Japanese exam, four assumptions underlying these claims were investigated: (1) the target domain is clearly identified; (2) critical language skills and knowledge needed in the target domain are identified; (3) assessment tasks that are representative of the target domain are identified; and (4) assessment tasks that require critical skills and are representative of the target domain are simulated. Backing for these assumptions was gathered through analyses of exam-related documents and test task characteristics, including context, input language, and scoring criteria. This study found reasonable backing for the first two assumptions and partial backing for the others. Therefore, this paper argues that the two claims that the exam attempts to make for the domain definition inference are not fully supported. It also discusses possible ways to improve the validity argument. [ABSTRACT FROM AUTHOR] |
| Copyright of Japanese Language & Literature is the property of American Association of Teachers of Japanese and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 194025952 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Exploring the Validity of the Advanced Placement (AP) Japanese Computer-Simulated Interpersonal Speaking Task: Domain Definition Inference. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Suzumura-Smith%2C+Nana%22">Suzumura-Smith, Nana</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Japanese+Language+%26+Literature%22">Japanese Language & Literature</searchLink>. Apr2026, Vol. 60 Issue 1, p83-137. 55p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Language+ability+testing%22">Language ability testing</searchLink><br />*<searchLink fieldCode="DE" term="%22Test+validity%22">Test validity</searchLink><br />*<searchLink fieldCode="DE" term="%22Advanced+placement+programs+%28Education%29%22">Advanced placement programs (Education)</searchLink><br />*<searchLink fieldCode="DE" term="%22Language+ability%22">Language ability</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: This study examined the domain definition inference for the AP Japanese exam, which aims to measure language proficiency in situations reflecting real life. For the domain definition inference, this exam attempts to claim that (a) features of examinee performance that provide evidence of language proficiency have been identified, and (b) the assessment tasks are relevant to and representative of the real-life domain. Focusing on the computer-simulated conversation task of the AP Japanese exam, four assumptions underlying these claims were investigated: (1) the target domain is clearly identified; (2) critical language skills and knowledge needed in the target domain are identified; (3) assessment tasks that are representative of the target domain are identified; and (4) assessment tasks that require critical skills and are representative of the target domain are simulated. Backing for these assumptions was gathered through analyses of exam-related documents and test task characteristics, including context, input language, and scoring criteria. This study found reasonable backing for the first two assumptions and partial backing for the others. Therefore, this paper argues that the two claims that the exam attempts to make for the domain definition inference are not fully supported. It also discusses possible ways to improve the validity argument. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Japanese Language & Literature is the property of American Association of Teachers of Japanese and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=194025952 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.5195/jll.2026.309 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 55 StartPage: 83 Subjects: – SubjectFull: Language ability testing Type: general – SubjectFull: Test validity Type: general – SubjectFull: Advanced placement programs (Education) Type: general – SubjectFull: Language ability Type: general Titles: – TitleFull: Exploring the Validity of the Advanced Placement (AP) Japanese Computer-Simulated Interpersonal Speaking Task: Domain Definition Inference. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Suzumura-Smith, Nana IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 04 Text: Apr2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 15367827 Numbering: – Type: volume Value: 60 – Type: issue Value: 1 Titles: – TitleFull: Japanese Language & Literature Type: main |
| ResultId | 1 |
