Getting Lucky: How Guessing Threatens the Validity of Performance Classifications
Saved in:
| Title: | Getting Lucky: How Guessing Threatens the Validity of Performance Classifications |
|---|---|
| Language: | English |
| Authors: | Foley, Brett P. |
| Source: | Practical Assessment, Research & Evaluation. Feb 2016 21(3). |
| Availability: | Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare |
| Peer Reviewed: | Y |
| Page Count: | 23 |
| Publication Date: | 2016 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Guessing (Tests), Multiple Choice Tests, Case Studies, Test Construction, Test Validity, Probability, Educational Assessment, Test Items, Scoring, Standard Setting (Scoring) |
| ISSN: | 1531-7714 |
| Abstract: | There is always a chance that examinees will answer multiple choice (MC) items correctly by guessing. Design choices in some modern exams have created situations where guessing at random through the full exam--rather than only for a subset of items where the examinee does not know the answer--can be an effective strategy to pass the exam. This paper describes two case studies to illustrate this problem, discusses test development decisions that can help address the situation, and provides recommendations to testing professionals to help identify when guessing at random can be an effective strategy to pass the exam. |
| Abstractor: | As Provided |
| Entry Date: | 2016 |
| Accession Number: | EJ1091824 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1091824 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1091824 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Getting Lucky: How Guessing Threatens the Validity of Performance Classifications – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Foley%2C+Brett+P%2E%22">Foley, Brett P.</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Practical+Assessment%2C+Research+%26+Evaluation%22"><i>Practical Assessment, Research & Evaluation</i></searchLink>. Feb 2016 21(3). – Name: Avail Label: Availability Group: Avail Data: Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 23 – Name: DatePubCY Label: Publication Date Group: Date Data: 2016 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Guessing+%28Tests%29%22">Guessing (Tests)</searchLink><br /><searchLink fieldCode="DE" term="%22Multiple+Choice+Tests%22">Multiple Choice Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Case+Studies%22">Case Studies</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Probability%22">Probability</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Assessment%22">Educational Assessment</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring%22">Scoring</searchLink><br /><searchLink fieldCode="DE" term="%22Standard+Setting+%28Scoring%29%22">Standard Setting (Scoring)</searchLink> – Name: ISSN Label: ISSN Group: ISSN Data: 1531-7714 – Name: Abstract Label: Abstract Group: Ab Data: There is always a chance that examinees will answer multiple choice (MC) items correctly by guessing. Design choices in some modern exams have created situations where guessing at random through the full exam--rather than only for a subset of items where the examinee does not know the answer--can be an effective strategy to pass the exam. This paper describes two case studies to illustrate this problem, discusses test development decisions that can help address the situation, and provides recommendations to testing professionals to help identify when guessing at random can be an effective strategy to pass the exam. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2016 – Name: AN Label: Accession Number Group: ID Data: EJ1091824 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1091824 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 23 Subjects: – SubjectFull: Guessing (Tests) Type: general – SubjectFull: Multiple Choice Tests Type: general – SubjectFull: Case Studies Type: general – SubjectFull: Test Construction Type: general – SubjectFull: Test Validity Type: general – SubjectFull: Probability Type: general – SubjectFull: Educational Assessment Type: general – SubjectFull: Test Items Type: general – SubjectFull: Scoring Type: general – SubjectFull: Standard Setting (Scoring) Type: general Titles: – TitleFull: Getting Lucky: How Guessing Threatens the Validity of Performance Classifications Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Foley, Brett P. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 02 Type: published Y: 2016 Identifiers: – Type: issn-electronic Value: 1531-7714 Numbering: – Type: volume Value: 21 – Type: issue Value: 3 Titles: – TitleFull: Practical Assessment, Research & Evaluation Type: main |
| ResultId | 1 |
