View in EDS

Evaluation of Exam Questions Using Bootstrapping: Practical Applications in R and SPSS with a Case Study

Saved in:
Bibliographic Details
Title: Evaluation of Exam Questions Using Bootstrapping: Practical Applications in R and SPSS with a Case Study
Language: English
Authors: Changiz Mohiyeddini
Source: Anatomical Sciences Education. 2025 18(8):858-880.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 23
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Descriptors: Test Items, Sampling, Statistical Inference, Nonparametric Statistics, Difficulty Level, Correlation, Test Construction
DOI: 10.1002/ase.70082
ISSN: 1935-9772
1935-9780
Abstract: This article presents a step-by-step guide to using R and SPSS to bootstrap exam questions. Bootstrapping, a versatile nonparametric analytical technique, can help to improve the psychometric qualities of exam questions in the process of quality assurance. Bootstrapping is particularly useful in disciplines such as medical education, where student cohorts are normally too small to reliably use parametric analysis to evaluate the quality of exam questions. Traditional parametric approaches need large samples; otherwise, they can yield unreliable estimates of metrics such as item difficulty and point-biserial correlations with small cohorts, potentially misleading the evaluation of exam questions and consequently leading to flawed assessments. By employing bootstrapping, educators can resample data to obtain robust confidence intervals for key metrics. This allows for a more accurate evaluation of question quality. This guide provides a step-by-step approach using R and SPSS, along with explaining the necessary code to bootstrap exam question means, standard deviations, item difficulty, and point-biserial correlations. In addition, the code includes automated visualizations and the capability to export results in reader-friendly tables, enhancing time efficiency and streamlining both data analysis and presentation processes. Furthermore, this article includes a case study in which the code is applied and the results are discussed to showcase how bootstrapping can inform decisions regarding exam question revisions.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1478968
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1478968
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Evaluation of Exam Questions Using Bootstrapping: Practical Applications in R and SPSS with a Case Study
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Changiz+Mohiyeddini%22">Changiz Mohiyeddini</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Anatomical+Sciences+Education%22"><i>Anatomical Sciences Education</i></searchLink>. 2025 18(8):858-880.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 23
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Sampling%22">Sampling</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Inference%22">Statistical Inference</searchLink><br /><searchLink fieldCode="DE" term="%22Nonparametric+Statistics%22">Nonparametric Statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Difficulty+Level%22">Difficulty Level</searchLink><br /><searchLink fieldCode="DE" term="%22Correlation%22">Correlation</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1002/ase.70082
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1935-9772<br />1935-9780
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This article presents a step-by-step guide to using R and SPSS to bootstrap exam questions. Bootstrapping, a versatile nonparametric analytical technique, can help to improve the psychometric qualities of exam questions in the process of quality assurance. Bootstrapping is particularly useful in disciplines such as medical education, where student cohorts are normally too small to reliably use parametric analysis to evaluate the quality of exam questions. Traditional parametric approaches need large samples; otherwise, they can yield unreliable estimates of metrics such as item difficulty and point-biserial correlations with small cohorts, potentially misleading the evaluation of exam questions and consequently leading to flawed assessments. By employing bootstrapping, educators can resample data to obtain robust confidence intervals for key metrics. This allows for a more accurate evaluation of question quality. This guide provides a step-by-step approach using R and SPSS, along with explaining the necessary code to bootstrap exam question means, standard deviations, item difficulty, and point-biserial correlations. In addition, the code includes automated visualizations and the capability to export results in reader-friendly tables, enhancing time efficiency and streamlining both data analysis and presentation processes. Furthermore, this article includes a case study in which the code is applied and the results are discussed to showcase how bootstrapping can inform decisions regarding exam question revisions.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1478968
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1478968
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1002/ase.70082
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 23
        StartPage: 858
    Subjects:
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Sampling
        Type: general
      – SubjectFull: Statistical Inference
        Type: general
      – SubjectFull: Nonparametric Statistics
        Type: general
      – SubjectFull: Difficulty Level
        Type: general
      – SubjectFull: Correlation
        Type: general
      – SubjectFull: Test Construction
        Type: general
    Titles:
      – TitleFull: Evaluation of Exam Questions Using Bootstrapping: Practical Applications in R and SPSS with a Case Study
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Changiz Mohiyeddini
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 1935-9772
            – Type: issn-electronic
              Value: 1935-9780
          Numbering:
            – Type: volume
              Value: 18
            – Type: issue
              Value: 8
          Titles:
            – TitleFull: Anatomical Sciences Education
              Type: main
ResultId 1