Enhancing Rubric Development in Science Education through Topic Modeling Techniques.

Saved in:
Bibliographic Details
Title: Enhancing Rubric Development in Science Education through Topic Modeling Techniques.
Authors: Hong, Minju (AUTHOR), You, Hyesun (AUTHOR)
Source: Journal of Experimental Education. 2026, Vol. 94 Issue 2, p347-364. 18p.
Subjects: Science education, Scoring rubrics, Evaluation methodology, Evaluators, Latent semantic analysis, Text mining, Educational evaluation, Quantitative research
Abstract: Content experts conduct traditional approaches to developing rubrics for constructed response (CR) items, which is a labor-intensive process. We aim to illustrate the potential benefits of utilizing topic modeling techniques to improve the efficiency of the rubric workload. The results of this study reveal that over half of the keywords in the rubric corresponded with the top 20 words extracted from the supervised latent Dirichlet allocation (sLDA) model. The rubric-based scores assigned by human raters showed medium-to-high associations with the sLDA-predicted scores. The sLDA approach offers supporting evidence for refining the rubric concerning criteria for word usage and score assignments. It accomplishes this by concurrently incorporating the predetermined rubric of content experts and the actual responses provided by students. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Experimental Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 191332437
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Enhancing Rubric Development in Science Education through Topic Modeling Techniques.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Hong%2C+Minju%22">Hong, Minju</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22You%2C+Hyesun%22">You, Hyesun</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Experimental+Education%22">Journal of Experimental Education</searchLink>. 2026, Vol. 94 Issue 2, p347-364. 18p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Science+education%22">Science education</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring+rubrics%22">Scoring rubrics</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+methodology%22">Evaluation methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluators%22">Evaluators</searchLink><br /><searchLink fieldCode="DE" term="%22Latent+semantic+analysis%22">Latent semantic analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Text+mining%22">Text mining</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+evaluation%22">Educational evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Quantitative+research%22">Quantitative research</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Content experts conduct traditional approaches to developing rubrics for constructed response (CR) items, which is a labor-intensive process. We aim to illustrate the potential benefits of utilizing topic modeling techniques to improve the efficiency of the rubric workload. The results of this study reveal that over half of the keywords in the rubric corresponded with the top 20 words extracted from the supervised latent Dirichlet allocation (sLDA) model. The rubric-based scores assigned by human raters showed medium-to-high associations with the sLDA-predicted scores. The sLDA approach offers supporting evidence for refining the rubric concerning criteria for word usage and score assignments. It accomplishes this by concurrently incorporating the predetermined rubric of content experts and the actual responses provided by students. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Experimental Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=191332437
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/00220973.2024.2329094
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 347
    Subjects:
      – SubjectFull: Science education
        Type: general
      – SubjectFull: Scoring rubrics
        Type: general
      – SubjectFull: Evaluation methodology
        Type: general
      – SubjectFull: Evaluators
        Type: general
      – SubjectFull: Latent semantic analysis
        Type: general
      – SubjectFull: Text mining
        Type: general
      – SubjectFull: Educational evaluation
        Type: general
      – SubjectFull: Quantitative research
        Type: general
    Titles:
      – TitleFull: Enhancing Rubric Development in Science Education through Topic Modeling Techniques.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Hong, Minju
      – PersonEntity:
          Name:
            NameFull: You, Hyesun
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Text: 2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 00220973
          Numbering:
            – Type: volume
              Value: 94
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Journal of Experimental Education
              Type: main
ResultId 1