Student Ratings and Course Modalities: A Small Study in a Large Context.

Saved in:
Bibliographic Details
Title: Student Ratings and Course Modalities: A Small Study in a Large Context.
Authors: Dziuban, Charles1, Moskal, Patsy1, Reiner, Annette1, Cohen, Adysen1
Source: Online Learning. Sep2023, Vol. 27 Issue 3, p70-103. 34p.
Subject Terms: *Student evaluation of teachers, *Psychology of students, *COVID-19 pandemic, Multidimensional scaling
Company/Entity: University of Central Florida
Abstract: This article examines the impact of course modality on student evaluation of courses and professors. Data were collected through the Student Perception of Instruction end of course rating form at the University of Central Florida (UCF), which contains nine items and maintains student anonymity. The findings indicate that while course modality accounts for only 1% of the variance in student evaluations, there is strong internal consistency and reliability in the rating scale. The distribution of ratings showed a concentration of scores at the high end, resulting in a high variability coefficient. However, when the long tail of low ratings was removed, the mean increased and the distribution became more symmetric, affecting various psychometric indices. The correlation matrices among the items revealed a single factor solution for each modality, suggesting that students tend to rely on a general impression when rating their courses. The multidimensional scaling process identified underlying categories such as structure, course climate, engagement, and consideration, even though students did not explicitly differentiate these elements in their responses. The study concludes that course modality has minimal influence on overall student ratings, a finding consistent across different time periods, including the COVID-19 pandemic. Although a single factor captures students' general evaluations, underlying categories shape their responses. The article also presents a classification model that predicts student ratings based on the scale items. This research addresses the complex dynamics of student evaluations, highlighting the nuanced relationship between course modality, student perceptions, and the underlying factors influencing their ratings. [ABSTRACT FROM AUTHOR]
Copyright of Online Learning is the property of Online Learning Consortium and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 172788973
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Student Ratings and Course Modalities: A Small Study in a Large Context.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Dziuban%2C+Charles%22">Dziuban, Charles</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Moskal%2C+Patsy%22">Moskal, Patsy</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Reiner%2C+Annette%22">Reiner, Annette</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Cohen%2C+Adysen%22">Cohen, Adysen</searchLink><relatesTo>1</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Online+Learning%22">Online Learning</searchLink>. Sep2023, Vol. 27 Issue 3, p70-103. 34p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Student+evaluation+of+teachers%22">Student evaluation of teachers</searchLink><br />*<searchLink fieldCode="DE" term="%22Psychology+of+students%22">Psychology of students</searchLink><br />*<searchLink fieldCode="DE" term="%22COVID-19+pandemic%22">COVID-19 pandemic</searchLink><br /><searchLink fieldCode="DE" term="%22Multidimensional+scaling%22">Multidimensional scaling</searchLink>
– Name: SubjectCompany
  Label: Company/Entity
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22University+of+Central+Florida%22">University of Central Florida</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This article examines the impact of course modality on student evaluation of courses and professors. Data were collected through the Student Perception of Instruction end of course rating form at the University of Central Florida (UCF), which contains nine items and maintains student anonymity. The findings indicate that while course modality accounts for only 1% of the variance in student evaluations, there is strong internal consistency and reliability in the rating scale. The distribution of ratings showed a concentration of scores at the high end, resulting in a high variability coefficient. However, when the long tail of low ratings was removed, the mean increased and the distribution became more symmetric, affecting various psychometric indices. The correlation matrices among the items revealed a single factor solution for each modality, suggesting that students tend to rely on a general impression when rating their courses. The multidimensional scaling process identified underlying categories such as structure, course climate, engagement, and consideration, even though students did not explicitly differentiate these elements in their responses. The study concludes that course modality has minimal influence on overall student ratings, a finding consistent across different time periods, including the COVID-19 pandemic. Although a single factor captures students' general evaluations, underlying categories shape their responses. The article also presents a classification model that predicts student ratings based on the scale items. This research addresses the complex dynamics of student evaluations, highlighting the nuanced relationship between course modality, student perceptions, and the underlying factors influencing their ratings. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Online Learning is the property of Online Learning Consortium and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=172788973
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.24059/olj.v27i3.4053
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 34
        StartPage: 70
    Subjects:
      – SubjectFull: Student evaluation of teachers
        Type: general
      – SubjectFull: Psychology of students
        Type: general
      – SubjectFull: COVID-19 pandemic
        Type: general
      – SubjectFull: Multidimensional scaling
        Type: general
      – SubjectFull: University of Central Florida
        Type: general
    Titles:
      – TitleFull: Student Ratings and Course Modalities: A Small Study in a Large Context.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Dziuban, Charles
      – PersonEntity:
          Name:
            NameFull: Moskal, Patsy
      – PersonEntity:
          Name:
            NameFull: Reiner, Annette
      – PersonEntity:
          Name:
            NameFull: Cohen, Adysen
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Text: Sep2023
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-print
              Value: 24725749
          Numbering:
            – Type: volume
              Value: 27
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Online Learning
              Type: main
ResultId 1