Student Ratings and Course Modalities: A Small Study in a Large Context.
Saved in:
| Title: | Student Ratings and Course Modalities: A Small Study in a Large Context. |
|---|---|
| Authors: | Dziuban, Charles1, Moskal, Patsy1, Reiner, Annette1, Cohen, Adysen1 |
| Source: | Online Learning. Sep2023, Vol. 27 Issue 3, p70-103. 34p. |
| Subject Terms: | *Student evaluation of teachers, *Psychology of students, *COVID-19 pandemic, Multidimensional scaling |
| Company/Entity: | University of Central Florida |
| Abstract: | This article examines the impact of course modality on student evaluation of courses and professors. Data were collected through the Student Perception of Instruction end of course rating form at the University of Central Florida (UCF), which contains nine items and maintains student anonymity. The findings indicate that while course modality accounts for only 1% of the variance in student evaluations, there is strong internal consistency and reliability in the rating scale. The distribution of ratings showed a concentration of scores at the high end, resulting in a high variability coefficient. However, when the long tail of low ratings was removed, the mean increased and the distribution became more symmetric, affecting various psychometric indices. The correlation matrices among the items revealed a single factor solution for each modality, suggesting that students tend to rely on a general impression when rating their courses. The multidimensional scaling process identified underlying categories such as structure, course climate, engagement, and consideration, even though students did not explicitly differentiate these elements in their responses. The study concludes that course modality has minimal influence on overall student ratings, a finding consistent across different time periods, including the COVID-19 pandemic. Although a single factor captures students' general evaluations, underlying categories shape their responses. The article also presents a classification model that predicts student ratings based on the scale items. This research addresses the complex dynamics of student evaluations, highlighting the nuanced relationship between course modality, student perceptions, and the underlying factors influencing their ratings. [ABSTRACT FROM AUTHOR] |
| Copyright of Online Learning is the property of Online Learning Consortium and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 172788973 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Student Ratings and Course Modalities: A Small Study in a Large Context. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Dziuban%2C+Charles%22">Dziuban, Charles</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Moskal%2C+Patsy%22">Moskal, Patsy</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Reiner%2C+Annette%22">Reiner, Annette</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Cohen%2C+Adysen%22">Cohen, Adysen</searchLink><relatesTo>1</relatesTo> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Online+Learning%22">Online Learning</searchLink>. Sep2023, Vol. 27 Issue 3, p70-103. 34p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Student+evaluation+of+teachers%22">Student evaluation of teachers</searchLink><br />*<searchLink fieldCode="DE" term="%22Psychology+of+students%22">Psychology of students</searchLink><br />*<searchLink fieldCode="DE" term="%22COVID-19+pandemic%22">COVID-19 pandemic</searchLink><br /><searchLink fieldCode="DE" term="%22Multidimensional+scaling%22">Multidimensional scaling</searchLink> – Name: SubjectCompany Label: Company/Entity Group: Su Data: <searchLink fieldCode="DE" term="%22University+of+Central+Florida%22">University of Central Florida</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: This article examines the impact of course modality on student evaluation of courses and professors. Data were collected through the Student Perception of Instruction end of course rating form at the University of Central Florida (UCF), which contains nine items and maintains student anonymity. The findings indicate that while course modality accounts for only 1% of the variance in student evaluations, there is strong internal consistency and reliability in the rating scale. The distribution of ratings showed a concentration of scores at the high end, resulting in a high variability coefficient. However, when the long tail of low ratings was removed, the mean increased and the distribution became more symmetric, affecting various psychometric indices. The correlation matrices among the items revealed a single factor solution for each modality, suggesting that students tend to rely on a general impression when rating their courses. The multidimensional scaling process identified underlying categories such as structure, course climate, engagement, and consideration, even though students did not explicitly differentiate these elements in their responses. The study concludes that course modality has minimal influence on overall student ratings, a finding consistent across different time periods, including the COVID-19 pandemic. Although a single factor captures students' general evaluations, underlying categories shape their responses. The article also presents a classification model that predicts student ratings based on the scale items. This research addresses the complex dynamics of student evaluations, highlighting the nuanced relationship between course modality, student perceptions, and the underlying factors influencing their ratings. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Online Learning is the property of Online Learning Consortium and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=172788973 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.24059/olj.v27i3.4053 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 34 StartPage: 70 Subjects: – SubjectFull: Student evaluation of teachers Type: general – SubjectFull: Psychology of students Type: general – SubjectFull: COVID-19 pandemic Type: general – SubjectFull: Multidimensional scaling Type: general – SubjectFull: University of Central Florida Type: general Titles: – TitleFull: Student Ratings and Course Modalities: A Small Study in a Large Context. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Dziuban, Charles – PersonEntity: Name: NameFull: Moskal, Patsy – PersonEntity: Name: NameFull: Reiner, Annette – PersonEntity: Name: NameFull: Cohen, Adysen IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 09 Text: Sep2023 Type: published Y: 2023 Identifiers: – Type: issn-print Value: 24725749 Numbering: – Type: volume Value: 27 – Type: issue Value: 3 Titles: – TitleFull: Online Learning Type: main |
| ResultId | 1 |