Evaluating College Students' Evaluations of a Professor's Teaching Effectiveness across Time and Instruction Mode (Online vs. Face-to-Face) Using a Multilevel Growth Modeling Approach
Saved in:
| Title: | Evaluating College Students' Evaluations of a Professor's Teaching Effectiveness across Time and Instruction Mode (Online vs. Face-to-Face) Using a Multilevel Growth Modeling Approach |
|---|---|
| Language: | English |
| Authors: | Carle, Adam C. |
| Source: | Computers & Education. Sep 2009 53(2):429-435. |
| Availability: | Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com |
| Peer Reviewed: | Y |
| Physical Description: | |
| Page Count: | 7 |
| Publication Date: | 2009 |
| Document Type: | Journal Articles Reports - Evaluative |
| Descriptors: | College Students, Student Evaluation of Teacher Performance, Online Courses, Correlation, Minority Group Teachers, Teaching Methods, Synchronous Communication, Higher Education, Teacher Effectiveness, Electronic Learning, College Faculty, Models, Classification, Tenure |
| DOI: | 10.1016/j.compedu.2009.03.001 |
| ISSN: | 0360-1315 |
| Abstract: | Aims: Do college students' ratings of a professor's teaching effectiveness suggest that a professor's teaching improves with time? Does anything predict which instructors receive the highest ratings or improve the fastest? And, importantly, do the correlates of change differ across face-to-face and online courses? Methods: I used data from 10,392 classes taught by 1120 instructors across three years and fit a taxonomy of multilevel growth models to examine whether students' ratings of teaching effectiveness (SETEs) changed across time, whether differences in average SETEs correlated with growth, and whether online vs. face-to-face, tenure, discipline, course level, sex, or minority status affected these estimates. Results: SETEs remained relatively stable across time and teachers, although analyses uncovered a statistically significant, negative correlation between initial status and growth. Instructors starting with lower SETEs improved the fastest. These findings held across online and face-to-face instruction modes. However, in face-to-face classes, minority instructors received significantly lower average SETEs. This difference did not occur in online classes. No other predictors showed statistically significant effects. Finally, considerable SETE variance remained unexplained even when including the full predictor set in the model. Discussion: These findings reveal that professors' SETEs can improve. Additionally, they indicate that patterns of change in teaching effectiveness do not differ generally across online and face-to-face instruction modes. However, the results showed that minority teachers in face-to-face but "not" online classes received lower evaluations than their majority counterparts. Additional research should seek to understand what leads to SETE differences across minority and majority groups in face-to-face classes but "not" online classes. (Contains 1 table.) |
| Abstractor: | As Provided |
| Entry Date: | 2009 |
| Accession Number: | EJ842994 |
| Database: | ERIC |
| Abstract: | Aims: Do college students' ratings of a professor's teaching effectiveness suggest that a professor's teaching improves with time? Does anything predict which instructors receive the highest ratings or improve the fastest? And, importantly, do the correlates of change differ across face-to-face and online courses? Methods: I used data from 10,392 classes taught by 1120 instructors across three years and fit a taxonomy of multilevel growth models to examine whether students' ratings of teaching effectiveness (SETEs) changed across time, whether differences in average SETEs correlated with growth, and whether online vs. face-to-face, tenure, discipline, course level, sex, or minority status affected these estimates. Results: SETEs remained relatively stable across time and teachers, although analyses uncovered a statistically significant, negative correlation between initial status and growth. Instructors starting with lower SETEs improved the fastest. These findings held across online and face-to-face instruction modes. However, in face-to-face classes, minority instructors received significantly lower average SETEs. This difference did not occur in online classes. No other predictors showed statistically significant effects. Finally, considerable SETE variance remained unexplained even when including the full predictor set in the model. Discussion: These findings reveal that professors' SETEs can improve. Additionally, they indicate that patterns of change in teaching effectiveness do not differ generally across online and face-to-face instruction modes. However, the results showed that minority teachers in face-to-face but "not" online classes received lower evaluations than their majority counterparts. Additional research should seek to understand what leads to SETE differences across minority and majority groups in face-to-face classes but "not" online classes. (Contains 1 table.) |
|---|---|
| ISSN: | 0360-1315 |
| DOI: | 10.1016/j.compedu.2009.03.001 |
