Validation of a Peer Observation and Evaluation Tool for Online Teaching in the U.S.

Saved in:
Bibliographic Details
Title: Validation of a Peer Observation and Evaluation Tool for Online Teaching in the U.S.
Language: English
Authors: Yuane Jia (ORCID 0000-0002-1792-0431), Amy B. Spagnolo, Nora Barrett, Ann A. Murphy, Peter M. Basto, Pamela Rothpletz-Puglia, Stuart Luther
Source: Educational Technology Research and Development. 2025 73(1):615-639.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 25
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Tests/Questionnaires
Education Level: Higher Education
Postsecondary Education
Descriptors: Higher Education, Peer Evaluation, Lesson Observation Criteria, Test Construction, Test Reliability, Test Validity, Online Courses, Teacher Evaluation, Electronic Learning, Health Education, Teacher Effectiveness
DOI: 10.1007/s11423-024-10428-z
ISSN: 1042-1629
1556-6501
Abstract: The benefits of peer evaluation of teaching effectiveness and quality in higher education are well documented. While instruments exist for the review and evaluation of entire online courses, there is no standardized single-lesson, peer evaluation instrument available for online instruction. This pilot study focused on the validation of a peer observation and evaluation tool for use with single lessons in both synchronous and asynchronous online courses in an inter-professional school of health professions. The researchers modified a psychometrically validated instrument developed for in-person peer observation by adding items from a renowned online course rubric to create a peer observation tool, entitled the Peer Observation and Evaluation Tool-Online (POET-O). The resulting instrument demonstrated adequate construct validity and reliability by using the many-facet Rasch measurement (MFRM) technique. MFRM results also indicated potential places to revise and improve the instrument. Recommendations for implementing the peer evaluation process of teaching are provided.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1462806
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:The benefits of peer evaluation of teaching effectiveness and quality in higher education are well documented. While instruments exist for the review and evaluation of entire online courses, there is no standardized single-lesson, peer evaluation instrument available for online instruction. This pilot study focused on the validation of a peer observation and evaluation tool for use with single lessons in both synchronous and asynchronous online courses in an inter-professional school of health professions. The researchers modified a psychometrically validated instrument developed for in-person peer observation by adding items from a renowned online course rubric to create a peer observation tool, entitled the Peer Observation and Evaluation Tool-Online (POET-O). The resulting instrument demonstrated adequate construct validity and reliability by using the many-facet Rasch measurement (MFRM) technique. MFRM results also indicated potential places to revise and improve the instrument. Recommendations for implementing the peer evaluation process of teaching are provided.
ISSN:1042-1629
1556-6501
DOI:10.1007/s11423-024-10428-z