Operationalizing a Weighted Performance Scoring Model for Sustainable e-Learning in Medical Education: Insights from Expert Judgement.
Saved in:
| Title: | Operationalizing a Weighted Performance Scoring Model for Sustainable e-Learning in Medical Education: Insights from Expert Judgement. |
|---|---|
| Authors: | Oluwadele, Deborah1,2 deborah.oluwadele@up.ac.za, Singh, Yashik1 singhy@ukzn.ac.za, Adeliyi, Timothy2 timothy.adeliyi@up.ac.za |
| Source: | Electronic Journal of e-Learning. 2024, Vol. 22 Issue 8, p24-40. 17p. |
| Subject Terms: | *Assessment of education, *Medical education, *Digital learning, Cronbach's alpha, Judgment (Psychology) |
| Abstract: | Validation is needed for any newly developed model or framework because it requires several real-life applications. The investment made into e-learning in medical education is daunting, as is the expectation for a positive return on investment. The medical education domain requires data-wise implementation of e-learning as the debate continues about the fitness of e-learning in medical education. The domain seldom employs frameworks or models to evaluate students' performance in e-learning contexts. However, when utilized, the Kirkpatrick evaluation model is a common choice. This model has faced significant criticism for its failure to incorporate constructs that assess technology and its influence on learning. This paper aims to assess the efficiency of a model developed to determine the effectiveness of e-learning in medical education, specifically targeting student performance. The model was validated through Delphi-based Expert Judgement Techniques (EJT), and Cronbach's alpha was used to determine the reliability of the proposed model. Simple Correspondence Analysis (SCA) was used to measure if stability is reached among experts. Fourteen experts, professors, senior lecturers, and researchers with an average of 12 years of experience in designing and evaluating students' performance in e-learning in medical education participated in the evaluation of the model based on two rounds of questionnaires developed to operationalize the constructs of the model. During the first round, the model had 64 % agreement from all experts; however, 100% agreement was achieved after the second round, with all statements achieving an average of 52% strong agreement and 48% agreement from all 14 experts; the evaluation dimension had the most substantial agreements, next to the design dimension. The results suggest that the model is valid and may be applied as Key Performance Metrics when designing and evaluating e-learning courses in medical education. [ABSTRACT FROM AUTHOR] |
| Copyright of Electronic Journal of e-Learning is the property of Academic Conferences & Publishing International Ltd. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 178757605 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Operationalizing a Weighted Performance Scoring Model for Sustainable e-Learning in Medical Education: Insights from Expert Judgement. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Oluwadele%2C+Deborah%22">Oluwadele, Deborah</searchLink><relatesTo>1,2</relatesTo><i> deborah.oluwadele@up.ac.za</i><br /><searchLink fieldCode="AR" term="%22Singh%2C+Yashik%22">Singh, Yashik</searchLink><relatesTo>1</relatesTo><i> singhy@ukzn.ac.za</i><br /><searchLink fieldCode="AR" term="%22Adeliyi%2C+Timothy%22">Adeliyi, Timothy</searchLink><relatesTo>2</relatesTo><i> timothy.adeliyi@up.ac.za</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Electronic+Journal+of+e-Learning%22">Electronic Journal of e-Learning</searchLink>. 2024, Vol. 22 Issue 8, p24-40. 17p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Assessment+of+education%22">Assessment of education</searchLink><br />*<searchLink fieldCode="DE" term="%22Medical+education%22">Medical education</searchLink><br />*<searchLink fieldCode="DE" term="%22Digital+learning%22">Digital learning</searchLink><br /><searchLink fieldCode="DE" term="%22Cronbach's+alpha%22">Cronbach's alpha</searchLink><br /><searchLink fieldCode="DE" term="%22Judgment+%28Psychology%29%22">Judgment (Psychology)</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Validation is needed for any newly developed model or framework because it requires several real-life applications. The investment made into e-learning in medical education is daunting, as is the expectation for a positive return on investment. The medical education domain requires data-wise implementation of e-learning as the debate continues about the fitness of e-learning in medical education. The domain seldom employs frameworks or models to evaluate students' performance in e-learning contexts. However, when utilized, the Kirkpatrick evaluation model is a common choice. This model has faced significant criticism for its failure to incorporate constructs that assess technology and its influence on learning. This paper aims to assess the efficiency of a model developed to determine the effectiveness of e-learning in medical education, specifically targeting student performance. The model was validated through Delphi-based Expert Judgement Techniques (EJT), and Cronbach's alpha was used to determine the reliability of the proposed model. Simple Correspondence Analysis (SCA) was used to measure if stability is reached among experts. Fourteen experts, professors, senior lecturers, and researchers with an average of 12 years of experience in designing and evaluating students' performance in e-learning in medical education participated in the evaluation of the model based on two rounds of questionnaires developed to operationalize the constructs of the model. During the first round, the model had 64 % agreement from all experts; however, 100% agreement was achieved after the second round, with all statements achieving an average of 52% strong agreement and 48% agreement from all 14 experts; the evaluation dimension had the most substantial agreements, next to the design dimension. The results suggest that the model is valid and may be applied as Key Performance Metrics when designing and evaluating e-learning courses in medical education. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Electronic Journal of e-Learning is the property of Academic Conferences & Publishing International Ltd. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=178757605 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.34190/ejel.22.8.3427 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 17 StartPage: 24 Subjects: – SubjectFull: Assessment of education Type: general – SubjectFull: Medical education Type: general – SubjectFull: Digital learning Type: general – SubjectFull: Cronbach's alpha Type: general – SubjectFull: Judgment (Psychology) Type: general Titles: – TitleFull: Operationalizing a Weighted Performance Scoring Model for Sustainable e-Learning in Medical Education: Insights from Expert Judgement. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Oluwadele, Deborah – PersonEntity: Name: NameFull: Singh, Yashik – PersonEntity: Name: NameFull: Adeliyi, Timothy IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 12 Text: 2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 14794403 Numbering: – Type: volume Value: 22 – Type: issue Value: 8 Titles: – TitleFull: Electronic Journal of e-Learning Type: main |
| ResultId | 1 |
