Harnessing predictive analytics to support high-risk learners in a one-year certification program in emergency medicine (CPEM) in Pakistan.

Saved in:
Bibliographic Details
Title: Harnessing predictive analytics to support high-risk learners in a one-year certification program in emergency medicine (CPEM) in Pakistan.
Authors: Ali, Saima1 (AUTHOR) saima.ali13@tih.org.pk, Saleem, Syed Ghazanfar1 (AUTHOR), Arumuganathan, Priya2 (AUTHOR), Mukhtar, Sama1 (AUTHOR), Khatri, Adeel1 (AUTHOR), Rybarczyk, Megan2 (AUTHOR)
Source: Medical Teacher. Jan2026, Vol. 48 Issue 1, p142-149. 8p.
Subject Terms: *Student assistance programs, *Predictive tests, *Educational outcomes, *Continuing medical education, *Professional licensure examinations, *Educational tests & measurements, *Retrospective studies, *Certification, *Longitudinal method, *Academic achievement, *Machine learning, *Learning strategies, *Learning disabilities, Prediction models, Receiver operating characteristic curves, Evaluation of human services programs, Questionnaires, Emergency medicine, Descriptive statistics, Structural equation modeling, Emergency medical services education, Medical records, Acquisition of data, Data analysis software, Sensitivity & specificity (Statistics), Regression analysis
Geographic Terms: Pakistan
Abstract: Introduction: Predictive analytics and Machine Learning (PAML) are gaining traction in health professions education (HPE). Their utilization includes, but is not limited to, guiding student enrollment, identifying at-risk learners, enhancing educational decisions, and allocating proper resources through data-driven insights. This study explored the use of PAML to identify at-risk learners in a one-year Certification Program in Emergency Medicine (CPEM) at the Indus Hospital and Health Network (IHHN), Pakistan with the aim of providing targeted educational support for improved outcome. Methodology: By leveraging data from prior CPEM cohorts (2018–2022, n = 91), regression tree and linear regression machine learning models were compared to predict the final examination performance of the CPEM 2023 learner cohort (n = 26). The models were prospectively applied to identify at-risk learners (n = 14/26). Extra learning support (ELS) was offered as an inclusive measure to everyone, not just the ones flagged by the models and was accepted by ten learners. Data were analyzed for model accuracy and the impact of the educational intervention. Results: Both models showed high accuracy (regression tree: Area Under the Receiver Operating Characteristic (ROC) Curve (AUC)= 0.89; linear regression: AUC= 0.88), though the regression tree model demonstrated slightly better sensitivity and specificity. The models altogether predicted unsatisfactory performance for 14 learners scheduled to sit for the 2023 final examination. Following targeted intervention, eight learners showed improvement in their final scores. Regression tree model was comparatively better in making predictions; however, both models had their limitation. Conclusion: The study demonstrated the feasibility and utility of using PAML to identify at-risk learners and tailor support strategies for enhancing educational outcome in low-resource settings. This additional support can augment expert judgement and ensure equitable educational practices. However, model limitations and ethical concerns, such as algorithmic bias, overfitting, and data imbalance, must be actively addressed in high-stakes assessments. Practice points Predictive analytics and machine learning (PAML) can be used to generate early, data-informed signals that support proactive intervention. Machine learning algorithms capture complex, non-linear relationships between learner characteristics. Real time data integration and faculty feedback can enhance model accuracy. Ethical, inclusive, and targeted interventions provide tailored learning support. Bias mitigation and regular model validation ensure maximal utilization of limited resources. [ABSTRACT FROM AUTHOR]
Copyright of Medical Teacher is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 190717580
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Harnessing predictive analytics to support high-risk learners in a one-year certification program in emergency medicine (CPEM) in Pakistan.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ali%2C+Saima%22">Ali, Saima</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> saima.ali13@tih.org.pk</i><br /><searchLink fieldCode="AR" term="%22Saleem%2C+Syed+Ghazanfar%22">Saleem, Syed Ghazanfar</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Arumuganathan%2C+Priya%22">Arumuganathan, Priya</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Mukhtar%2C+Sama%22">Mukhtar, Sama</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Khatri%2C+Adeel%22">Khatri, Adeel</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Rybarczyk%2C+Megan%22">Rybarczyk, Megan</searchLink><relatesTo>2</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Medical+Teacher%22">Medical Teacher</searchLink>. Jan2026, Vol. 48 Issue 1, p142-149. 8p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Student+assistance+programs%22">Student assistance programs</searchLink><br />*<searchLink fieldCode="DE" term="%22Predictive+tests%22">Predictive tests</searchLink><br />*<searchLink fieldCode="DE" term="%22Educational+outcomes%22">Educational outcomes</searchLink><br />*<searchLink fieldCode="DE" term="%22Continuing+medical+education%22">Continuing medical education</searchLink><br />*<searchLink fieldCode="DE" term="%22Professional+licensure+examinations%22">Professional licensure examinations</searchLink><br />*<searchLink fieldCode="DE" term="%22Educational+tests+%26+measurements%22">Educational tests & measurements</searchLink><br />*<searchLink fieldCode="DE" term="%22Retrospective+studies%22">Retrospective studies</searchLink><br />*<searchLink fieldCode="DE" term="%22Certification%22">Certification</searchLink><br />*<searchLink fieldCode="DE" term="%22Longitudinal+method%22">Longitudinal method</searchLink><br />*<searchLink fieldCode="DE" term="%22Academic+achievement%22">Academic achievement</searchLink><br />*<searchLink fieldCode="DE" term="%22Machine+learning%22">Machine learning</searchLink><br />*<searchLink fieldCode="DE" term="%22Learning+strategies%22">Learning strategies</searchLink><br />*<searchLink fieldCode="DE" term="%22Learning+disabilities%22">Learning disabilities</searchLink><br /><searchLink fieldCode="DE" term="%22Prediction+models%22">Prediction models</searchLink><br /><searchLink fieldCode="DE" term="%22Receiver+operating+characteristic+curves%22">Receiver operating characteristic curves</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+of+human+services+programs%22">Evaluation of human services programs</searchLink><br /><searchLink fieldCode="DE" term="%22Questionnaires%22">Questionnaires</searchLink><br /><searchLink fieldCode="DE" term="%22Emergency+medicine%22">Emergency medicine</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Structural+equation+modeling%22">Structural equation modeling</searchLink><br /><searchLink fieldCode="DE" term="%22Emergency+medical+services+education%22">Emergency medical services education</searchLink><br /><searchLink fieldCode="DE" term="%22Medical+records%22">Medical records</searchLink><br /><searchLink fieldCode="DE" term="%22Acquisition+of+data%22">Acquisition of data</searchLink><br /><searchLink fieldCode="DE" term="%22Data+analysis+software%22">Data analysis software</searchLink><br /><searchLink fieldCode="DE" term="%22Sensitivity+%26+specificity+%28Statistics%29%22">Sensitivity & specificity (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Regression+analysis%22">Regression analysis</searchLink>
– Name: SubjectGeographic
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Pakistan%22">Pakistan</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Introduction: Predictive analytics and Machine Learning (PAML) are gaining traction in health professions education (HPE). Their utilization includes, but is not limited to, guiding student enrollment, identifying at-risk learners, enhancing educational decisions, and allocating proper resources through data-driven insights. This study explored the use of PAML to identify at-risk learners in a one-year Certification Program in Emergency Medicine (CPEM) at the Indus Hospital and Health Network (IHHN), Pakistan with the aim of providing targeted educational support for improved outcome. Methodology: By leveraging data from prior CPEM cohorts (2018–2022, n = 91), regression tree and linear regression machine learning models were compared to predict the final examination performance of the CPEM 2023 learner cohort (n = 26). The models were prospectively applied to identify at-risk learners (n = 14/26). Extra learning support (ELS) was offered as an inclusive measure to everyone, not just the ones flagged by the models and was accepted by ten learners. Data were analyzed for model accuracy and the impact of the educational intervention. Results: Both models showed high accuracy (regression tree: Area Under the Receiver Operating Characteristic (ROC) Curve (AUC)= 0.89; linear regression: AUC= 0.88), though the regression tree model demonstrated slightly better sensitivity and specificity. The models altogether predicted unsatisfactory performance for 14 learners scheduled to sit for the 2023 final examination. Following targeted intervention, eight learners showed improvement in their final scores. Regression tree model was comparatively better in making predictions; however, both models had their limitation. Conclusion: The study demonstrated the feasibility and utility of using PAML to identify at-risk learners and tailor support strategies for enhancing educational outcome in low-resource settings. This additional support can augment expert judgement and ensure equitable educational practices. However, model limitations and ethical concerns, such as algorithmic bias, overfitting, and data imbalance, must be actively addressed in high-stakes assessments. Practice points Predictive analytics and machine learning (PAML) can be used to generate early, data-informed signals that support proactive intervention. Machine learning algorithms capture complex, non-linear relationships between learner characteristics. Real time data integration and faculty feedback can enhance model accuracy. Ethical, inclusive, and targeted interventions provide tailored learning support. Bias mitigation and regular model validation ensure maximal utilization of limited resources. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Medical Teacher is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=190717580
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/0142159X.2025.2519645
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 8
        StartPage: 142
    Subjects:
      – SubjectFull: Student assistance programs
        Type: general
      – SubjectFull: Predictive tests
        Type: general
      – SubjectFull: Educational outcomes
        Type: general
      – SubjectFull: Continuing medical education
        Type: general
      – SubjectFull: Professional licensure examinations
        Type: general
      – SubjectFull: Educational tests & measurements
        Type: general
      – SubjectFull: Retrospective studies
        Type: general
      – SubjectFull: Certification
        Type: general
      – SubjectFull: Longitudinal method
        Type: general
      – SubjectFull: Academic achievement
        Type: general
      – SubjectFull: Machine learning
        Type: general
      – SubjectFull: Learning strategies
        Type: general
      – SubjectFull: Learning disabilities
        Type: general
      – SubjectFull: Prediction models
        Type: general
      – SubjectFull: Receiver operating characteristic curves
        Type: general
      – SubjectFull: Evaluation of human services programs
        Type: general
      – SubjectFull: Questionnaires
        Type: general
      – SubjectFull: Emergency medicine
        Type: general
      – SubjectFull: Descriptive statistics
        Type: general
      – SubjectFull: Structural equation modeling
        Type: general
      – SubjectFull: Emergency medical services education
        Type: general
      – SubjectFull: Medical records
        Type: general
      – SubjectFull: Acquisition of data
        Type: general
      – SubjectFull: Data analysis software
        Type: general
      – SubjectFull: Sensitivity & specificity (Statistics)
        Type: general
      – SubjectFull: Regression analysis
        Type: general
      – SubjectFull: Pakistan
        Type: general
    Titles:
      – TitleFull: Harnessing predictive analytics to support high-risk learners in a one-year certification program in emergency medicine (CPEM) in Pakistan.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ali, Saima
      – PersonEntity:
          Name:
            NameFull: Saleem, Syed Ghazanfar
      – PersonEntity:
          Name:
            NameFull: Arumuganathan, Priya
      – PersonEntity:
          Name:
            NameFull: Mukhtar, Sama
      – PersonEntity:
          Name:
            NameFull: Khatri, Adeel
      – PersonEntity:
          Name:
            NameFull: Rybarczyk, Megan
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Text: Jan2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 0142159X
          Numbering:
            – Type: volume
              Value: 48
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Medical Teacher
              Type: main
ResultId 1