View in EDS

Tracking Attainment without a Counterfactual -- Lessons from the COVID-19 Pandemic: A Meta-Method Review. Review Report

Saved in:
Bibliographic Details
Title: Tracking Attainment without a Counterfactual -- Lessons from the COVID-19 Pandemic: A Meta-Method Review. Review Report
Language: English
Authors: Stephen R. T. Cromie, Gemma Schwendel, Pippa Lord, Education Endowment Foundation (EEF) (United Kingdom), National Foundation for Educational Research (NFER) (United Kingdom)
Source: Education Endowment Foundation. 2026.
Availability: Education Endowment Foundation. 9th Floor Millbank Tower, Millbank, London, SW1P 4QP, UK. Tel: +44-207-802-1676; e-mail: info@eefoundation.org.uk; Web site: https://educationendowmentfoundation.org.uk/
Peer Reviewed: Y
Page Count: 48
Publication Date: 2026
Document Type: Information Analyses
Descriptors: COVID-19, Pandemics, Educational Attainment, Foreign Countries, Educational Research, Research Methodology, Validity, Reliability, Bias, Evaluation, Guidelines, Crisis Management, Research Design, Educational Change, Data Use, Measurement
Geographic Terms: United Kingdom (England)
Abstract: The COVID-19 pandemic led to unprecedented school closures, prompting numerous studies to track the impact on pupil attainment, in a context where national achievement tests were cancelled. These studies varied widely in their methodologies, measures, and conclusions, making it challenging for policymakers to draw consistent insights. The report reviews seven major studies that tracked pupil attainment during and after the COVID-19 pandemic in England to provide actionable recommendations for future research on widespread prolonged educational disruptions, including events such as natural disasters, climate change, national workforce strikes, modern warfare, and organised terrorism including widespread cyber-attacks, in addition to future pandemics. The studies were conducted in adverse circumstances where there was an impetus for rapid initiation of studies to inform time-critical policies; and also at the time when there were greatest risks to school and pupil participation. Using an extended ROBINS-E risk of bias framework, the report identifies common risks of bias, arising from insufficient confounding factors, selection effects, missing data, post-exposure interventions, and limited validation of outcome measures. The insights from this review highlight the need for robust, comprehensive methodologies in tracking educational attainment during disruptions, drawing on expertise in complex sampling, psychometrics, and observational studies.
Abstractor: ERIC
Entry Date: 2026
Accession Number: ED680936
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED680936
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED680936
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Tracking Attainment without a Counterfactual -- Lessons from the COVID-19 Pandemic: A Meta-Method Review. Review Report
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Stephen+R%2E+T%2E+Cromie%22">Stephen R. T. Cromie</searchLink><br /><searchLink fieldCode="AR" term="%22Gemma+Schwendel%22">Gemma Schwendel</searchLink><br /><searchLink fieldCode="AR" term="%22Pippa+Lord%22">Pippa Lord</searchLink><br /><searchLink fieldCode="AR" term="%22Education+Endowment+Foundation+%28EEF%29+%28United+Kingdom%29%22">Education Endowment Foundation (EEF) (United Kingdom)</searchLink><br /><searchLink fieldCode="AR" term="%22National+Foundation+for+Educational+Research+%28NFER%29+%28United+Kingdom%29%22">National Foundation for Educational Research (NFER) (United Kingdom)</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Education+Endowment+Foundation%22"><i>Education Endowment Foundation</i></searchLink>. 2026.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Education Endowment Foundation. 9th Floor Millbank Tower, Millbank, London, SW1P 4QP, UK. Tel: +44-207-802-1676; e-mail: info@eefoundation.org.uk; Web site: https://educationendowmentfoundation.org.uk/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 48
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Information Analyses
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22COVID-19%22">COVID-19</searchLink><br /><searchLink fieldCode="DE" term="%22Pandemics%22">Pandemics</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Attainment%22">Educational Attainment</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Research%22">Educational Research</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Methodology%22">Research Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Validity%22">Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Reliability%22">Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Bias%22">Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation%22">Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Guidelines%22">Guidelines</searchLink><br /><searchLink fieldCode="DE" term="%22Crisis+Management%22">Crisis Management</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Design%22">Research Design</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Change%22">Educational Change</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Use%22">Data Use</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement%22">Measurement</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22United+Kingdom+%28England%29%22">United Kingdom (England)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The COVID-19 pandemic led to unprecedented school closures, prompting numerous studies to track the impact on pupil attainment, in a context where national achievement tests were cancelled. These studies varied widely in their methodologies, measures, and conclusions, making it challenging for policymakers to draw consistent insights. The report reviews seven major studies that tracked pupil attainment during and after the COVID-19 pandemic in England to provide actionable recommendations for future research on widespread prolonged educational disruptions, including events such as natural disasters, climate change, national workforce strikes, modern warfare, and organised terrorism including widespread cyber-attacks, in addition to future pandemics. The studies were conducted in adverse circumstances where there was an impetus for rapid initiation of studies to inform time-critical policies; and also at the time when there were greatest risks to school and pupil participation. Using an extended ROBINS-E risk of bias framework, the report identifies common risks of bias, arising from insufficient confounding factors, selection effects, missing data, post-exposure interventions, and limited validation of outcome measures. The insights from this review highlight the need for robust, comprehensive methodologies in tracking educational attainment during disruptions, drawing on expertise in complex sampling, psychometrics, and observational studies.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED680936
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED680936
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 48
    Subjects:
      – SubjectFull: COVID-19
        Type: general
      – SubjectFull: Pandemics
        Type: general
      – SubjectFull: Educational Attainment
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Educational Research
        Type: general
      – SubjectFull: Research Methodology
        Type: general
      – SubjectFull: Validity
        Type: general
      – SubjectFull: Reliability
        Type: general
      – SubjectFull: Bias
        Type: general
      – SubjectFull: Evaluation
        Type: general
      – SubjectFull: Guidelines
        Type: general
      – SubjectFull: Crisis Management
        Type: general
      – SubjectFull: Research Design
        Type: general
      – SubjectFull: Educational Change
        Type: general
      – SubjectFull: Data Use
        Type: general
      – SubjectFull: Measurement
        Type: general
      – SubjectFull: United Kingdom (England)
        Type: general
    Titles:
      – TitleFull: Tracking Attainment without a Counterfactual -- Lessons from the COVID-19 Pandemic: A Meta-Method Review. Review Report
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Education Endowment Foundation (EEF) (United Kingdom)
      – PersonEntity:
          Name:
            NameFull: National Foundation for Educational Research (NFER) (United Kingdom)
      – PersonEntity:
          Name:
            NameFull: Stephen R. T. Cromie
      – PersonEntity:
          Name:
            NameFull: Gemma Schwendel
      – PersonEntity:
          Name:
            NameFull: Pippa Lord
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2026
          Titles:
            – TitleFull: Education Endowment Foundation
              Type: main
ResultId 1