View in EDS

The Correlated Proxy Problem: Why Control Variables Can Obscure the Contribution of Selection Processes to Group-Level Inequality. EdWorkingPaper No. 25-1120

Saved in:
Bibliographic Details
Title: The Correlated Proxy Problem: Why Control Variables Can Obscure the Contribution of Selection Processes to Group-Level Inequality. EdWorkingPaper No. 25-1120
Language: English
Authors: Joao M. Souto-Maior, Kenneth A. Shores, Rachel E. Fish, Annenberg Institute for School Reform at Brown University
Source: Annenberg Institute for School Reform at Brown University. 2025.
Availability: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
Peer Reviewed: N
Page Count: 72
Publication Date: 2025
Sponsoring Agency: William T. Grant Foundation
Spencer Foundation
Document Type: Reports - Research
Descriptors: Control Groups, Predictor Variables, Correlation, Selection Criteria, Social Class, Conflict, Participant Characteristics, Data Analysis, Researchers, Attitudes, Statistical Bias, Research Methodology, Graphs, Structural Equation Models, Scores, Case Studies, Disproportionate Representation, Special Education, African American Students, White Students
Abstract: Whether selection processes contribute to group-level disparities or merely reflect pre-existing inequalities is an important societal question. In the context of observational data, researchers, concerned about omitted-variable bias, assess selection-contributing inequality via a kitchen-sink approach, comparing selection outcomes of different-group individuals net of various characteristics. We introduce a conceptual framework that clearly defines the quantity of interest and argue that researchers should only control for the extent to which individuals meet selection criteria. Informed by this framework, we use directed acyclic graphs and structural equation modeling to show that traditional practices can inaccurately represent selection-contributing inequality because chosen controls frequently capture selection-irrelevant characteristics, which we define as the correlated proxy problem. Using Black-White disproportionality in special education as a case study, we show that typical practices of using test scores as covariates likely drastically underestimate the influence of selection-contributing inequality to Black over-representation in special education.
Abstractor: As Provided
Entry Date: 2025
Accession Number: ED671105
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED671105
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED671105
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Correlated Proxy Problem: Why Control Variables Can Obscure the Contribution of Selection Processes to Group-Level Inequality. EdWorkingPaper No. 25-1120
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Joao+M%2E+Souto-Maior%22">Joao M. Souto-Maior</searchLink><br /><searchLink fieldCode="AR" term="%22Kenneth+A%2E+Shores%22">Kenneth A. Shores</searchLink><br /><searchLink fieldCode="AR" term="%22Rachel+E%2E+Fish%22">Rachel E. Fish</searchLink><br /><searchLink fieldCode="AR" term="%22Annenberg+Institute+for+School+Reform+at+Brown+University%22">Annenberg Institute for School Reform at Brown University</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Annenberg+Institute+for+School+Reform+at+Brown+University%22"><i>Annenberg Institute for School Reform at Brown University</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 72
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: William T. Grant Foundation<br />Spencer Foundation
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Control+Groups%22">Control Groups</searchLink><br /><searchLink fieldCode="DE" term="%22Predictor+Variables%22">Predictor Variables</searchLink><br /><searchLink fieldCode="DE" term="%22Correlation%22">Correlation</searchLink><br /><searchLink fieldCode="DE" term="%22Selection+Criteria%22">Selection Criteria</searchLink><br /><searchLink fieldCode="DE" term="%22Social+Class%22">Social Class</searchLink><br /><searchLink fieldCode="DE" term="%22Conflict%22">Conflict</searchLink><br /><searchLink fieldCode="DE" term="%22Participant+Characteristics%22">Participant Characteristics</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Analysis%22">Data Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Researchers%22">Researchers</searchLink><br /><searchLink fieldCode="DE" term="%22Attitudes%22">Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Bias%22">Statistical Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Methodology%22">Research Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Graphs%22">Graphs</searchLink><br /><searchLink fieldCode="DE" term="%22Structural+Equation+Models%22">Structural Equation Models</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Case+Studies%22">Case Studies</searchLink><br /><searchLink fieldCode="DE" term="%22Disproportionate+Representation%22">Disproportionate Representation</searchLink><br /><searchLink fieldCode="DE" term="%22Special+Education%22">Special Education</searchLink><br /><searchLink fieldCode="DE" term="%22African+American+Students%22">African American Students</searchLink><br /><searchLink fieldCode="DE" term="%22White+Students%22">White Students</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Whether selection processes contribute to group-level disparities or merely reflect pre-existing inequalities is an important societal question. In the context of observational data, researchers, concerned about omitted-variable bias, assess selection-contributing inequality via a kitchen-sink approach, comparing selection outcomes of different-group individuals net of various characteristics. We introduce a conceptual framework that clearly defines the quantity of interest and argue that researchers should only control for the extent to which individuals meet selection criteria. Informed by this framework, we use directed acyclic graphs and structural equation modeling to show that traditional practices can inaccurately represent selection-contributing inequality because chosen controls frequently capture selection-irrelevant characteristics, which we define as the correlated proxy problem. Using Black-White disproportionality in special education as a case study, we show that typical practices of using test scores as covariates likely drastically underestimate the influence of selection-contributing inequality to Black over-representation in special education.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED671105
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED671105
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 72
    Subjects:
      – SubjectFull: Control Groups
        Type: general
      – SubjectFull: Predictor Variables
        Type: general
      – SubjectFull: Correlation
        Type: general
      – SubjectFull: Selection Criteria
        Type: general
      – SubjectFull: Social Class
        Type: general
      – SubjectFull: Conflict
        Type: general
      – SubjectFull: Participant Characteristics
        Type: general
      – SubjectFull: Data Analysis
        Type: general
      – SubjectFull: Researchers
        Type: general
      – SubjectFull: Attitudes
        Type: general
      – SubjectFull: Statistical Bias
        Type: general
      – SubjectFull: Research Methodology
        Type: general
      – SubjectFull: Graphs
        Type: general
      – SubjectFull: Structural Equation Models
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Case Studies
        Type: general
      – SubjectFull: Disproportionate Representation
        Type: general
      – SubjectFull: Special Education
        Type: general
      – SubjectFull: African American Students
        Type: general
      – SubjectFull: White Students
        Type: general
    Titles:
      – TitleFull: The Correlated Proxy Problem: Why Control Variables Can Obscure the Contribution of Selection Processes to Group-Level Inequality. EdWorkingPaper No. 25-1120
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Annenberg Institute for School Reform at Brown University
      – PersonEntity:
          Name:
            NameFull: Joao M. Souto-Maior
      – PersonEntity:
          Name:
            NameFull: Kenneth A. Shores
      – PersonEntity:
          Name:
            NameFull: Rachel E. Fish
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Titles:
            – TitleFull: Annenberg Institute for School Reform at Brown University
              Type: main
ResultId 1