View in EDS

A Framework for Considering Exploration, Interpretation, and Confirmation during Data Analysis: Computationally Assisted Analysis of Teacher-Group Interactions

Saved in:
Bibliographic Details
Title: A Framework for Considering Exploration, Interpretation, and Confirmation during Data Analysis: Computationally Assisted Analysis of Teacher-Group Interactions
Language: English
Authors: Paul Hur, Chris Palaguachi, Nessrine Machaka, Christina Krist, Elizabeth B. Dyer, Cynthia D’Angelo, Nigel Bosch
Source: Journal of Educational Data Mining. 2026 18(1):180-207.
Availability: International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: https://jedm.educationaldatamining.org/index.php/JEDM
Peer Reviewed: Y
Page Count: 28
Publication Date: 2026
Sponsoring Agency: National Science Foundation (NSF), Division of Research on Learning in Formal and Informal Settings (DRL)
Contract Number: 1920796
Document Type: Journal Articles
Reports - Research
Education Level: High Schools
Secondary Education
Descriptors: Artificial Intelligence, Man Machine Systems, Teacher Student Relationship, High School Teachers, Teacher Behavior, Interaction, Evaluation Methods, Models, Small Group Instruction, Verbal Communication, Nonverbal Communication, Role, Educational Researchers
ISSN: 2157-2100
Abstract: Education researchers increasingly analyze heterogeneous, multimodal data with computational tools. Yet, reporting rarely makes explicit who (human or computer) leads meaning-making at different points in the analysis. We introduce a framework for analytic agency that distinguishes three stages, exploration, interpretation, and confirmation, and classifies each as primarily human- or computer-led, as considering stage-level leadership can clarify assumptions in analysis. We demonstrate the framework in a multimodal case study of teacher-student group interactions in high school mathematics classrooms. Using 15 classroom videos from three teachers, we selected 21 student groups and developed a pose-based detector that flags interactions. The pipeline aligned group-level audio and word-level transcripts to each detected window and computed acoustic/prosodic features and large-language-model indicators for question-asking, confusion, help-seeking, and math talk. Across the corpus, the detector surfaced 317 interaction events (M = 15.10 per group, SD = 12.42; mean duration = 32.73s). We compared before, during, and after segments using paired tests and mixedeffects models. Naturally, results for mixed-effects models showed significant shifts in keypoints before-toduring and before-to-after for those emphasized in the detection approach, while audio features showed no significant changes. One transcript indicator, confusion, decreased after interactions (β = -0.061, p = 0.049). The pipeline showed preferences for spatial co-presence rather than interaction discourse change, which illustrates how leadership in exploration shaped what became detectable and, consequently, how interpretation proceeded. In the paper's conclusion, we outline hybrid, iterative variants and discuss limitations. Making stage-level agency explicit can help researchers align methodological choices with theoretical aims and produce more transparent, auditable analyses of complex classroom data.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1506628
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1506628
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1506628
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A Framework for Considering Exploration, Interpretation, and Confirmation during Data Analysis: Computationally Assisted Analysis of Teacher-Group Interactions
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Paul+Hur%22">Paul Hur</searchLink><br /><searchLink fieldCode="AR" term="%22Chris+Palaguachi%22">Chris Palaguachi</searchLink><br /><searchLink fieldCode="AR" term="%22Nessrine+Machaka%22">Nessrine Machaka</searchLink><br /><searchLink fieldCode="AR" term="%22Christina+Krist%22">Christina Krist</searchLink><br /><searchLink fieldCode="AR" term="%22Elizabeth+B%2E+Dyer%22">Elizabeth B. Dyer</searchLink><br /><searchLink fieldCode="AR" term="%22Cynthia+D%27Angelo%22">Cynthia D’Angelo</searchLink><br /><searchLink fieldCode="AR" term="%22Nigel+Bosch%22">Nigel Bosch</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Educational+Data+Mining%22"><i>Journal of Educational Data Mining</i></searchLink>. 2026 18(1):180-207.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: https://jedm.educationaldatamining.org/index.php/JEDM
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 28
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Science Foundation (NSF), Division of Research on Learning in Formal and Informal Settings (DRL)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: 1920796
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Man+Machine+Systems%22">Man Machine Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Student+Relationship%22">Teacher Student Relationship</searchLink><br /><searchLink fieldCode="DE" term="%22High+School+Teachers%22">High School Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Behavior%22">Teacher Behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Interaction%22">Interaction</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Models%22">Models</searchLink><br /><searchLink fieldCode="DE" term="%22Small+Group+Instruction%22">Small Group Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Verbal+Communication%22">Verbal Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Nonverbal+Communication%22">Nonverbal Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Role%22">Role</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Researchers%22">Educational Researchers</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2157-2100
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Education researchers increasingly analyze heterogeneous, multimodal data with computational tools. Yet, reporting rarely makes explicit who (human or computer) leads meaning-making at different points in the analysis. We introduce a framework for analytic agency that distinguishes three stages, exploration, interpretation, and confirmation, and classifies each as primarily human- or computer-led, as considering stage-level leadership can clarify assumptions in analysis. We demonstrate the framework in a multimodal case study of teacher-student group interactions in high school mathematics classrooms. Using 15 classroom videos from three teachers, we selected 21 student groups and developed a pose-based detector that flags interactions. The pipeline aligned group-level audio and word-level transcripts to each detected window and computed acoustic/prosodic features and large-language-model indicators for question-asking, confusion, help-seeking, and math talk. Across the corpus, the detector surfaced 317 interaction events (M = 15.10 per group, SD = 12.42; mean duration = 32.73s). We compared before, during, and after segments using paired tests and mixedeffects models. Naturally, results for mixed-effects models showed significant shifts in keypoints before-toduring and before-to-after for those emphasized in the detection approach, while audio features showed no significant changes. One transcript indicator, confusion, decreased after interactions (β = -0.061, p = 0.049). The pipeline showed preferences for spatial co-presence rather than interaction discourse change, which illustrates how leadership in exploration shaped what became detectable and, consequently, how interpretation proceeded. In the paper's conclusion, we outline hybrid, iterative variants and discuss limitations. Making stage-level agency explicit can help researchers align methodological choices with theoretical aims and produce more transparent, auditable analyses of complex classroom data.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1506628
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1506628
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 28
        StartPage: 180
    Subjects:
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Man Machine Systems
        Type: general
      – SubjectFull: Teacher Student Relationship
        Type: general
      – SubjectFull: High School Teachers
        Type: general
      – SubjectFull: Teacher Behavior
        Type: general
      – SubjectFull: Interaction
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Models
        Type: general
      – SubjectFull: Small Group Instruction
        Type: general
      – SubjectFull: Verbal Communication
        Type: general
      – SubjectFull: Nonverbal Communication
        Type: general
      – SubjectFull: Role
        Type: general
      – SubjectFull: Educational Researchers
        Type: general
    Titles:
      – TitleFull: A Framework for Considering Exploration, Interpretation, and Confirmation during Data Analysis: Computationally Assisted Analysis of Teacher-Group Interactions
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Paul Hur
      – PersonEntity:
          Name:
            NameFull: Chris Palaguachi
      – PersonEntity:
          Name:
            NameFull: Nessrine Machaka
      – PersonEntity:
          Name:
            NameFull: Christina Krist
      – PersonEntity:
          Name:
            NameFull: Elizabeth B. Dyer
      – PersonEntity:
          Name:
            NameFull: Cynthia D’Angelo
      – PersonEntity:
          Name:
            NameFull: Nigel Bosch
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-electronic
              Value: 2157-2100
          Numbering:
            – Type: volume
              Value: 18
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Educational Data Mining
              Type: main
ResultId 1