View in EDS

Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform. EdWorkingPaper No. 23-891

Saved in:
Bibliographic Details
Title: Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform. EdWorkingPaper No. 23-891
Language: English
Authors: Dorottya Demszky, Rose Wang, Sean Geraghty, Carol Yu
Source: Annenberg Institute for School Reform at Brown University. 2023.
Availability: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: AISR_Info@brown.edu; Web site: http://www.annenberginstitute.org
Peer Reviewed: N
Page Count: 22
Publication Date: 2023
Document Type: Reports - Research
Tests/Questionnaires
Education Level: Elementary Education
Secondary Education
Elementary Secondary Education
Descriptors: Elementary Secondary Education, Students, Teachers, Feedback (Response), Classroom Communication, Teacher Student Relationship, Learner Engagement, Mathematics Instruction, Tutoring, Tutors, Cognitive Processes, Student Motivation, Extraversion Introversion, Abstract Reasoning, Thinking Skills, Computer Mediated Communication
Abstract: Providing ample opportunities for students to express their thinking is pivotal to their learning of mathematical concepts. We introduce the Talk Meter, which provides in-the-moment automated feedback on student-teacher talk ratios. We conduct a randomized controlled trial on a virtual math tutoring platform (n=742 tutors) to evaluate the effectiveness of the Talk Meter at increasing student talk. In one treatment arm, we show the Talk Meter only to the tutor, while in the other arm we show it to both the student and the tutor. We find that the Talk Meter increases student talk ratios in both treatment conditions by 13-14%; this trend is driven by the tutor talking less in the tutor-facing condition, whereas in the student-facing condition it is driven by the student expressing significantly more mathematical thinking. Through interviews with tutors, we find the student-facing Talk Meter was more motivating to students, especially those with introverted personalities, and was effective at encouraging joint effort towards balanced talk time. These results demonstrate the promise of in-the-moment joint talk time feedback to both teachers and students as a low cost, engaging, and scalable way to increase students' mathematical reasoning.
Abstractor: As Provided
Entry Date: 2024
Accession Number: ED638947
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED638947
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED638947
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform. EdWorkingPaper No. 23-891
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Dorottya+Demszky%22">Dorottya Demszky</searchLink><br /><searchLink fieldCode="AR" term="%22Rose+Wang%22">Rose Wang</searchLink><br /><searchLink fieldCode="AR" term="%22Sean+Geraghty%22">Sean Geraghty</searchLink><br /><searchLink fieldCode="AR" term="%22Carol+Yu%22">Carol Yu</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Annenberg+Institute+for+School+Reform+at+Brown+University%22"><i>Annenberg Institute for School Reform at Brown University</i></searchLink>. 2023.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: AISR_Info@brown.edu; Web site: http://www.annenberginstitute.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 22
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research<br />Tests/Questionnaires
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Elementary+Secondary+Education%22">Elementary Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Elementary+Secondary+Education%22">Elementary Secondary Education</searchLink><br /><searchLink fieldCode="DE" term="%22Students%22">Students</searchLink><br /><searchLink fieldCode="DE" term="%22Teachers%22">Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Feedback+%28Response%29%22">Feedback (Response)</searchLink><br /><searchLink fieldCode="DE" term="%22Classroom+Communication%22">Classroom Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Student+Relationship%22">Teacher Student Relationship</searchLink><br /><searchLink fieldCode="DE" term="%22Learner+Engagement%22">Learner Engagement</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Instruction%22">Mathematics Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Tutoring%22">Tutoring</searchLink><br /><searchLink fieldCode="DE" term="%22Tutors%22">Tutors</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Processes%22">Cognitive Processes</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Motivation%22">Student Motivation</searchLink><br /><searchLink fieldCode="DE" term="%22Extraversion+Introversion%22">Extraversion Introversion</searchLink><br /><searchLink fieldCode="DE" term="%22Abstract+Reasoning%22">Abstract Reasoning</searchLink><br /><searchLink fieldCode="DE" term="%22Thinking+Skills%22">Thinking Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Mediated+Communication%22">Computer Mediated Communication</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Providing ample opportunities for students to express their thinking is pivotal to their learning of mathematical concepts. We introduce the Talk Meter, which provides in-the-moment automated feedback on student-teacher talk ratios. We conduct a randomized controlled trial on a virtual math tutoring platform (n=742 tutors) to evaluate the effectiveness of the Talk Meter at increasing student talk. In one treatment arm, we show the Talk Meter only to the tutor, while in the other arm we show it to both the student and the tutor. We find that the Talk Meter increases student talk ratios in both treatment conditions by 13-14%; this trend is driven by the tutor talking less in the tutor-facing condition, whereas in the student-facing condition it is driven by the student expressing significantly more mathematical thinking. Through interviews with tutors, we find the student-facing Talk Meter was more motivating to students, especially those with introverted personalities, and was effective at encouraging joint effort towards balanced talk time. These results demonstrate the promise of in-the-moment joint talk time feedback to both teachers and students as a low cost, engaging, and scalable way to increase students' mathematical reasoning.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED638947
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED638947
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 22
    Subjects:
      – SubjectFull: Elementary Secondary Education
        Type: general
      – SubjectFull: Students
        Type: general
      – SubjectFull: Teachers
        Type: general
      – SubjectFull: Feedback (Response)
        Type: general
      – SubjectFull: Classroom Communication
        Type: general
      – SubjectFull: Teacher Student Relationship
        Type: general
      – SubjectFull: Learner Engagement
        Type: general
      – SubjectFull: Mathematics Instruction
        Type: general
      – SubjectFull: Tutoring
        Type: general
      – SubjectFull: Tutors
        Type: general
      – SubjectFull: Cognitive Processes
        Type: general
      – SubjectFull: Student Motivation
        Type: general
      – SubjectFull: Extraversion Introversion
        Type: general
      – SubjectFull: Abstract Reasoning
        Type: general
      – SubjectFull: Thinking Skills
        Type: general
      – SubjectFull: Computer Mediated Communication
        Type: general
    Titles:
      – TitleFull: Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform. EdWorkingPaper No. 23-891
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Dorottya Demszky
      – PersonEntity:
          Name:
            NameFull: Rose Wang
      – PersonEntity:
          Name:
            NameFull: Sean Geraghty
      – PersonEntity:
          Name:
            NameFull: Carol Yu
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2023
          Titles:
            – TitleFull: Annenberg Institute for School Reform at Brown University
              Type: main
ResultId 1