View in EDS

Automated Scoring of Summary-Writing Tasks Designed to Measure Reading Comprehension

Saved in:
Bibliographic Details
Title: Automated Scoring of Summary-Writing Tasks Designed to Measure Reading Comprehension
Language: English
Authors: Madnani, Nitin (ORCID 0000-0001-9354-6851), Burstein, Jill (ORCID 0000-0001-7725-7574), Sabatini, John (ORCID 0000-0002-0292-2039), O'Reilly, Tenaha (ORCID 0000-0002-8513-9719)
Source: Grantee Submission. 2013Paper presented at the Workshop on Innovative Use of Natural Language Processing for Building Educational Applications (8th, 2013).
Peer Reviewed: Y
Page Count: 7
Publication Date: 2013
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305F100005
Document Type: Speeches/Meeting Papers
Reports - Research
Education Level: Elementary Education
Secondary Education
Grade 6
Intermediate Grades
Middle Schools
Grade 7
Junior High Schools
Grade 9
High Schools
Descriptors: Computer Assisted Testing, Scoring, Writing Evaluation, Reading Comprehension, Elementary School Students, Secondary School Students, Grade 6, Grade 7, Grade 9, Automation
Abstract: We introduce a cognitive framework for measuring reading comprehension that includes the use of novel summary-writing tasks. We derive NLP features from the holistic rubric used to score the summaries written by students for such tasks and use them to design a preliminary, automated scoring system. Our results show that the automated approach performs very well on summaries written by students for two different passages. [This manuscript is an early draft of a paper published in: "Proceedings of the 8th Workshop on Innovative Use of Natural Language Processing for Building Educational Applications" (pp. 163-168). Atlanta, GA: Association for Computational Linguistics.]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2020
Accession Number: ED603960
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED603960
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED603960
AccessLevel: 3
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Automated Scoring of Summary-Writing Tasks Designed to Measure Reading Comprehension
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Madnani%2C+Nitin%22">Madnani, Nitin</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-9354-6851">0000-0001-9354-6851</externalLink>)<br /><searchLink fieldCode="AR" term="%22Burstein%2C+Jill%22">Burstein, Jill</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7725-7574">0000-0001-7725-7574</externalLink>)<br /><searchLink fieldCode="AR" term="%22Sabatini%2C+John%22">Sabatini, John</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-0292-2039">0000-0002-0292-2039</externalLink>)<br /><searchLink fieldCode="AR" term="%22O'Reilly%2C+Tenaha%22">O'Reilly, Tenaha</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-8513-9719">0000-0002-8513-9719</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Grantee+Submission%22"><i>Grantee Submission</i></searchLink>. 2013Paper presented at the Workshop on Innovative Use of Natural Language Processing for Building Educational Applications (8th, 2013).
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 7
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2013
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R305F100005
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Speeches/Meeting Papers<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+6%22">Grade 6</searchLink><br /><searchLink fieldCode="EL" term="%22Intermediate+Grades%22">Intermediate Grades</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+7%22">Grade 7</searchLink><br /><searchLink fieldCode="EL" term="%22Junior+High+Schools%22">Junior High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+9%22">Grade 9</searchLink><br /><searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring%22">Scoring</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+Evaluation%22">Writing Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Comprehension%22">Reading Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Students%22">Secondary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+6%22">Grade 6</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+7%22">Grade 7</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+9%22">Grade 9</searchLink><br /><searchLink fieldCode="DE" term="%22Automation%22">Automation</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: We introduce a cognitive framework for measuring reading comprehension that includes the use of novel summary-writing tasks. We derive NLP features from the holistic rubric used to score the summaries written by students for such tasks and use them to design a preliminary, automated scoring system. Our results show that the automated approach performs very well on summaries written by students for two different passages. [This manuscript is an early draft of a paper published in: "Proceedings of the 8th Workshop on Innovative Use of Natural Language Processing for Building Educational Applications" (pp. 163-168). Atlanta, GA: Association for Computational Linguistics.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2020
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED603960
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED603960
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 7
    Subjects:
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Scoring
        Type: general
      – SubjectFull: Writing Evaluation
        Type: general
      – SubjectFull: Reading Comprehension
        Type: general
      – SubjectFull: Elementary School Students
        Type: general
      – SubjectFull: Secondary School Students
        Type: general
      – SubjectFull: Grade 6
        Type: general
      – SubjectFull: Grade 7
        Type: general
      – SubjectFull: Grade 9
        Type: general
      – SubjectFull: Automation
        Type: general
    Titles:
      – TitleFull: Automated Scoring of Summary-Writing Tasks Designed to Measure Reading Comprehension
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Madnani, Nitin
      – PersonEntity:
          Name:
            NameFull: Burstein, Jill
      – PersonEntity:
          Name:
            NameFull: Sabatini, John
      – PersonEntity:
          Name:
            NameFull: O'Reilly, Tenaha
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2013
          Titles:
            – TitleFull: Grantee Submission
              Type: main
ResultId 1