Evaluating the Effectiveness of Accommodations Given to Students with Learning Impairments: Ordinal and Interpretable Machine-Learning-Based Methodology

Saved in:
Bibliographic Details
Title: Evaluating the Effectiveness of Accommodations Given to Students with Learning Impairments: Ordinal and Interpretable Machine-Learning-Based Methodology
Language: English
Authors: Singer, Gonen (ORCID 0000-0002-2610-9579), Golan, Maya, Shiff, Rachel, Kleper, Dvir
Source: IEEE Transactions on Learning Technologies. Dec 2022 15(6):736-746.
Availability: Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
Peer Reviewed: Y
Page Count: 11
Publication Date: 2022
Document Type: Journal Articles
Reports - Research
Descriptors: Academic Accommodations (Disabilities), Students with Disabilities, Program Effectiveness, Equal Education, Performance, Evaluation Methods, Program Evaluation, Models
DOI: 10.1109/TLT.2022.3214537
ISSN: 1939-1382
Abstract: In most academic institutions, students with learning impairments (LIs) are entitled to various accommodations as a means of compensating for their impairment. Ensuring that the appropriate accommodations were selected requires an intelligent support tool to track their effectiveness. In this article, we regard the effectiveness of such accommodations in terms of their quality and reliability. High-quality accommodations allow students with LIs equal access and equal opportunity to demonstrate their knowledge compared to their peers who do not have LIs. Highly reliable accommodations mean a significant performance difference between students with LIs who actually use the accommodations compared with students with LIs who do not use the accommodations, given similar student characteristics. Previous literature is inconclusive regarding the evidence of the effectiveness of such accommodations since different accommodations may have a different effect on different subgroups of exams and students. This article proposes a methodology, based on ordinal interpretable models, that produce practical insights to professionals who are responsible for students with LIs, to address the problem of exploring the effectiveness of learning accommodations. The suggested models use the ordinal information of the target variables for evaluating student performance and yield practical insights for designing the most suitable accommodation for a student with LIs based on their characteristics. The ordinal interpretable models are evaluated using a database of tens of thousands of engineering students. The results demonstrate that the suggested interpretable models perform significantly better than the compared algorithms on all measures.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1360023
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1360023
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Evaluating the Effectiveness of Accommodations Given to Students with Learning Impairments: Ordinal and Interpretable Machine-Learning-Based Methodology
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Singer%2C+Gonen%22">Singer, Gonen</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-2610-9579">0000-0002-2610-9579</externalLink>)<br /><searchLink fieldCode="AR" term="%22Golan%2C+Maya%22">Golan, Maya</searchLink><br /><searchLink fieldCode="AR" term="%22Shiff%2C+Rachel%22">Shiff, Rachel</searchLink><br /><searchLink fieldCode="AR" term="%22Kleper%2C+Dvir%22">Kleper, Dvir</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22IEEE+Transactions+on+Learning+Technologies%22"><i>IEEE Transactions on Learning Technologies</i></searchLink>. Dec 2022 15(6):736-746.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 11
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Academic+Accommodations+%28Disabilities%29%22">Academic Accommodations (Disabilities)</searchLink><br /><searchLink fieldCode="DE" term="%22Students+with+Disabilities%22">Students with Disabilities</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Effectiveness%22">Program Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Equal+Education%22">Equal Education</searchLink><br /><searchLink fieldCode="DE" term="%22Performance%22">Performance</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Evaluation%22">Program Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Models%22">Models</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1109/TLT.2022.3214537
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1939-1382
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In most academic institutions, students with learning impairments (LIs) are entitled to various accommodations as a means of compensating for their impairment. Ensuring that the appropriate accommodations were selected requires an intelligent support tool to track their effectiveness. In this article, we regard the effectiveness of such accommodations in terms of their quality and reliability. High-quality accommodations allow students with LIs equal access and equal opportunity to demonstrate their knowledge compared to their peers who do not have LIs. Highly reliable accommodations mean a significant performance difference between students with LIs who actually use the accommodations compared with students with LIs who do not use the accommodations, given similar student characteristics. Previous literature is inconclusive regarding the evidence of the effectiveness of such accommodations since different accommodations may have a different effect on different subgroups of exams and students. This article proposes a methodology, based on ordinal interpretable models, that produce practical insights to professionals who are responsible for students with LIs, to address the problem of exploring the effectiveness of learning accommodations. The suggested models use the ordinal information of the target variables for evaluating student performance and yield practical insights for designing the most suitable accommodation for a student with LIs based on their characteristics. The ordinal interpretable models are evaluated using a database of tens of thousands of engineering students. The results demonstrate that the suggested interpretable models perform significantly better than the compared algorithms on all measures.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1360023
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1360023
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/TLT.2022.3214537
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 11
        StartPage: 736
    Subjects:
      – SubjectFull: Academic Accommodations (Disabilities)
        Type: general
      – SubjectFull: Students with Disabilities
        Type: general
      – SubjectFull: Program Effectiveness
        Type: general
      – SubjectFull: Equal Education
        Type: general
      – SubjectFull: Performance
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Program Evaluation
        Type: general
      – SubjectFull: Models
        Type: general
    Titles:
      – TitleFull: Evaluating the Effectiveness of Accommodations Given to Students with Learning Impairments: Ordinal and Interpretable Machine-Learning-Based Methodology
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Singer, Gonen
      – PersonEntity:
          Name:
            NameFull: Golan, Maya
      – PersonEntity:
          Name:
            NameFull: Shiff, Rachel
      – PersonEntity:
          Name:
            NameFull: Kleper, Dvir
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-electronic
              Value: 1939-1382
          Numbering:
            – Type: volume
              Value: 15
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: IEEE Transactions on Learning Technologies
              Type: main
ResultId 1