View in EDS

The Affordances of Multivariate Elo-Based Learner Modeling in Game-Based Assessment

Saved in:
Bibliographic Details
Title: The Affordances of Multivariate Elo-Based Learner Modeling in Game-Based Assessment
Language: English
Authors: Ruiperez-Valiente, Jose A. (ORCID 0000-0002-2304-6365), Kim, Yoon Jeon, Baker, Ryan S., Martinez, Pedro A., Lin, Grace C.
Source: IEEE Transactions on Learning Technologies. Apr 2023 16(2):152-165.
Availability: Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
Peer Reviewed: Y
Page Count: 14
Publication Date: 2023
Sponsoring Agency: National Science Foundation (NSF)
Contract Number: 1935450
Document Type: Journal Articles
Reports - Research
Descriptors: Affordances, Game Based Learning, Student Evaluation, Multivariate Analysis, Educational Technology, Task Analysis, Computation, Learning Analytics, Geometry, Puzzles, Algorithms
DOI: 10.1109/TLT.2022.3203912
ISSN: 1939-1382
Abstract: Previous research and experiences have indicated the potential that games have in educational settings. One of the possible uses of games in education is as game-based assessments (GBA), using game tasks to generate evidence about skills and content knowledge that can be valuable. There are different approaches in the literature to implement the assessment machinery of these GBA, all of them having strengths and drawbacks. In this article, we propose using multivariate Elo-based learner modeling, as we believe it has a strong potential in the context of GBA for three aims: first, to simultaneously measure students competence across several knowledge components in a game; second, to predict task performance; and finally, to estimate task difficulty within the game. To do so, we present our GBA Shadowspect, which is focused on solving geometry puzzles, and we depict our implementation using data collected from several high schools across the USA. We obtain high-performing results (AUC of 0.87) and demonstrate that the model enables analysis of how each student's competency evolves after each puzzle attempt. Moreover, the model provides accurate estimations of each task's difficulty, enabling iterative improvement of the game design. This study highlights the potential that multivariate Elo-based learner modeling has within the context of GBA, sharing lessons learned, and encouraging future researchers in the field to consider this algorithm to build their assessment machinery.
Abstractor: As Provided
Entry Date: 2023
Accession Number: EJ1374066
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1374066
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Affordances of Multivariate Elo-Based Learner Modeling in Game-Based Assessment
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ruiperez-Valiente%2C+Jose+A%2E%22">Ruiperez-Valiente, Jose A.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-2304-6365">0000-0002-2304-6365</externalLink>)<br /><searchLink fieldCode="AR" term="%22Kim%2C+Yoon+Jeon%22">Kim, Yoon Jeon</searchLink><br /><searchLink fieldCode="AR" term="%22Baker%2C+Ryan+S%2E%22">Baker, Ryan S.</searchLink><br /><searchLink fieldCode="AR" term="%22Martinez%2C+Pedro+A%2E%22">Martinez, Pedro A.</searchLink><br /><searchLink fieldCode="AR" term="%22Lin%2C+Grace+C%2E%22">Lin, Grace C.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22IEEE+Transactions+on+Learning+Technologies%22"><i>IEEE Transactions on Learning Technologies</i></searchLink>. Apr 2023 16(2):152-165.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 14
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Science Foundation (NSF)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: 1935450
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Affordances%22">Affordances</searchLink><br /><searchLink fieldCode="DE" term="%22Game+Based+Learning%22">Game Based Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Evaluation%22">Student Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Multivariate+Analysis%22">Multivariate Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Technology%22">Educational Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Task+Analysis%22">Task Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Computation%22">Computation</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Analytics%22">Learning Analytics</searchLink><br /><searchLink fieldCode="DE" term="%22Geometry%22">Geometry</searchLink><br /><searchLink fieldCode="DE" term="%22Puzzles%22">Puzzles</searchLink><br /><searchLink fieldCode="DE" term="%22Algorithms%22">Algorithms</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1109/TLT.2022.3203912
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1939-1382
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Previous research and experiences have indicated the potential that games have in educational settings. One of the possible uses of games in education is as game-based assessments (GBA), using game tasks to generate evidence about skills and content knowledge that can be valuable. There are different approaches in the literature to implement the assessment machinery of these GBA, all of them having strengths and drawbacks. In this article, we propose using multivariate Elo-based learner modeling, as we believe it has a strong potential in the context of GBA for three aims: first, to simultaneously measure students competence across several knowledge components in a game; second, to predict task performance; and finally, to estimate task difficulty within the game. To do so, we present our GBA Shadowspect, which is focused on solving geometry puzzles, and we depict our implementation using data collected from several high schools across the USA. We obtain high-performing results (AUC of 0.87) and demonstrate that the model enables analysis of how each student's competency evolves after each puzzle attempt. Moreover, the model provides accurate estimations of each task's difficulty, enabling iterative improvement of the game design. This study highlights the potential that multivariate Elo-based learner modeling has within the context of GBA, sharing lessons learned, and encouraging future researchers in the field to consider this algorithm to build their assessment machinery.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1374066
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1374066
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/TLT.2022.3203912
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 152
    Subjects:
      – SubjectFull: Affordances
        Type: general
      – SubjectFull: Game Based Learning
        Type: general
      – SubjectFull: Student Evaluation
        Type: general
      – SubjectFull: Multivariate Analysis
        Type: general
      – SubjectFull: Educational Technology
        Type: general
      – SubjectFull: Task Analysis
        Type: general
      – SubjectFull: Computation
        Type: general
      – SubjectFull: Learning Analytics
        Type: general
      – SubjectFull: Geometry
        Type: general
      – SubjectFull: Puzzles
        Type: general
      – SubjectFull: Algorithms
        Type: general
    Titles:
      – TitleFull: The Affordances of Multivariate Elo-Based Learner Modeling in Game-Based Assessment
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ruiperez-Valiente, Jose A.
      – PersonEntity:
          Name:
            NameFull: Kim, Yoon Jeon
      – PersonEntity:
          Name:
            NameFull: Baker, Ryan S.
      – PersonEntity:
          Name:
            NameFull: Martinez, Pedro A.
      – PersonEntity:
          Name:
            NameFull: Lin, Grace C.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-electronic
              Value: 1939-1382
          Numbering:
            – Type: volume
              Value: 16
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: IEEE Transactions on Learning Technologies
              Type: main
ResultId 1