Effect of Gamification on Gamers: Evaluating Interventions for Students Who Game the System

Saved in:
Bibliographic Details
Title: Effect of Gamification on Gamers: Evaluating Interventions for Students Who Game the System
Language: English
Authors: Kirk P. Vanacore (ORCID 0000-0003-0673-5721), Ashish Gurung, Adam C. Sales, Neil T. Heffernan (ORCID 0000-0002-3280-288X)
Source: Journal of Educational Data Mining. 2024 16(1):112-140.
Availability: International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: https://jedm.educationaldatamining.org/index.php/JEDM
Peer Reviewed: Y
Page Count: 29
Publication Date: 2024
Sponsoring Agency: Institute of Education Sciences (ED)
National Science Foundation (NSF)
Department of Education (ED)
Office of Elementary and Secondary Education (OESE) (ED), Education Innovation and Research (EIR)
Office of Naval Research (ONR) (DOD)
Small Business Administration (SBA), Small Business Innovation Research (SBIR)
Contract Number: R305D210036
R305N210049
R305D210031
R305A170137
R305A170243
R305A180401
R305A120125
R305R220012
2118725
2118904
1950683
1917808
1931523
1940236
1917713
1903304
1822830
1759229
1724889
1636782
1535428
P200A120238
P200A180088
P200A150306
U411B190024
S411B210024
S411B220024
N000141812768
R44GM146483
Document Type: Journal Articles
Reports - Research
Education Level: Elementary Education
Grade 7
Junior High Schools
Middle Schools
Secondary Education
Descriptors: Gamification, Student Behavior, Computer Uses in Education, Intervention, Outcomes of Education, School Districts, Feedback (Response), Mathematics Achievement, Algebra, Mathematics Instruction, Educational Games, Instructional Design, Grade 7, Middle School Students
ISSN: 2157-2100
Abstract: Gaming the system is a persistent problem in Computer-Based Learning Platforms. While substantial progress has been made in identifying and understanding such behaviors, effective interventions remain scarce. This study uses a method of causal moderation known as Fully Latent Principal Stratification to explore the impact of two types of interventions--gamification and manipulation of assistance access on the learning outcomes of students who tend to game the system. The results indicate that gamification does not consistently mitigate these negative behaviors. One gamified condition had a consistently positive effect on learning regardless of students' propensity to game the system, whereas the other had a negative effect on gamers. However, delaying access to hints and feedback may have a positive effect on the learning outcomes of those gaming the system. This paper also illustrates the potential for integrating detection and causal methodologies within educational data mining to evaluate effective responses to detected behaviors.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2024
Accession Number: EJ1430518
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1430518
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1430518
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Effect of Gamification on Gamers: Evaluating Interventions for Students Who Game the System
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Kirk+P%2E+Vanacore%22">Kirk P. Vanacore</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-0673-5721">0000-0003-0673-5721</externalLink>)<br /><searchLink fieldCode="AR" term="%22Ashish+Gurung%22">Ashish Gurung</searchLink><br /><searchLink fieldCode="AR" term="%22Adam+C%2E+Sales%22">Adam C. Sales</searchLink><br /><searchLink fieldCode="AR" term="%22Neil+T%2E+Heffernan%22">Neil T. Heffernan</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-3280-288X">0000-0002-3280-288X</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Educational+Data+Mining%22"><i>Journal of Educational Data Mining</i></searchLink>. 2024 16(1):112-140.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: https://jedm.educationaldatamining.org/index.php/JEDM
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 29
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)<br />National Science Foundation (NSF)<br />Department of Education (ED)<br />Office of Elementary and Secondary Education (OESE) (ED), Education Innovation and Research (EIR)<br />Office of Naval Research (ONR) (DOD)<br />Small Business Administration (SBA), Small Business Innovation Research (SBIR)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R305D210036<br />R305N210049<br />R305D210031<br />R305A170137<br />R305A170243<br />R305A180401<br />R305A120125<br />R305R220012<br />2118725<br />2118904<br />1950683<br />1917808<br />1931523<br />1940236<br />1917713<br />1903304<br />1822830<br />1759229<br />1724889<br />1636782<br />1535428<br />P200A120238<br />P200A180088<br />P200A150306<br />U411B190024<br />S411B210024<br />S411B220024<br />N000141812768<br />R44GM146483
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+7%22">Grade 7</searchLink><br /><searchLink fieldCode="EL" term="%22Junior+High+Schools%22">Junior High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Gamification%22">Gamification</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Behavior%22">Student Behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Uses+in+Education%22">Computer Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Outcomes+of+Education%22">Outcomes of Education</searchLink><br /><searchLink fieldCode="DE" term="%22School+Districts%22">School Districts</searchLink><br /><searchLink fieldCode="DE" term="%22Feedback+%28Response%29%22">Feedback (Response)</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Achievement%22">Mathematics Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Algebra%22">Algebra</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Instruction%22">Mathematics Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Games%22">Educational Games</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Design%22">Instructional Design</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+7%22">Grade 7</searchLink><br /><searchLink fieldCode="DE" term="%22Middle+School+Students%22">Middle School Students</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2157-2100
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Gaming the system is a persistent problem in Computer-Based Learning Platforms. While substantial progress has been made in identifying and understanding such behaviors, effective interventions remain scarce. This study uses a method of causal moderation known as Fully Latent Principal Stratification to explore the impact of two types of interventions--gamification and manipulation of assistance access on the learning outcomes of students who tend to game the system. The results indicate that gamification does not consistently mitigate these negative behaviors. One gamified condition had a consistently positive effect on learning regardless of students' propensity to game the system, whereas the other had a negative effect on gamers. However, delaying access to hints and feedback may have a positive effect on the learning outcomes of those gaming the system. This paper also illustrates the potential for integrating detection and causal methodologies within educational data mining to evaluate effective responses to detected behaviors.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1430518
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1430518
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 29
        StartPage: 112
    Subjects:
      – SubjectFull: Gamification
        Type: general
      – SubjectFull: Student Behavior
        Type: general
      – SubjectFull: Computer Uses in Education
        Type: general
      – SubjectFull: Intervention
        Type: general
      – SubjectFull: Outcomes of Education
        Type: general
      – SubjectFull: School Districts
        Type: general
      – SubjectFull: Feedback (Response)
        Type: general
      – SubjectFull: Mathematics Achievement
        Type: general
      – SubjectFull: Algebra
        Type: general
      – SubjectFull: Mathematics Instruction
        Type: general
      – SubjectFull: Educational Games
        Type: general
      – SubjectFull: Instructional Design
        Type: general
      – SubjectFull: Grade 7
        Type: general
      – SubjectFull: Middle School Students
        Type: general
    Titles:
      – TitleFull: Effect of Gamification on Gamers: Evaluating Interventions for Students Who Game the System
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kirk P. Vanacore
      – PersonEntity:
          Name:
            NameFull: Ashish Gurung
      – PersonEntity:
          Name:
            NameFull: Adam C. Sales
      – PersonEntity:
          Name:
            NameFull: Neil T. Heffernan
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-electronic
              Value: 2157-2100
          Numbering:
            – Type: volume
              Value: 16
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Educational Data Mining
              Type: main
ResultId 1