View in EDS

Assessment Tool to Understand How Students Justify Their Decisions in Data Comparison Problems

Saved in:
Bibliographic Details
Title: Assessment Tool to Understand How Students Justify Their Decisions in Data Comparison Problems
Language: English
Authors: Karel Kok (ORCID 0000-0002-4767-1333), Burkhard Priemer (ORCID 0000-0001-5399-7631)
Source: Physical Review Physics Education Research. 2023 19(2).
Availability: American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: https://journals.aps.org/prper/
Peer Reviewed: Y
Page Count: 22
Publication Date: 2023
Document Type: Journal Articles
Reports - Research
Education Level: Secondary Education
Descriptors: Data Analysis, Comparative Analysis, Secondary School Students, Teaching Methods, Computer Assisted Instruction, Physics, Concept Formation, Measurement Techniques, Distance Education, Foreign Countries, Scientific Concepts
Geographic Terms: Germany
DOI: 10.1103/PhysRevPhysEducRes.19.020141
ISSN: 2469-9896
Abstract: Students at all levels of education experience difficulties with the concepts of measurement uncertainties. One task that includes concepts of measurement uncertainties is a data comparison problem where students decide whether two datasets are in agreement or not--an authentic scientific practice. To aid students with these concepts and tasks, sensitive instruments are needed that probe students' understanding and track their progress. We present a tool in the form of a coding manual that analyzes students' written justifications for such a data comparison problem. With this coding manual, justifications are coded based on the quantity that is compared and the deciding criterion in this comparison. Our coding manual was used in the evaluation of a digital learning environment (DLE). In this evaluation, 154 participants (aged 14-17 years) wrote a justification for a data comparison problem before and after going through the DLE. These participants were randomly assigned to one of three groups where each group was taught an increased amount of concepts regarding measurement uncertainties. By analyzing the participants' justifications with our coding manual, we could probe their ability to compare datasets on a fine-grained level. The sensitivity of our tool was illustrated by the increase in higher quality codes with the increased conceptual teaching between the three groups. We argue that our tool for coding justifications can be applied to any data comparison problem giving detailed information about what data analysis methods students use and how they reach their conclusion and thus contributes to the research on students' understanding of measurement uncertainties.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1409492
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1409492
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Assessment Tool to Understand How Students Justify Their Decisions in Data Comparison Problems
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Karel+Kok%22">Karel Kok</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-4767-1333">0000-0002-4767-1333</externalLink>)<br /><searchLink fieldCode="AR" term="%22Burkhard+Priemer%22">Burkhard Priemer</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-5399-7631">0000-0001-5399-7631</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Physical+Review+Physics+Education+Research%22"><i>Physical Review Physics Education Research</i></searchLink>. 2023 19(2).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: https://journals.aps.org/prper/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 22
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Data+Analysis%22">Data Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Students%22">Secondary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Instruction%22">Computer Assisted Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Physics%22">Physics</searchLink><br /><searchLink fieldCode="DE" term="%22Concept+Formation%22">Concept Formation</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement+Techniques%22">Measurement Techniques</searchLink><br /><searchLink fieldCode="DE" term="%22Distance+Education%22">Distance Education</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Scientific+Concepts%22">Scientific Concepts</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Germany%22">Germany</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1103/PhysRevPhysEducRes.19.020141
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2469-9896
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Students at all levels of education experience difficulties with the concepts of measurement uncertainties. One task that includes concepts of measurement uncertainties is a data comparison problem where students decide whether two datasets are in agreement or not--an authentic scientific practice. To aid students with these concepts and tasks, sensitive instruments are needed that probe students' understanding and track their progress. We present a tool in the form of a coding manual that analyzes students' written justifications for such a data comparison problem. With this coding manual, justifications are coded based on the quantity that is compared and the deciding criterion in this comparison. Our coding manual was used in the evaluation of a digital learning environment (DLE). In this evaluation, 154 participants (aged 14-17 years) wrote a justification for a data comparison problem before and after going through the DLE. These participants were randomly assigned to one of three groups where each group was taught an increased amount of concepts regarding measurement uncertainties. By analyzing the participants' justifications with our coding manual, we could probe their ability to compare datasets on a fine-grained level. The sensitivity of our tool was illustrated by the increase in higher quality codes with the increased conceptual teaching between the three groups. We argue that our tool for coding justifications can be applied to any data comparison problem giving detailed information about what data analysis methods students use and how they reach their conclusion and thus contributes to the research on students' understanding of measurement uncertainties.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1409492
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1409492
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1103/PhysRevPhysEducRes.19.020141
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 22
    Subjects:
      – SubjectFull: Data Analysis
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Secondary School Students
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Computer Assisted Instruction
        Type: general
      – SubjectFull: Physics
        Type: general
      – SubjectFull: Concept Formation
        Type: general
      – SubjectFull: Measurement Techniques
        Type: general
      – SubjectFull: Distance Education
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Scientific Concepts
        Type: general
      – SubjectFull: Germany
        Type: general
    Titles:
      – TitleFull: Assessment Tool to Understand How Students Justify Their Decisions in Data Comparison Problems
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Karel Kok
      – PersonEntity:
          Name:
            NameFull: Burkhard Priemer
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-electronic
              Value: 2469-9896
          Numbering:
            – Type: volume
              Value: 19
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Physical Review Physics Education Research
              Type: main
ResultId 1