View in EDS

Assessment of Expert Decisions in Graduate Quantum Mechanics

Saved in:
Bibliographic Details
Title: Assessment of Expert Decisions in Graduate Quantum Mechanics
Language: English
Authors: Michael E. Robbins (ORCID 0009-0002-8896-4578), Gabriel J. DiQuattro, Eric W. Burkholder (ORCID 0000-0001-7420-4290)
Source: Physical Review Physics Education Research. 2025 21(1).
Availability: American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: https://journals.aps.org/prper/
Peer Reviewed: Y
Page Count: 14
Publication Date: 2025
Sponsoring Agency: National Science Foundation (NSF), Division of Graduate Education (DGE)
Contract Number: 2429155
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Science Education, College Science, Science Instruction, Teaching Methods, Physics, Graduate Study, Graduate Students, Artificial Intelligence, Science Process Skills, Expertise, Problem Solving, Quantum Mechanics, Novices, Scoring Rubrics, Scores
DOI: 10.1103/PhysRevPhysEducRes.21.010125
ISSN: 2469-9896
Abstract: [This paper is part of the Focused Collection in Investigating and Improving Quantum Education through Research.] One of the greatest weaknesses of physics education research is the paucity of research on graduate education. While there are a growing number of investigations of graduate student degree progress and admissions, there are very few investigations of "learning" at the graduate level. Additionally, existing studies of learning in physics graduate programs frequently focus on content knowledge rather than professional skills such as problem solving. Given that over 90% of physics Ph.D. graduates report solving technical problems regularly in the workplace, we sought to develop an assessment to measure how well graduate programs are training students to solve problems. Using a framework that characterizes expert-like problem-solving skills as a set of decisions to be made, we developed and validated such an assessment in graduate quantum mechanics (QM) following recently developed design frameworks for measuring problem solving and best practices for assessment validation. We collected validity evidence through think-aloud interviews with practicing physicists and physics graduate students, as well as written solutions provided by physics graduate and undergraduate students. The assessment shows strong potential in differentiating novice and expert problem solving in QM and showed reliability in repeated testing with similar populations. These results show the promise of measuring expert decision making in graduate QM and provide baseline measurements for future educational interventions to more effectively teach these skills.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1469480
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1469480
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Assessment of Expert Decisions in Graduate Quantum Mechanics
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Michael+E%2E+Robbins%22">Michael E. Robbins</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0002-8896-4578">0009-0002-8896-4578</externalLink>)<br /><searchLink fieldCode="AR" term="%22Gabriel+J%2E+DiQuattro%22">Gabriel J. DiQuattro</searchLink><br /><searchLink fieldCode="AR" term="%22Eric+W%2E+Burkholder%22">Eric W. Burkholder</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7420-4290">0000-0001-7420-4290</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Physical+Review+Physics+Education+Research%22"><i>Physical Review Physics Education Research</i></searchLink>. 2025 21(1).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: https://journals.aps.org/prper/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 14
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Science Foundation (NSF), Division of Graduate Education (DGE)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: 2429155
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Science+Education%22">Science Education</searchLink><br /><searchLink fieldCode="DE" term="%22College+Science%22">College Science</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Instruction%22">Science Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Physics%22">Physics</searchLink><br /><searchLink fieldCode="DE" term="%22Graduate+Study%22">Graduate Study</searchLink><br /><searchLink fieldCode="DE" term="%22Graduate+Students%22">Graduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Process+Skills%22">Science Process Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Expertise%22">Expertise</searchLink><br /><searchLink fieldCode="DE" term="%22Problem+Solving%22">Problem Solving</searchLink><br /><searchLink fieldCode="DE" term="%22Quantum+Mechanics%22">Quantum Mechanics</searchLink><br /><searchLink fieldCode="DE" term="%22Novices%22">Novices</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring+Rubrics%22">Scoring Rubrics</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1103/PhysRevPhysEducRes.21.010125
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2469-9896
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: [This paper is part of the Focused Collection in Investigating and Improving Quantum Education through Research.] One of the greatest weaknesses of physics education research is the paucity of research on graduate education. While there are a growing number of investigations of graduate student degree progress and admissions, there are very few investigations of "learning" at the graduate level. Additionally, existing studies of learning in physics graduate programs frequently focus on content knowledge rather than professional skills such as problem solving. Given that over 90% of physics Ph.D. graduates report solving technical problems regularly in the workplace, we sought to develop an assessment to measure how well graduate programs are training students to solve problems. Using a framework that characterizes expert-like problem-solving skills as a set of decisions to be made, we developed and validated such an assessment in graduate quantum mechanics (QM) following recently developed design frameworks for measuring problem solving and best practices for assessment validation. We collected validity evidence through think-aloud interviews with practicing physicists and physics graduate students, as well as written solutions provided by physics graduate and undergraduate students. The assessment shows strong potential in differentiating novice and expert problem solving in QM and showed reliability in repeated testing with similar populations. These results show the promise of measuring expert decision making in graduate QM and provide baseline measurements for future educational interventions to more effectively teach these skills.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1469480
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1469480
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1103/PhysRevPhysEducRes.21.010125
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
    Subjects:
      – SubjectFull: Science Education
        Type: general
      – SubjectFull: College Science
        Type: general
      – SubjectFull: Science Instruction
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Physics
        Type: general
      – SubjectFull: Graduate Study
        Type: general
      – SubjectFull: Graduate Students
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Science Process Skills
        Type: general
      – SubjectFull: Expertise
        Type: general
      – SubjectFull: Problem Solving
        Type: general
      – SubjectFull: Quantum Mechanics
        Type: general
      – SubjectFull: Novices
        Type: general
      – SubjectFull: Scoring Rubrics
        Type: general
      – SubjectFull: Scores
        Type: general
    Titles:
      – TitleFull: Assessment of Expert Decisions in Graduate Quantum Mechanics
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Michael E. Robbins
      – PersonEntity:
          Name:
            NameFull: Gabriel J. DiQuattro
      – PersonEntity:
          Name:
            NameFull: Eric W. Burkholder
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2469-9896
          Numbering:
            – Type: volume
              Value: 21
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Physical Review Physics Education Research
              Type: main
ResultId 1