Assessment of Expert Decisions in Graduate Quantum Mechanics
Saved in:
| Title: | Assessment of Expert Decisions in Graduate Quantum Mechanics |
|---|---|
| Language: | English |
| Authors: | Michael E. Robbins (ORCID |
| Source: | Physical Review Physics Education Research. 2025 21(1). |
| Availability: | American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: https://journals.aps.org/prper/ |
| Peer Reviewed: | Y |
| Page Count: | 14 |
| Publication Date: | 2025 |
| Sponsoring Agency: | National Science Foundation (NSF), Division of Graduate Education (DGE) |
| Contract Number: | 2429155 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Science Education, College Science, Science Instruction, Teaching Methods, Physics, Graduate Study, Graduate Students, Artificial Intelligence, Science Process Skills, Expertise, Problem Solving, Quantum Mechanics, Novices, Scoring Rubrics, Scores |
| DOI: | 10.1103/PhysRevPhysEducRes.21.010125 |
| ISSN: | 2469-9896 |
| Abstract: | [This paper is part of the Focused Collection in Investigating and Improving Quantum Education through Research.] One of the greatest weaknesses of physics education research is the paucity of research on graduate education. While there are a growing number of investigations of graduate student degree progress and admissions, there are very few investigations of "learning" at the graduate level. Additionally, existing studies of learning in physics graduate programs frequently focus on content knowledge rather than professional skills such as problem solving. Given that over 90% of physics Ph.D. graduates report solving technical problems regularly in the workplace, we sought to develop an assessment to measure how well graduate programs are training students to solve problems. Using a framework that characterizes expert-like problem-solving skills as a set of decisions to be made, we developed and validated such an assessment in graduate quantum mechanics (QM) following recently developed design frameworks for measuring problem solving and best practices for assessment validation. We collected validity evidence through think-aloud interviews with practicing physicists and physics graduate students, as well as written solutions provided by physics graduate and undergraduate students. The assessment shows strong potential in differentiating novice and expert problem solving in QM and showed reliability in repeated testing with similar populations. These results show the promise of measuring expert decision making in graduate QM and provide baseline measurements for future educational interventions to more effectively teach these skills. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1469480 |
| Database: | ERIC |
| Abstract: | [This paper is part of the Focused Collection in Investigating and Improving Quantum Education through Research.] One of the greatest weaknesses of physics education research is the paucity of research on graduate education. While there are a growing number of investigations of graduate student degree progress and admissions, there are very few investigations of "learning" at the graduate level. Additionally, existing studies of learning in physics graduate programs frequently focus on content knowledge rather than professional skills such as problem solving. Given that over 90% of physics Ph.D. graduates report solving technical problems regularly in the workplace, we sought to develop an assessment to measure how well graduate programs are training students to solve problems. Using a framework that characterizes expert-like problem-solving skills as a set of decisions to be made, we developed and validated such an assessment in graduate quantum mechanics (QM) following recently developed design frameworks for measuring problem solving and best practices for assessment validation. We collected validity evidence through think-aloud interviews with practicing physicists and physics graduate students, as well as written solutions provided by physics graduate and undergraduate students. The assessment shows strong potential in differentiating novice and expert problem solving in QM and showed reliability in repeated testing with similar populations. These results show the promise of measuring expert decision making in graduate QM and provide baseline measurements for future educational interventions to more effectively teach these skills. |
|---|---|
| ISSN: | 2469-9896 |
| DOI: | 10.1103/PhysRevPhysEducRes.21.010125 |
