Adapting Public Exams for Introductory Physics: A Mixed-Methods Investigation of Student Outcomes
Abstract
Public Exams are an assessment system designed in the context of Biology Education Research to increase student engagement in the exam design process. Students are shown incomplete versions of test questions ahead of time, with the format of the question revealed but some details withheld. Students are also given the chance to provide feedback on the questions, refining them for clarity before the actual exam. In this study, we examined the impact of Public Exams on the experiences and outcomes of N = 42 students in an introductory physics course at New Mexico State University. Using a combination of online numerical surveys, open-ended written responses, and student grade data, we conducted a mixed-methods analysis of the impact of Public Exams on students in this class. We also applied our method to re-analyze the publicly available data of Wiggins et al. Students reported various benefits of Public Exams, including reduced test anxiety and directing to core concepts, and we observed a significant positive correlation between the participation rate of students in editing public exam questions and their average exam grade. But students also expressed dissatisfaction with the incomplete information provided on problems, and they had a less positive response rate than the control sample. In other qualitative responses, students also consistently highlighted the applications of procedural knowledge as most helpful to their learning and a recommendation for the future. Our findings suggest that physics students at NMSU do benefit from Public Exams through reduced anxiety and directing to core concepts, but that the Public Exam system, as previously described, is not optimized for use in physics. We attribute this to the particular emphasis in physics on applying procedural knowledge and suggest modifications of the Public Exam system to better tailor it to a physics context.
Related
- Calculating a journey to Mars with introductory physics
- Data-driven modeling in the introductory physics laboratory: Scaling analysis and data collapse in the specific heat of water experiment
- Mechanics Cognitive Diagnostic: Testing Fine-Grained Learning Objectives in Introductory Physics
- Active Learning with Generative AI in Introductory Physics: A Multi-Institutional Study of the P-A.I.R. Framework
- Designing an AI Agent That Does Not Tutor: Design Rules for Socratic Probing in Introductory Physics
BibTeX
@misc{marahatta2026adapting,
title = {{Adapting Public Exams for Introductory Physics: A Mixed-Methods Investigation of Student Outcomes}},
author = {Binisha Marahatta and Matthew D. Sievert},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.03847},
eprint = {2610.03847},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.03847},
}
RIS
TY - UNPB
TI - Adapting Public Exams for Introductory Physics: A Mixed-Methods Investigation of Student Outcomes
AU - Binisha Marahatta
AU - Matthew D. Sievert
PY - 2026
DA - 2026/10/02
PB - arXiv
DO - 10.48550/arxiv.2610.03847
UR - https://arxiv.org/abs/2610.03847
AB - Public Exams are an assessment system designed in the context of Biology Education Research to increase student engagement in the exam design process. Students are shown incomplete versions of test questions ahead of time, with the format of the question revealed but some details withheld. Students are also given the chance to provide feedback on the questions, refining them for clarity before the actual exam. In this study, we examined the impact of Public Exams on the experiences and outcomes of N = 42 students in an introductory physics course at New Mexico State University. Using a combination of online numerical surveys, open-ended written responses, and student grade data, we conducted a mixed-methods analysis of the impact of Public Exams on students in this class. We also applied our method to re-analyze the publicly available data of Wiggins et al. Students reported various benefits of Public Exams, including reduced test anxiety and directing to core concepts, and we observed a significant positive correlation between the participation rate of students in editing public exam questions and their average exam grade. But students also expressed dissatisfaction with the incomplete information provided on problems, and they had a less positive response rate than the control sample. In other qualitative responses, students also consistently highlighted the applications of procedural knowledge as most helpful to their learning and a recommendation for the future. Our findings suggest that physics students at NMSU do benefit from Public Exams through reduced anxiety and directing to core concepts, but that the Public Exam system, as previously described, is not optimized for use in physics. We attribute this to the particular emphasis in physics on applying procedural knowledge and suggest modifications of the Public Exam system to better tailor it to a physics context.
ER -