Name
Changes in Research Productivity Metrics Among Residency Applicants
Before and After USMLE Step 1 Pass/Fail Implementation: A Multi-Year
Specialty-Level Analysis
Date & Time
Sunday, June 7, 2026, 4:38 PM - 4:53 PM
Location Name
Walsh
Speakers
Authors
Anand Chundi, FAU Charles E. Schmidt College of Medicine
Poojita Chinmay, Medical College of Georgia
Presentation Topic(s)
Assessment
Description
Purpose:
The transition of USMLE Step 1 to pass/fail (P/F) reporting in 2022 raised
concerns that residency programs would shift greater emphasis toward research
productivity and scholarly output. Empirical evidence describing how
applicant research experiences changed following this policy shift remains
limited. This study compares national residency applicant research metrics
across all specialties before and after Step 1 became P/F.
Methods:
AAMC residency applicant data from three pre-P/F years (2020–2022) and one
post-P/F year (2025) were combined. Two variables were analyzed for all ACGME
specialties: (1) number of research experiences and (2) number of
abstracts/presentations/publications. Pre-P/F values were averaged for each
specialty and paired with corresponding 2025 values. Paired t-tests assessed
pre–post differences, and effect sizes were calculated using paired Cohen’s
d.
Results:
Across 23 specialties, applicants in the post-P/F era had significantly
fewer research experiences (mean decrease –1.69; 95% CI –2.03 to –1.34;
t=10.08; p=1.04×10??), representing a large negative effect (d = –2.10).
In contrast, applicants demonstrated a significant increase in
abstracts/presentations/publications, with a mean rise of +4.41 scholarly
products (95% CI 2.54 to 6.27; t = –4.90; p=6.67×10??), corresponding to a
large positive effect (d = 1.02). These trends were consistent across low-,
moderate-, and highly competitive specialties.
Conclusion:
Contrary to predictions that Step 1 P/F would drive applicants to pursue
more research experiences, applicants instead completed fewer distinct
research engagements, yet produced higher scholarly output. This suggests a
shift toward fewer but more productive, publication-focused research
activities in the post-P/F era. These findings highlight the evolving
behaviors of applicants following the implementation of Step 1 P/F and
underscore the need for residency programs to interpret research metrics
cautiously. Increased reliance on publication quantity alone may disadvantage
students with unequal access to high-yield research environments.
The transition of USMLE Step 1 to pass/fail (P/F) reporting in 2022 raised
concerns that residency programs would shift greater emphasis toward research
productivity and scholarly output. Empirical evidence describing how
applicant research experiences changed following this policy shift remains
limited. This study compares national residency applicant research metrics
across all specialties before and after Step 1 became P/F.
Methods:
AAMC residency applicant data from three pre-P/F years (2020–2022) and one
post-P/F year (2025) were combined. Two variables were analyzed for all ACGME
specialties: (1) number of research experiences and (2) number of
abstracts/presentations/publications. Pre-P/F values were averaged for each
specialty and paired with corresponding 2025 values. Paired t-tests assessed
pre–post differences, and effect sizes were calculated using paired Cohen’s
d.
Results:
Across 23 specialties, applicants in the post-P/F era had significantly
fewer research experiences (mean decrease –1.69; 95% CI –2.03 to –1.34;
t=10.08; p=1.04×10??), representing a large negative effect (d = –2.10).
In contrast, applicants demonstrated a significant increase in
abstracts/presentations/publications, with a mean rise of +4.41 scholarly
products (95% CI 2.54 to 6.27; t = –4.90; p=6.67×10??), corresponding to a
large positive effect (d = 1.02). These trends were consistent across low-,
moderate-, and highly competitive specialties.
Conclusion:
Contrary to predictions that Step 1 P/F would drive applicants to pursue
more research experiences, applicants instead completed fewer distinct
research engagements, yet produced higher scholarly output. This suggests a
shift toward fewer but more productive, publication-focused research
activities in the post-P/F era. These findings highlight the evolving
behaviors of applicants following the implementation of Step 1 P/F and
underscore the need for residency programs to interpret research metrics
cautiously. Increased reliance on publication quantity alone may disadvantage
students with unequal access to high-yield research environments.
Presentation Tag(s)
Student Presentation, Best Student Oral Nominee