Licensing exam pass/fail raises concerns
Medical Economics reports that moving parts of the medical licensing exam to pass/fail has introduced challenges, including impacts on at‑risk students and diversity in training pipelines. The piece frames the change as creating new selection pressures for later stages of medical careers. (medicaleconomics.com)
The first exam in the United States medical licensing series stopped giving three-digit scores in January 2022, and schools say the pressure did not disappear. (usmle.org) Step 1 of the United States Medical Licensing Examination switched to pass/fail for tests taken on or after January 26, 2022, while Step 2 Clinical Knowledge kept its three-digit score. The Step 1 passing standard also rose by two points at the same time. (usmle.org, usmle.org) Medical Economics reported on August 31, 2023 that a TrueLearn survey of 250 medical educators found 31% said students would be at risk of underperforming on Step 2, and only 26% said they had the data needed to identify at-risk students. The same report said 39% named identifying at-risk students as a top challenge after the scoring change. (medicaleconomics.com) The old Step 1 score had become a sorting tool for residency programs, even though the exam was built for licensure, not hiring. The Association of American Medical Colleges said in 2019 that Step 1 scores were getting “far more weight than they deserve” in residency selection. (aamc.org) Once that score disappeared, programs looked harder at the numbers that remained. In a 2024 study of 433 directors in competitive specialties, the top two selection factors were Step 2 Clinical Knowledge scores and away rotations at the program’s own site. (pmc.ncbi.nlm.nih.gov) That shift changes who gets screened in and who gets screened out. In the same 2024 study, 24.0% of program directors said matching would get harder for underrepresented applicants in medicine, while 49.19% said it would get harder for osteopathic applicants and 56.35% said it would get harder for international medical graduates. (pmc.ncbi.nlm.nih.gov) Earlier research had already shown how score cutoffs shaped diversity. A 2020 cross-sectional study of 10,541 residency applicants found that Step 1 cutoff scores could disproportionately exclude underrepresented minorities in medicine from interview consideration. (pmc.ncbi.nlm.nih.gov) Residency directors are also working in a system with new filters beyond test scores. The National Resident Matching Program said its 2024 survey added new questions on program signaling, a process that lets applicants send limited expressions of interest to selected programs. (nrmp.org) Medical schools and residency programs are still trying to replace one simple number with a broader file review. Four years after the switch, the main result looks less like the end of screening and more like a move in where the screening happens. (medicaleconomics.com, pmc.ncbi.nlm.nih.gov)
