Purpose
The University of Minnesota Medical School (UMN) directly observes M1-M4 students performing the EPAs in clinical settings. Students’ performance on a subsection of the EPAs, 7-13, is often more easily observed in advanced clerkships or during residency. Observations allow instructors to determine students’ skill levels and respond accordingly. Curriculum opportunities or clinical protocols may not allow students to observe or participate in critical EPA-related activities. Situational Judgement multiple choice questions (MCQs), created under the structure of the EPAs and the descriptions of pre-entrustable and entrustable learners, can be given to students to explore these content areas in a low-risk environment. Moreover, students’ results can be used by students themselves or programs to diagnose issues and personalize learning. Since the boundaries of pre-entrustable and entrustable behaviors are established, this abstract presents a pilot in which AI develops distractors and rationales that specifically describe behaviors at intermediary levels.

Methods
The AAMC Core EPA toolkit materials, best practices in item writing, and expert review will guide situational judgment practice questions (n=30) for 180 situational judgment items.

Results
Thus far, AI is useful for creating clinical scenarios. In addition, the AAMC tightly defines the definitions and content boundaries. This expert-created, public material for curriculum developers and teachers can mimic the questions of well-written situation judgment tests.

Conclusion
The AAMC Core EPA toolkits provide rich resources to create these situation judgment-type practice MCQs. Previous research has shown that students need more opportunities to practice and demonstrate their skills in EPA 7-12. However, curricular opportunities and site limitations prevent building critical EPA skills. Low-stakes MCQs, similar to simulations, allow students the opportunity to practice. This preparation may prepare them to recognize and understand the complexities of these advanced EPAs well before the advanced clerkships or residency.