Session Coordinator: Mari Hopper

There is a need for effective assessments to evaluate clinical reasoning and application of basic science, as traditional MCQs often fall short in assessing higher-order skills like critical thinking. The Progressive Case Disclosure (PCD) format aims to address this gap by revealing clinical information sequentially, requiring examinees to re-analyze with each new detail. PCDs emphasize real-world clinical reasoning rather than just factual recall. However, creating PCD materials and scoring exams is time/expertise intensive. Generative AI can mitigate this by rapidly generating high-quality PCD question stems, rubrics, and grading. This hands-on session will introduce the PCD exam and discuss a novel format that uses AI to create assessments emphasizing integration of basic and clinical sciences. Participants will design a sample PCD question and rubric with the help of AI, and identify benefits like evaluating critical thinking, as well as challenges of relying on AI for assessments.

By the end of the session, participants will be able to:

- Explain key features of the Progressive Case Disclosure (PCD) exam format including sequential reveal of information requiring analysis and reinterpretation

- Develop a sample PCD question stem and grading rubric using generative AI technology to rapidly produce high-quality materials assessing clinical reasoning skills

- Identify potential benefits of implementing PCD exams such as improved assessment of critical thinking, integration of basic and clinical sciences, and real-world clinical reasoning

- Recognize possible challenges and limitations related to use of PCD exams and reliance on AI technologies for assessment generation including cost, expertise, and validity evidence

- Discuss the role of innovative technologies like generative AI in improving timely and robust assessments of higher-order skills in medical education