UTC +1
90 Minute
EOK: György Békésy Lecture Hall
This Community of Practice (COP) session will explore challenges associated with Performance Assessment of Clinical Skills (PACS) in dentistry. The session will build on our 2025 session which identified a need for practical training around running an OSCE.
During the in-person workshop, we will explore at a basic and practical level how to make sense of OSCE data after the examination. We will discuss how to undertake a Borderline Regression Analysis to confirm, or otherwise, the pass mark. We will consider issues with this method and strategies for when it doesn’t work. We will then explore how to check if the examination is fair – in terms of station, examiner and circuit performance. Participants will be invited to participate in small group exercises to build on their expertise and help embed practical skills. We anticipate workshop participation to encourage collaborative partnerships and training initiatives, forming the foundation for future COP activities.
Approximate Duration (minutes)
Topic
Detail
0 – 5
Introduction
Introduce the team, outline aims and objectives
20 min
Introduction to standard setting using the Borderline Regression method
Short talk introducing participants to the Borderline Regression method
20 min
Workshop –
Scrutinising the output of borderline regression
Small group workshop - Members discuss / scrutinise the output of Borderline Regression – discussing the effectiveness / decision making process.
20 mins
Introduction to station, examiner and circuit analysis
Broad overview of Cronbachs alpha, examiner analysis / circuit analysis.
20 mins
Workshop – making sense of the data
Practical exercise in small groups examining the data and making sense of the output. Small group discussions about decision making processes following the data analysis.
5 minutes
Session close
Summary, thanks, and next steps
During the session, delegates will:
Understand and describe a method for post-hoc standard setting (Borderline Regression)
Explain the importance of post-hoc analysis to assess station performance and fairness
Develop practical skills in managing OSCE data
