Outputs (9)

A realist evaluation of how, why and when Objective Structured Clinical Exams (OSCEs) are experienced as an authentic assessment of clinical preparedness (2024)
Journal Article
Yeates, P., Maluf, A., Kinston, R., Cope, N., Cullen, K., Cole, A., …Wong, G. (2024). A realist evaluation of how, why and when Objective Structured Clinical Exams (OSCEs) are experienced as an authentic assessment of clinical preparedness. Medical Teacher, 1-9. https://doi.org/10.1080/0142159X.2024.2339413

Introduction: Whilst rarely researched, the authenticity with which Objective Structured Clinical Exams (OSCEs) simulate practice is arguably critical to making valid judgements about candidates’ preparedness to progress in their training. We studied... Read More about A realist evaluation of how, why and when Objective Structured Clinical Exams (OSCEs) are experienced as an authentic assessment of clinical preparedness.

Training healthcare professionals to be ready for practice in an era of social distancing: A realist evaluation (2023)
Journal Article
Lefroy, J., Bialan, J., Moult, A., Hay, F., Stapleton, C., Thompson, J., …Cope, N. (2023). Training healthcare professionals to be ready for practice in an era of social distancing: A realist evaluation. Advances in Health Sciences Education, https://doi.org/10.1007/s10459-023-10297-w

Background Programme changes due to the COVID-19 pandemic have impacted variably on preparation for practice of healthcare professional students. Explanations for such variability need exploration. The aim of our study was to understand what clinica... Read More about Training healthcare professionals to be ready for practice in an era of social distancing: A realist evaluation.

Using video-based examiner score comparison and adjustment (VESCA) to compare the influence of examiners at different sites in a distributed objective structured clinical exam (OSCE) (2023)
Journal Article
Yeates, P., Maluf, A., Cope, N., McCray, G., McBain, S., Beardow, D., …McKinley, R. B. (2023). Using video-based examiner score comparison and adjustment (VESCA) to compare the influence of examiners at different sites in a distributed objective structured clinical exam (OSCE). BMC Medical Education, 23(1), Article 803. https://doi.org/10.1186/s12909-023-04774-4

Purpose: Ensuring equivalence of examiners’ judgements within distributed objective structured clinical exams (OSCEs) is key to both fairness and validity but is hampered by lack of cross-over in the performances which different groups of examiners o... Read More about Using video-based examiner score comparison and adjustment (VESCA) to compare the influence of examiners at different sites in a distributed objective structured clinical exam (OSCE).

Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study. (2022)
Journal Article
Yeates, P., Maluf, A., Kinston, R., Cope, N., McCray, G., Cullen, K., …Wong, G. (2022). Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study. BMJ Open, 12(12), Article e064387. https://doi.org/10.1136/bmjopen-2022-064387

INTRODUCTION: Objective structured clinical exams (OSCEs) are a cornerstone of assessing the competence of trainee healthcare professionals, but have been criticised for (1) lacking authenticity, (2) variability in examiners' judgements which can cha... Read More about Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study..

Determining the influence of different linking patterns on the stability of students' score adjustments produced using Video-based Examiner Score Comparison and Adjustment (VESCA). (2022)
Journal Article
Yeates, P., McCray, G., Moult, A., Cope, N., Fuller, R., & McKinley, R. (2022). Determining the influence of different linking patterns on the stability of students' score adjustments produced using Video-based Examiner Score Comparison and Adjustment (VESCA). BMC Medical Education, 22, Article 41. https://doi.org/10.1186/s12909-022-03115-1

BACKGROUND: Ensuring equivalence of examiners' judgements across different groups of examiners is a priority for large scale performance assessments in clinical education, both to enhance fairness and reassure the public. This study extends insight i... Read More about Determining the influence of different linking patterns on the stability of students' score adjustments produced using Video-based Examiner Score Comparison and Adjustment (VESCA)..

Determining influence, interaction and causality of Contrast and Sequence effects in OSCEs. (2021)
Journal Article
Yeates, P., Moult, A., Cope, N., McCray, G., Fuller, R., & McKinley, R. (2022). Determining influence, interaction and causality of Contrast and Sequence effects in OSCEs. Medical Education, 56(3), 292-302. https://doi.org/10.1111/medu.14713

INTRODUCTION: Differential rater function over time (DRIFT) and contrast effects (examiners' scores biased away from the standard of preceding performances) both challenge the fairness of scoring in Objective Structured Clinical Exams (OSCEs). This i... Read More about Determining influence, interaction and causality of Contrast and Sequence effects in OSCEs..

Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE) (2021)
Journal Article
Yeates, P., Moult, A., Cope, N., McCray, G., Xilas, E., Lovelock, T., …McKinley, R. K. (. (2021). Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE). Academic Medicine, 96(8), 1189-1196. https://doi.org/10.1097/acm.0000000000004028

Purpose Ensuring that examiners in different parallel circuits of objective structured clinical examinations (OSCEs) judge to the same standard is critical to the chain of validity. Recent work suggests examiner-cohort (i.e., the particular group of... Read More about Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE).

Exploring differences in individual and group judgements in standard setting (2019)
Journal Article
Yeates, P., Cope, N., Luksaite, E., Hassell, A., & Dikomitis, L. (2019). Exploring differences in individual and group judgements in standard setting. Medical Education, https://doi.org/10.1111/medu.13915

Background: Standard setting is critically important to assessment decisions in medical education. Recent research has demonstrated variations between medical schools in the standards set for shared items. Despite the centrality of judgement to crite... Read More about Exploring differences in individual and group judgements in standard setting.

Developing a video-based method to compare and adjust examiner effects in fully nested OSCEs (2018)
Journal Article
Yeates, P., Cope, N., Hawarden, A., Bradshaw, H., McCray, G., & Homer, M. (2019). Developing a video-based method to compare and adjust examiner effects in fully nested OSCEs. Medical Education, 53(3), 250-263. https://doi.org/10.1111/medu.13783

Background: Whilst averaging across multiple examiners judgements reduces unwanted overall score variability in Objective Structured Clinical Examinations (OSCE), designs involving several parallel circuits of the OSCE require that different examin... Read More about Developing a video-based method to compare and adjust examiner effects in fully nested OSCEs.