Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study. (2022)
Journal Article
Yeates, P., Maluf, A., Kinston, R., Cope, N., McCray, G., Cullen, K., …Wong, G. (2022). Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study. BMJ Open, 12(12), Article e064387. https://doi.org/10.1136/bmjopen-2022-064387

INTRODUCTION: Objective structured clinical exams (OSCEs) are a cornerstone of assessing the competence of trainee healthcare professionals, but have been criticised for (1) lacking authenticity, (2) variability in examiners' judgements which can cha... Read More about Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study..

Determining influence, interaction and causality of Contrast and Sequence effects in OSCEs. (2021)
Journal Article
Yeates, P., Moult, A., Cope, N., McCray, G., Fuller, R., & McKinley, R. (2022). Determining influence, interaction and causality of Contrast and Sequence effects in OSCEs. Medical Education, 56(3), 292-302. https://doi.org/10.1111/medu.14713

INTRODUCTION: Differential rater function over time (DRIFT) and contrast effects (examiners' scores biased away from the standard of preceding performances) both challenge the fairness of scoring in Objective Structured Clinical Exams (OSCEs). This i... Read More about Determining influence, interaction and causality of Contrast and Sequence effects in OSCEs..

Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE) (2021)
Journal Article
Yeates, P., Moult, A., Cope, N., McCray, G., Xilas, E., Lovelock, T., …McKinley, R. K. (. (2021). Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE). Academic Medicine, 96(8), 1189-1196. https://doi.org/10.1097/acm.0000000000004028

Purpose Ensuring that examiners in different parallel circuits of objective structured clinical examinations (OSCEs) judge to the same standard is critical to the chain of validity. Recent work suggests examiner-cohort (i.e., the particular group of... Read More about Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE).

Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! (2021)
Journal Article
Lewis, M., Bromley, K., Sutton, C., McCray, G., Myers, H., & Lancaster, G. (2021). Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back!. Pilot and Feasibility Studies, 7, Article 40. https://doi.org/10.1186/s40814-021-00770-x

BACKGROUND: The current CONSORT guidelines for reporting pilot trials do not recommend hypothesis testing of clinical outcomes on the basis that a pilot trial is under-powered to detect such differences and this is the aim of the main trial. It state... Read More about Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back!.

Developing a video-based method to compare and adjust examiner effects in fully nested OSCEs (2018)
Journal Article
Yeates, P., Cope, N., Hawarden, A., Bradshaw, H., McCray, G., & Homer, M. (2019). Developing a video-based method to compare and adjust examiner effects in fully nested OSCEs. Medical Education, 53(3), 250-263. https://doi.org/10.1111/medu.13783

Background:
Whilst averaging across multiple examiners judgements reduces unwanted overall score variability in Objective Structured Clinical Examinations (OSCE), designs involving several parallel circuits of the OSCE require that different examin... Read More about Developing a video-based method to compare and adjust examiner effects in fully nested OSCEs.

Exploring the Relationship between Examiners’ Memories for performances, domain separation and score variability. (2018)
Journal Article
Yeates, & McCray. (2018). Exploring the Relationship between Examiners’ Memories for performances, domain separation and score variability. Medical Teacher, 1159-1165. https://doi.org/10.1080/0142159X.2018.1463088

Background: OSCE examiners' scores are variable and may discriminate domains of performance poorly. Examiners must hold their observations of OSCE performances in "episodic memory" until performances end. We investigated whether examiners vary in the... Read More about Exploring the Relationship between Examiners’ Memories for performances, domain separation and score variability..