Comparing the influence of ‘describing findings to the examiner’ or ‘examining as in usual practice’ on the students’ performance and assessors’ judgements during physical examination skills assessment

Stephenson, Catherine; Yeates, Peter; Lefroy, Janet

Abstract

Background:

Within assessment of physical examination skills, two approaches are common: “Describing Findings” (students comment throughout); and examining as “Usual Practice” (students only report findings at the end). Despite numerous potential influences on both students’ performances and assessors’ judgements, no prior studies have investigated the influence of either approach on assessments.

Methods:

Two group, randomised, crossover design. Within a 2-station simulated physical examination OSCE, we manipulated whether students “described findings” or examined as “usual practice”, collecting 1/. performance scores; 2/. Students’/examiners’ cognitive load ratings; ratings of the 3/. fluency and 4/. completeness of students’ presentations and 5/. Students’ task-finishing, comparing all 5 end-points across conditions.

Results:

Neither students’ performance scores nor examiners’ cognitive load were influenced by experimental condition. Students reported higher cognitive load (7/9) when “describing findings” than “usual practice” (6/9, p=0.002), and were less likely to finish (4 vs 12, p=0.007). Presentation completeness was higher for “describing findings” (mean=2.40, (95CIs=2.05-2.74)) than “usual practice” (mean=1.92 (1.65-2.18),p=0.016), whilst fluency ratings showed a similar trend.

Conclusions:

The decision to “Describe Findings” or examine as “Usual Practice” does not appear neutral, potentially influencing students’ efficiency, recall and (by inference) learning. Institutions should explicitly select one option based on assessment goals.

Citation

Stephenson, C., Yeates, P., & Lefroy, J. (2020). Comparing the influence of ‘describing findings to the examiner’ or ‘examining as in usual practice’ on the students’ performance and assessors’ judgements during physical examination skills assessment. MedEdPublish, 9(18), https://doi.org/10.15694/mep.2020.000018.1

• Journal Article Type: Article
• Acceptance Date: Jan 20, 2020
• Publication Date: Jan 21, 2020
• Publicly Available Date: Jun 12, 2023
• Journal: MedEdPublish
• Print ISSN: 2312-7996
• Publisher: Taylor and Francis
• Peer Reviewed: Peer Reviewed
• Volume: 9
• Issue: 18
• DOI: https://doi.org/10.15694/mep.2020.000018.1
• Keywords: influence, examiner, practice, physical exercise,
• Public URL: https://keele-repository.worktribe.com/output/415615
• Publisher URL: https://doi.org/10.15694/mep.2020.000018.1