What do RCTs tell us, and could they tell us more? Looking within and beyond the study sample

Sim, Julius; Lancaster, Gillian; Lewis, Martyn

Abstract

Randomised controlled trials (RCTs) are generally regarded as the gold-standard method to answer questions of treatment effectiveness. Carefully designed and rigorously implemented, they can provide unbiased estimates of average treatment effectiveness in a wide range of clinical presentations. However, they have two potential drawbacks. First, owing to the variability of treatment effects at the level of individual patients, the aggregate findings of an RCT may be difficult to apply to a particular patient or type of patient. Subgroup analyses can produce more specific findings in this regard but have some shortcomings of their own and must be conducted, and reported, carefully. Second, while RCTs can normally claim a high degree of internal validity, their external validity can be more questionable. This results from the fact that participants in an RCT may not be representative of the target population to which their findings are intended to apply, and from differences between the experimental context in which RCTs are conducted and the world of everyday clinical practice. This chapter will discuss these difficulties and suggest ways in which they may be mitigated.

Citation

Sim, J., Lancaster, G., & Lewis, M. (2024). What do RCTs tell us, and could they tell us more? Looking within and beyond the study sample. In A Medical Educator's Guide to Thinking Critically about Randomised Controlled Trials: Deconstructing the "Gold Standard" (109-144). Springer Nature [academic journals on nature.com]. https://doi.org/10.1007/978-3-031-25859-6_5

• Online Publication Date: May 31, 2024
• Publication Date: 2024
• Deposit Date: Jun 17, 2024
• Publisher: Springer Nature [academic journals on nature.com]
• Pages: 109-144
• Book Title: A Medical Educator's Guide to Thinking Critically about Randomised Controlled Trials: Deconstructing the "Gold Standard"
• ISBN: 978-3-031-25858-9
• DOI: https://doi.org/10.1007/978-3-031-25859-6_5
• Public URL: https://keele-repository.worktribe.com/output/852113
• Publisher URL: https://link.springer.com/chapter/10.1007/978-3-031-25859-6_5#citeas