Sample size and precision of estimates in studies of depression screening tool accuracy: A meta‐research review of studies published in 2018–2021

Nassar, Elsa‐Lynn; Levis, Brooke; Neyer, Marieke A.; Rice, Danielle B.; Booij, Linda; Benedetti, Andrea; Thombs, Brett D.

Abstract

AbstractObjectivesDepression screening tool accuracy studies should be conducted with large enough sample sizes to generate precise accuracy estimates. We assessed the proportion of recently published depression screening tool diagnostic accuracy studies that reported sample size calculations; the proportion that provided confidence intervals (CIs); and precision, based on the width and lower bounds of 95% CIs for sensitivity and specificity. In addition, we assessed whether these results have improved since a previous review of studies published in 2013–2015.MethodsMEDLINE was searched from January 1, 2018, through May 21, 2021.ResultsTwelve of 106 primary studies (11%) described a viable sample size calculation, which represented an improvement of 8% since the last review. Thirty‐six studies (34%) provided reasonably accurate CIs. Of 103 studies where 95% CIs were provided or could be calculated, seven (7%) had sensitivity CI widths of ≤10%, whereas 58 (56%) had widths of ≥21%. Eighty‐four studies (82%) had lower bounds of CIs <80% for sensitivity and 77 studies (75%) for specificity. These results were similar to those reported previously.ConclusionFew studies reported sample size calculations, and the number of included individuals in most studies was too small to generate reasonably precise accuracy estimates.

Citation

Nassar, E., Levis, B., Neyer, M. A., Rice, D. B., Booij, L., Benedetti, A., & Thombs, B. D. (in press). Sample size and precision of estimates in studies of depression screening tool accuracy: A meta‐research review of studies published in 2018–2021. International Journal of Methods in Psychiatric Research, 31(2), https://doi.org/10.1002/mpr.1910

• Journal Article Type: Article
• Acceptance Date: Mar 17, 2022
• Online Publication Date: Apr 1, 2022
• Deposit Date: Sep 6, 2023
• Publicly Available Date: Sep 6, 2023
• Journal: International Journal of Methods in Psychiatric Research
• Print ISSN: 1049-8931
• Publisher: Wiley
• Peer Reviewed: Peer Reviewed
• Volume: 31
• Issue: 2
• DOI: https://doi.org/10.1002/mpr.1910
• Keywords: Psychiatry and Mental health
• Publisher URL: https://onlinelibrary.wiley.com/doi/10.1002/mpr.1910