Discrimination of a single-item scale to measure intention to have a COVID-19 vaccine

Sim, Julius; Smith, Louise E.; Amlôt, Richard; Rubin, G. James; Sevdalis, Nick; Sherman, Susan M.

Abstract

Aim: When developing public health measures in a pandemic, it is important to examine attitudes and beliefs relating to vaccination uptake. We report the discrimination of a single-item vaccination intention scale and derive cutpoints in terms of sensitivity (true positives) and specificity (true negatives) in relation to subsequent vaccination status. Subject and Methods: In a sample of UK adults (n=1119) recruited through an online survey platform, vaccination intention was measured on a 0–10 numerical rating scale (0=very unlikely, 10=very likely) at the beginning of the UK COVID-19 vaccination rollout (January 2021), and self-reported vaccination status was gathered after vaccination had been offered to all adults (October 2021). Discrimination of the scale was measured by the area under the receiver operating characteristic (ROC) curve. Results: The responders reporting being vaccinated or unvaccinated were 1034 (92.4%) and 85 (7.6%), respectively. The area under the ROC curve was.956 (95% CI.943,.967), indicating a high degree of discrimination. The combined value of sensitivity and specificity was greatest at a cutpoint of 8 on the scale (sensitivity =.821, specificity =.988). If, however, the individual values of sensitivity and specificity are required to be simultaneously optimized, this occurs at point 6 (sensitivity =.886, specificity =.871). Conclusion: We recommend a 0–10 intention scale as a validated, practical measure of vaccination intention in public health practice, with a cutpoint of 8 on the scale as optimal, unless sensitivity and specificity are to be simultaneously optimized, when 6 is the optimal cutpoint.

Citation

Sim, J., Smith, L. E., Amlôt, R., Rubin, G. J., Sevdalis, N., & Sherman, S. M. (2025). Discrimination of a single-item scale to measure intention to have a COVID-19 vaccine. PloS one, 20(5), Article e0322503. https://doi.org/10.1371/journal.pone.0322503

• Journal Article Type: Article
• Acceptance Date: Mar 23, 2025
• Online Publication Date: May 5, 2025
• Publication Date: May 5, 2025
• Deposit Date: May 6, 2025
• Publicly Available Date: May 6, 2025
• Journal: PLOS One
• Print ISSN: 1932-6203
• Electronic ISSN: 1932-6203
• Publisher: Public Library of Science (PLoS)
• Peer Reviewed: Peer Reviewed
• Volume: 20
• Issue: 5
• Article Number: e0322503
• DOI: https://doi.org/10.1371/journal.pone.0322503
• Public URL: https://keele-repository.worktribe.com/output/1231207