Evaluating Artificial Intelligence in Clinical Settings-Let Us Not Reinvent the Wheel.

Cresswell, Kathrin; de Keizer, Nicolette; Magrabi, Farah; Williams, Robin; Rigby, Michael; Prgomet, Mirela; Kukhareva, Polina; Wong, Zoie Shui-Yee; Scott, Philip; Craven, Catherine K; Georgiou, Andrew; Medlock, Stephanie; Brender McNair, Jytte; Ammenwerth, Elske

Abstract

Given the requirement to minimize the risks and maximize the benefits of technology applications in health care provision, there is an urgent need to incorporate theory-informed health IT (HIT) evaluation frameworks into existing and emerging guidelines for the evaluation of artificial intelligence (AI). Such frameworks can help developers, implementers, and strategic decision makers to build on experience and the existing empirical evidence base. We provide a pragmatic conceptual overview of selected concrete examples of how existing theory-informed HIT evaluation frameworks may be used to inform the safe development and implementation of AI in health care settings. The list is not exhaustive and is intended to illustrate applications in line with various stakeholder requirements. Existing HIT evaluation frameworks can help to inform AI-based development and implementation by supporting developers and strategic decision makers in considering relevant technology, user, and organizational dimensions. This can facilitate the design of technologies, their implementation in user and organizational settings, and the sustainability and scalability of technologies. [Abstract copyright: ©Kathrin Cresswell, Nicolette de Keizer, Farah Magrabi, Robin Williams, Michael Rigby, Mirela Prgomet, Polina Kukhareva, Zoie Shui-Yee Wong, Philip Scott, Catherine K Craven, Andrew Georgiou, Stephanie Medlock, Jytte Brender McNair, Elske Ammenwerth. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 07.08.2024.]

Citation

Cresswell, K., de Keizer, N., Magrabi, F., Williams, R., Rigby, M., Prgomet, M., …Ammenwerth, E. (in press). Evaluating Artificial Intelligence in Clinical Settings-Let Us Not Reinvent the Wheel. Journal of Medical Internet Research, 26, Article e46407. https://doi.org/10.2196/46407

• Journal Article Type: Article
• Acceptance Date: Mar 2, 2024
• Online Publication Date: Aug 7, 2024
• Deposit Date: Aug 27, 2024
• Journal: Journal of medical Internet research
• Print ISSN: 1438-8871
• Electronic ISSN: 1438-8871
• Publisher: JMIR Publications
• Peer Reviewed: Peer Reviewed
• Volume: 26
• Article Number: e46407
• DOI: https://doi.org/10.2196/46407
• Keywords: optimization, Medical Informatics - methods, evaluation, health care, theory, Humans, patient safety, optimisation, artificial intelligence, Artificial Intelligence
• Public URL: https://keele-repository.worktribe.com/output/888385