Design Considerations for Building Credible Security Testbeds: Perspectives from Industrial Control System Use Cases

Ani, Uchenna D; Watson, Jeremy M; Green, Benjamin; Craggs, Barnaby; Nurse, Jason

Abstract

This paper presents a mapping framework for design factors and implementation process for building credible Industrial Control Systems (ICS) security testbeds. The resilience of ICSs has become a critical concern to operators and governments following widely publicised cyber security events. The inability to apply conventional Information Technology security practice to ICSs further compounds challenges in adequately securing critical systems. To overcome these challenges, and do so without impacting live environments, testbeds for the exploration, development and evaluation of security controls are widely used. However, how a testbed is designed and its attributes, can directly impact not only its viability but also its credibility as a whole. Through a combined systematic and thematic analysis and mapping of ICS security testbed design attributes, this paper suggests that the expertise of human experimenters, design objectives, the implementation approach, architectural coverage, core characteristics, and evaluation methods; are considerations that can help establish or enhance confidence, trustworthiness and acceptance; thus, credibility of ICS security testbeds.

Citation

Ani, U. D., Watson, J. M., Green, B., Craggs, B., & Nurse, J. (2020). Design Considerations for Building Credible Security Testbeds: Perspectives from Industrial Control System Use Cases. Journal of Cyber Security Technology, 5(2), https://doi.org/10.1080/23742917.2020.1843822

• Journal Article Type: Article
• Acceptance Date: Oct 25, 2020
• Online Publication Date: Nov 23, 2020
• Publication Date: Nov 23, 2020
• Deposit Date: Feb 8, 2024
• Publicly Available Date: Feb 8, 2024
• Journal: Journal of Cyber Security Technology
• Print ISSN: 2374-2917
• Publisher: Taylor and Francis Group
• Peer Reviewed: Peer Reviewed
• Volume: 5
• Issue: 2
• DOI: https://doi.org/10.1080/23742917.2020.1843822
• Keywords: ICS Testbeds, Security Simulations, Security Modelling, Model Credibility, Cyber Security Simulations
• Publisher URL: https://www.tandfonline.com/doi/full/10.1080/23742917.2020.1843822