Fast Generation of Custom Floating-Point Spatial Filters on FPGAs

Campos, Nelson; Edirisinghe, Eran; Chesnokov, Slava; Larkin, Daniel

Abstract

Convolutional Neural Networks (CNNs) have been utilised in many image and video processing applications. The convolution operator, also known as a spatial filter, is usually a linear operation, but this linearity compromises essential features and details inherent in the non-linearity present in many applications. However, due to its slow processing, the use of a nonlinear spatial filter is a significant bottleneck in many software applications. Further, due to their complexity, they are difficult to accelerate in FPGA or VLSI architectures. This paper presents novel FPGA implementations of linear and nonlinear spatial filters. More specifically, the arithmetic computations are carried out in custom floating-point, enabling a tradeoff of precision and hardware compactness, reducing algorithm development time. Further, we show that it is possible to process video at a resolution of 1080p with a frame rate of 60 frames per second, using a low-cost FPGA board. Finally, we show that using a domain-specific language will allow the rapid prototyping of image processing algorithms in custom floating-point arithmetic, allowing non-experts to quickly develop real-time video processing applications.

Citation

Campos, N., Edirisinghe, E., Chesnokov, S., & Larkin, D. (2024). Fast Generation of Custom Floating-Point Spatial Filters on FPGAs. IEEE Access, 12, 167059-167071. https://doi.org/10.1109/access.2024.3486066

• Journal Article Type: Article
• Acceptance Date: Oct 18, 2024
• Online Publication Date: Oct 24, 2024
• Publication Date: 2024
• Deposit Date: Dec 12, 2024
• Journal: IEEE Access
• Publisher: Institute of Electrical and Electronics Engineers (IEEE)
• Peer Reviewed: Peer Reviewed
• Volume: 12
• Pages: 167059-167071
• DOI: https://doi.org/10.1109/access.2024.3486066
• Public URL: https://keele-repository.worktribe.com/output/1014944
• Publisher URL: https://ieeexplore.ieee.org/document/10734090