Interpretative Attention Networks for Structural Component Recognition

Uniyal, Abhishek; Mandal, Bappaditya; Puhan, Niladri B.; Bera, Padmalochan

Abstract

Bridges are essential for enabling movement during environmental disasters and serve as crucial links for rescue and aid delivery. Effective bridge inspection and maintenance are more critical than ever due to increasing severity and frequency of environmental disasters. Although current state-of-the-art deep learning models have achieved good performance many challenges still exist, such as their performance on challenging datasets and their opaque-box nature makes it difficult to understand their decision-making process and identify potential biases. This research work proposes a novel architecture that incorporates innovative parallel twin attention module, synchronous amplification module, aggregated multi-feature attention module and squeeze and excitation blocks, that helps to focus on specific regions of the image plane automatically resulting in improved structural component recognition accuracy. Its parallelism helps to capture long-range dependencies enabling the model to use contextual information encompassing spatial and channel information when segmenting bridge components. Experimental results and ablation studies show that our proposed architecture outperforms the current state-of-the-art methodologies in the challenging bridge component classification dataset. We also examine our models through XAI methods to provide insights into its decision-making process and making it more trustable by highlighting the importance of different features for various similar recognition/segmentation tasks.

Citation

Uniyal, A., Mandal, B., Puhan, N. B., & Bera, P. Interpretative Attention Networks for Structural Component Recognition. Presented at 27th International Conference on Pattern Recognition, Kolkata, India

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 27th International Conference on Pattern Recognition
• Acceptance Date: Dec 4, 2024
• Online Publication Date: Dec 4, 2024
• Publication Date: Dec 4, 2024
• Deposit Date: Dec 16, 2024
• Publicly Available Date: Dec 17, 2024
• Journal: Pattern recognition
• Print ISSN: 0031-3203
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Pages: 63-77
• Series Title: Lecture Notes in Computer Science
• DOI: https://doi.org/10.1007/978-3-031-78444-6_5
• Public URL: https://keele-repository.worktribe.com/output/1018988
• Additional Information: First Online: 4 December 2024; Conference Acronym: ICPR; Conference Name: International Conference on Pattern Recognition; Conference City: Kolkata; Conference Country: India; Conference Year: 2024; Conference Start Date: 1 December 2024; Conference End Date: 5 December 2024; Conference Number: 27; Conference ID: icpr2024; Conference URL: https://icpr2024.org/