TRIMOON: Two-Round Inconsistency-based Multi-modal fusion Network for fake news detection

Abstract

Compared to ordinary news, fake news is characterized by faster dissemination and lower production cost and therefore causes a great social harm. For these reasons, the challenge to efficiently and accurately detect fake news has attracted a lot of attention in the research community. We propose a Two-Round Inconsistency-based Multi-modal fusion Network (TRIMOON) for fake news detection, which consists of three main components: the multi-modal feature extraction module, the multi-modal feature fusion module and the classification module. To filter the noise generated in the fusion process, we perform a two-fold inconsistency detection, once before and once after the fusion process. Experimental results also prove this to be quite effective. Our proposed TRIMOON is evaluated on both the Chinese and the English datasets, and our model outperforms the state-of-the-art approaches on several classification evaluation metrics.

Citation

Xiong, S., Xi, L., Zhang, G., Shi, L., Liu, L., & Batra, V. (2023). TRIMOON: Two-Round Inconsistency-based Multi-modal fusion Network for fake news detection. Information Fusion, 150 - 158. https://doi.org/10.1016/j.inffus.2022.12.016

• Acceptance Date: Dec 16, 2022
• Online Publication Date: Dec 30, 2022
• Publication Date: May 1, 2023
• Publicly Available Date: Dec 31, 2024
• Journal: Information Fusion
• Print ISSN: 1566-2535
• Publisher: Elsevier
• Pages: 150 - 158
• DOI: https://doi.org/10.1016/j.inffus.2022.12.016
• Keywords: Fake news detection; Multi-modal fusion; Deep learning; Feature fusion
• Public URL: https://keele-repository.worktribe.com/output/425166
• Publisher URL: https://www.sciencedirect.com/science/article/abs/pii/S1566253522002639?via%3Dihub