Yunhao Zhang, Shanshan Li, Zhian Pan, Qingjie Liu, Guan Li · Applied Sciences 2026 · 2026
DOI: 10.3390/app16199951
Counts differ because each database indexes a different set of publications. We treat OpenAlex as the canonical count; Google Scholar is not shown (no API, and crawling it violates its ToS).
Multimodal image–text posts on social media provide valuable evidence for disaster response, but fine-grained crisis classification remains difficult when modality reliability varies, categories overlap, and global representations obscure localized visual cues. This study proposes MSGLF-Refine, a text-guided global–local refinement framework based on OpenCLIP ViT-L/14-336. Global image–text fusion establishes a baseline representation; text-guided attention then retrieves relevant visual patches, and gated residual integration controls their contribution to the final prediction. On the official five-class CrisisMMD Task 02 split, a three-seed equal-logit ensemble achieves 92.44% accuracy, 92.41% weighted F1-score, and 90.28% macro F1-score. Published results provide benchmark context, while internally matched ablations show that local refinement maintains comparable average single-model performance to the global baseline and yields a larger observed ensemble gain. Leave-one-event-out experiments across seven disasters improve weighted F1-score over direct global concatenation for every held-out event. Text-length analysis examines performance across posts of different lengths. Counterfactual text interventions and visual evidence analysis offer complementary checks on the model’s evidence use. The results support global–local refinement on the historical CrisisMMD benchmark, while rare-class performance and generalization to current social media require further validation.
No comments yet — start the discussion below.