2026 WACV WACV 2026

Dual-Domain Multimodal Hyperbolic Fusion for Cardiopulmonary Disease Diagnosis in Emergency Care

Abstract

Differentiating between cardiac and pulmonary diseases in emergency settings presents a significant challenge due to overlapping symptoms like dyspnea and chest pain, where misdiagnosis can lead to inappropriate interventions and increased morbidity. While electrocardiograms (ECGs) and chest X-rays (CXRs) provide complementary diagnostic information, existing multimodal fusion approaches fail to fully capture the complex relationships between these fundamentally different data modalities. To address these limitations, we propose DDMF-Net, a Dual-Domain Multimodal Fusion Network that explicitly unifies multi-domain features--from both frequency and spatial/temporal perspectives--and conducts cross-modality fusion of ECG, CXR signals and clinical parameters in hyperbolic space, thereby enhancing the modeling of complex cardiopulmonary pathophysiology. Our framework contains three innovations: (1) a frequency fusion module that captures complementary spectral patterns across modalities, (2) an inter-domain fusion module that dynamically balances domain-specific features, and (3) a hyperbolic cross-attention module with soft-entailment loss that effectively models hierarchical relationships between low-level imaging/signal data and high-level clinical parameters. Evaluated on four MIMIC datasets, DDMF-Net achieves state-of-the-art performance with over 2.9% improvement in micro-AUC, enabling more accurate differentiation of cardiac and pulmonary conditions in time-sensitive emergency settings. Code is publicly available at https://github.com/ kknankk/DDMF_Net.

🌉 Interdisciplinary Bridge — Artificial Intelligence and Computer Vision and Deep Learning and Healthcare & Medicine and Machine Learning
🧭 Keyword Pioneer — cardiopulmonary disease
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio