← Learning Types
Machine Learning › Learning Types ›

Multimodal Learning

85 directly classified papers

Papers per year

Papers

Multimodal Large Language Models Make Text-to-Image Generative Models Align Better NIPS 2024
Learning Multi-Scale Video-Text Correspondence for Weakly Supervised Temporal Article Gronding AAAI 2024
Dual Memory Fusion for Multimodal Speech Emotion Recognition INTERSPEECH 2023
MMER: Multimodal Multi-task Learning for Speech Emotion Recognition INTERSPEECH 2023
Segmental SpeechCLIP: Utilizing Pretrained Image-text Models for Audio-Visual Learning INTERSPEECH 2023
GrowCLIP: Data-Aware Automatic Model Growing for Large-scale Contrastive Language-Image Pre-Training ICCV 2023
Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models EMNLP 2023
Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairs EMNLP 2023
Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework NIPS 2023
Human-Centred Multimodal Deep Learning Models for Chest X-Ray Diagnosis IJCAI 2023
Putting Natural in Natural Language Processing ACL 2023
Improving Grammatical Error Correction with Multimodal Feature Integration ACL 2023
TOT：Topology-Aware Optimal Transport for Multimodal Hate Detection AAAI 2023
A Multimodal Investigation of Speech, Text, Cognitive and Facial Video Features for Characterizing Depression With and Without Medication INTERSPEECH 2023
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval CVPR 2022
Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality EMNLP 2022
Prompting for Multimodal Hateful Meme Classification EMNLP 2022
TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection EMNLP 2022
Self-supervised Cross-modal Pretraining for Speech Emotion Recognition and Sentiment Analysis EMNLP 2022
Multimodal Conversation Modelling for Topic Derailment Detection EMNLP 2022
Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition ACL 2022
Missing Modality meets Meta Sampling (M3S): An Efficient Universal Approach for Multimodal Sentiment Analysis with Missing Modality AACL 2022
Enriching Language Models with Visually-grounded Word Vectors and the Lancaster Sensorimotor Norms EMNLP 2021
Look Before You Speak: Visually Contextualized Utterances CVPR 2021
Investigating Negation in Pre-trained Vision-and-language Models EMNLP 2021