← Authors

Michael Auli

73 papers · 2011–2024 · 12 conferences · across top CS/AI conferences

Achievements

πŸƒ Academic Marathon (13) 🌍 Conference Polyglot (12) πŸŒ‰ Interdisciplinary Bridge 🐝 Cross-Pollinator (6) 🌈 Renaissance Researcher (7) πŸ—ΊοΈ Taxonomy Completionist (17) 🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🀝 Dynamic Duo (29) 🧬 Topic Evolution 🌱 Topic Pioneer πŸ”¬ Deep Specialist (18) πŸ† Keyword Champion (2) πŸ—ƒοΈ Keyword Collector (181) ⚑ Prolific Year (6) πŸ’Ž Century Club (73) πŸ”₯ Unstoppable (12) πŸ“ˆ Trend Setter

Conferences

ACL (16) EMNLP (10) INTERSPEECH (10) NAACL (9) IJCNLP (7) ICML (6) ICLR (5) NIPS (4) EACL (2) JMLR (2) CVPR (1) ECCV (1)

Top co-authors

Alexei Baevski (29) David Grangier (14) Sergey Edunov (11) Wei-Ning Hsu (11) Alexis CONNEAU (10) Myle Ott (9) Marc’Aurelio Ranzato (7) Angela Fan (7) Jianfeng Gao (6) Juan Pino (6)

Keywords

self-supervised learning (14) neural machine translation (13) speech recognition (12) machine translation (9) representation learning (6) language model (6) language modeling (6) wav2vec 2.0 (5) multilingual model (5) text generation (5) speech translation (4) beam search (4) sequence to sequence (4) zero-shot learning (3) speech representation (3) sequence-to-sequence model (3) data augmentation (3) semi-supervised learning (3) convolutional neural network (3) transformer model (3)

Papers

Scaling Speech Technology to 1,000+ Languages JMLR 2024
Toward Joint Language Modeling for Speech Units and Text EMNLP 2023
Simple and Effective Unsupervised Speech Translation ACL 2023
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language ICML 2023
DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning NIPS 2023
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale INTERSPEECH 2022
Masked Autoencoders that Listen NIPS 2022
Simple and Effective Zero-shot Cross-lingual Phoneme Recognition INTERSPEECH 2022
Simple and Effective Unsupervised Speech Synthesis INTERSPEECH 2022
On-demand compute reduction with stochastic wav2vec 2.0 INTERSPEECH 2022
Wav2Vec-Aug: Improved self-supervised training with limited data INTERSPEECH 2022
Unified Speech-Text Pre-training for Speech Translation and Recognition ACL 2022
XTREME-S: Evaluating Cross-lingual Speech Representations INTERSPEECH 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language ICML 2022
Multilingual Speech Translation from Efficient Finetuning of Pretrained Models IJCNLP 2021
Self-training Improves Pre-training for Natural Language Understanding NAACL 2021
Beyond English-Centric Multilingual Machine Translation JMLR 2021
Unsupervised Cross-Lingual Representation Learning for Speech Recognition INTERSPEECH 2021
Unsupervised Speech Recognition NIPS 2021
Multilingual Speech Translation from Efficient Finetuning of Pretrained Models ACL 2021
Reservoir Transformers ACL 2021
Discriminative Reranking for Neural Machine Translation ACL 2021
Large-Scale Self- and Semi-Supervised Learning for Speech Translation INTERSPEECH 2021
Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training INTERSPEECH 2021
The Source-Target Domain Mismatch Problem in Machine Translation EACL 2021
Discriminative Reranking for Neural Machine Translation IJCNLP 2021
Reservoir Transformers IJCNLP 2021
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations NIPS 2020
On The Evaluation of Machine Translation Systems Trained With Back-Translation ACL 2020
Robust and On-the-fly Dataset Denoising for Image Classification ECCV 2020
Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling EMNLP 2020
vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations ICLR 2020
Depth-Adaptive Transformer ICLR 2020
Cloze-driven Pretraining of Self-attention Networks IJCNLP 2019
Simple and Effective Noisy Channel Modeling for Neural Machine Translation IJCNLP 2019
wav2vec: Unsupervised Pre-Training for Speech Recognition INTERSPEECH 2019
Wizard of Wikipedia: Knowledge-Powered Conversational Agents ICLR 2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling NAACL 2019
Pre-trained language model representations for language generation NAACL 2019
Simple and Effective Noisy Channel Modeling for Neural Machine Translation EMNLP 2019
Cloze-driven Pretraining of Self-attention Networks EMNLP 2019
Adaptive Input Representations for Neural Language Modeling ICLR 2019
Mixture Models for Diverse Machine Translation: Tricks of the Trade ICML 2019
Pay Less Attention with Lightweight and Dynamic Convolutions ICLR 2019
ELI5: Long Form Question Answering ACL 2019
Facebook FAIR’s WMT19 News Translation Task Submission ACL 2019
3D Human Pose Estimation in Video With Temporal Convolutions and Semi-Supervised Training CVPR 2019
Scaling Neural Machine Translation EMNLP 2018
Analyzing Uncertainty in Neural Machine Translation ICML 2018
Understanding Back-Translation at Scale EMNLP 2018
Controllable Abstractive Summarization ACL 2018
QuickEdit: Editing Text & Translations by Crossing Words Out NAACL 2018
Classical Structured Prediction Losses for Sequence to Sequence Learning NAACL 2018
Convolutional Sequence to Sequence Learning ICML 2017
A Convolutional Encoder Model for Neural Machine Translation ACL 2017
Language Modeling with Gated Convolutional Networks ICML 2017
Strategies for Training Large Vocabulary Neural Language Models ACL 2016
Abstractive Sentence Summarization with Attentive Recurrent Neural Networks NAACL 2016
Expected F-Measure Training for Shift-Reduce Parsing with Recurrent Neural Networks NAACL 2016
Neural Text Generation from Structured Data with Application to the Biography Domain EMNLP 2016
deltaBLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets ACL 2015
CCG Supertagging with a Recurrent Neural Network ACL 2015
deltaBLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets IJCNLP 2015
CCG Supertagging with a Recurrent Neural Network IJCNLP 2015
A Neural Network Approach to Context-Sensitive Generation of Conversational Responses NAACL 2015
Learning Translation Models from Monolingual Continuous Representations NAACL 2015
Minimum Translation Modeling with Recurrent Neural Networks EACL 2014
Decoder Integration and Expected BLEU Training for Recurrent Neural Network Language Models ACL 2014
Large-scale Expected BLEU Training of Phrase-based Reordering Models EMNLP 2014
Joint Language and Translation Modeling with Recurrent Neural Networks EMNLP 2013
A Comparison of Loopy Belief Propagation and Dual Decomposition for Integrated CCG Supertagging and Parsing ACL 2011
Training a Log-Linear Parser with Loss Functions via Softmax-Margin EMNLP 2011
Efficient CCG Parsing: A* versus Adaptive Supertagging ACL 2011