← Authors

Omer Levy

71 papers · 2013–2025 · 11 conferences · across top CS/AI conferences

Achievements

🐣 Hot Topic Early Bird 🌈 Renaissance Researcher (6) 🐝 Cross-Pollinator (14) πŸƒ Academic Marathon (12) πŸŒ‰ Interdisciplinary Bridge 🌍 Conference Polyglot (11) πŸ—ΊοΈ Taxonomy Completionist (13) 🧭 Keyword Pioneer 🌟 Keyword Trendsetter Combo (3) 🧬 Topic Evolution πŸ† Keyword Champion πŸ”¬ Deep Specialist (10) 🀝 Dynamic Duo (19) ⚑ Prolific Year (10) πŸ’Ž Century Club (71) πŸ—ƒοΈ Keyword Collector (248) ❓ The Questioner (6) πŸ“ˆ Trend Setter πŸš€ Conference Pioneer πŸ”₯ Unstoppable (13)

Conferences

ACL (19) EMNLP (14) NAACL (11) ICLR (6) NIPS (6) CONLL (5) IJCNLP (4) ICML (3) COLING (1) EACL (1) SEMEVAL (1)

Top co-authors

Luke Zettlemoyer (19) Ido Dagan (8) Uri Shaham (7) Jonathan Berant (6) Yuval Kirstain (6) Ori Ram (6) Marjan Ghazvininejad (5) Avia Efrat (5) Mike Lewis (4) Chunting Zhou (4)

Research topics

Understanding (1)

Keywords

question answering (9) large language model (9) language model (6) few-shot learning (5) neural network (5) machine translation (4) transfer learning (4) zero-shot learning (4) natural language understanding (4) text classification (4) word embedding (4) natural language inference (4) representation learning (4) coreference resolution (4) natural language processing (3) masked language model (3) non-autoregressive translation (3) attention mechanism (3) pretrained language model (3) benchmark evaluation (3)

Papers

Keep Guessing? When Considering Inference Scaling, Mind the Baselines NAACL 2025
Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model ICLR 2025
Branch-Solve-Merge Improves Large Language Model Evaluation and Generation NAACL 2024
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length NIPS 2024
Self-Alignment with Instruction Backtranslation ICLR 2024
Altogether: Image Captioning via Re-aligning Alt-text EMNLP 2024
Instruction Induction: From Few Examples to Natural Language Task Descriptions ACL 2023
Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation NIPS 2023
LMentry: A Language Model Benchmark of Elementary Language Tasks ACL 2023
Scaling Laws for Generative Mixed-Modal Language Models ICML 2023
Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor ACL 2023
Causes and Cures for Interference in Multilingual Translation ACL 2023
LIMA: Less Is More for Alignment NIPS 2023
ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding EMNLP 2023
What Do You Get When You Cross Beam Search with Nucleus Sampling? ACL 2022
Simple Local Attentions Remain Competitive for Long-Context Tasks NAACL 2022
SCROLLS: Standardized CompaRison Over Long Language Sequences EMNLP 2022
A Few More Examples May Be Worth Billions of Parameters EMNLP 2022
Transformer Language Models without Positional Encodings Still Learn Positional Information EMNLP 2022
Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens NAACL 2022
Learning to Retrieve Passages without Supervision NAACL 2022
Cryptonite: A Cryptic Crossword Benchmark for Extreme Ambiguity in Language EMNLP 2021
Transformer Feed-Forward Layers Are Key-Value Memories EMNLP 2021
How to Train BERT with an Academic Budget EMNLP 2021
ParaShoot: A Hebrew Question Answering Dataset EMNLP 2021
Can Latent Alignments Improve Autoregressive Machine Translation? NAACL 2021
Neural Machine Translation without Embeddings NAACL 2021
Coreference Resolution without Span Representations IJCNLP 2021
Few-Shot Question Answering by Pretraining Span Selection IJCNLP 2021
Few-Shot Question Answering by Pretraining Span Selection ACL 2021
Coreference Resolution without Span Representations ACL 2021
Generalization through Memorization: Nearest Neighbor Language Models ICLR 2020
Structural Language Models of Code ICML 2020
Aligned Cross Entropy for Non-Autoregressive Machine Translation ICML 2020
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension ACL 2020
Improving Transformer Models by Reordering their Sublayers ACL 2020
Blockwise Self-Attention for Long Document Understanding EMNLP 2020
pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference NAACL 2019
Are Sixteen Heads Really Better than One? NIPS 2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems NIPS 2019
What Does BERT Look at? An Analysis of BERT’s Attention ACL 2019
BERT for Coreference Resolution: Baselines and Analysis EMNLP 2019
Mask-Predict: Parallel Decoding of Conditional Masked Language Models EMNLP 2019
Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation EMNLP 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding ICLR 2019
code2seq: Generating Sequences from Structured Representations of Code ICLR 2019
BERT for Coreference Resolution: Baselines and Analysis IJCNLP 2019
Mask-Predict: Parallel Decoding of Conditional Masked Language Models IJCNLP 2019
Deep RNNs Encode Soft Hierarchical Syntax ACL 2018
Ultra-Fine Entity Typing ACL 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding EMNLP 2018
Simulating Action Dynamics with Neural Process Networks ICLR 2018
LSTMs Exploit Linguistic Attributes of Data ACL 2018
Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum ACL 2018
Annotation Artifacts in Natural Language Inference Data NAACL 2018
Proceedings of the Workshop on Generalization in the Age of Deep Learning NAACL 2018
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling ACL 2018
Named Entity Disambiguation for Noisy Text CONLL 2017
Zero-Shot Relation Extraction via Reading Comprehension CONLL 2017
A Strong Baseline for Learning Cross-Lingual Word Embeddings from Sentence Alignments EACL 2017
Annotating Relation Inference in Context via Question Answering ACL 2016
Modeling Extractive Sentence Intersection via Subtree Entailment COLING 2016
Do Supervised Distributional Methods Really Learn Lexical Inference Relations? NAACL 2015
Learning to Exploit Structured Resources for Lexical Inference CONLL 2015
The Excitement Open Platform for Textual Inferences ACL 2014
Linguistic Regularities in Sparse and Explicit Word Representations CONLL 2014
Focused Entailment Graphs for Open IE Propositions CONLL 2014
Neural Word Embedding as Implicit Matrix Factorization NIPS 2014
Dependency-Based Word Embeddings ACL 2014
Recognizing Partial Textual Entailment ACL 2013
UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis SEMEVAL 2013