← Authors

Roy Schwartz

55 papers · 2011–2026 · 12 conferences · across top CS/AI conferences

Achievements

πŸƒ Academic Marathon (14) 🌈 Renaissance Researcher (5) 🐝 Cross-Pollinator (11) πŸŒ‰ Interdisciplinary Bridge 🌍 Conference Polyglot (11) πŸ—ΊοΈ Taxonomy Completionist (91) 🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🌱 Topic Pioneer 🀝 Dynamic Duo (22) πŸ—ƒοΈ Keyword Collector (199) ❓ The Questioner (4) ⚑ Prolific Year (6) πŸ“ˆ Trend Setter πŸ’Ž Century Club (54) πŸ”₯ Unstoppable (15)

Conferences

EMNLP (16) ACL (12) NAACL (9) IJCNLP (5) CONLL (3) COLING (2) ICLR (2) NIPS (2) AAAI (1) COLT (1) EACL (1) ICCV (1)

Top co-authors

Noah A. Smith (22) Hao Peng (10) Ari Rappoport (9) Gabriel Stanovsky (7) Jesse Dodge (6) Roi Reichart (5) Michael Hassid (5) Yonatan Bitton (5) Suchin Gururangan (4) Dallas Card (3)

Keywords

language model (9) text classification (7) attention mechanism (6) recurrent neural network (5) multimodal learning (4) natural language processing (3) visual question answering (3) language modeling (3) validation performance (3) neural architecture (3) natural language inference (3) constituency parsing (2) early exit (2) model compression (2) sparse regularization (2) convolutional neural network (2) knowledge base (2) unsupervised learning (2) unsupervised parsing (2) entity linking (2)

Papers

How Quantization Shapes Bias in Large Language Models EACL 2026
On Pruning State-Space LLMs EMNLP 2025
Context Length Alone Hurts LLM Performance Despite Perfect Retrieval EMNLP 2025
From Tokens to Words: On the Inner Lexicon of LLMs ICLR 2025
Attend First, Consolidate Later: On the Importance of Attention in Different LLM Layers EMNLP 2024
Transformers are Multi-State RNNs EMNLP 2024
Beyond Performance: Quantifying and Mitigating Label Bias in LLMs NAACL 2024
VASR: Visual Analogies of Situation Recognition AAAI 2023
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images ICCV 2023
Textually Pretrained Speech Language Models NIPS 2023
Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings ACL 2023
Curating Datasets for Better Performance with Example Training Dynamics ACL 2023
Fighting Bias With Bias: Promoting Model Robustness by Amplifying Dataset Biases ACL 2023
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models NIPS 2022
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations NAACL 2022
How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers EMNLP 2022
ABC: Attention with Bounded-memory Control ACL 2022
Data Contamination: From Memorization to Exploitation ACL 2022
Fewer Errors, but More Stereotypes? The Effect of Model Size on Gender Bias NAACL 2022
Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent EMNLP 2021
Data Efficient Masked Language Modeling for Vision and Language EMNLP 2021
Expected Validation Performance and Estimation of a Random Variable’s Maximum EMNLP 2021
Extracting a Knowledge Base of Mechanisms from COVID-19 Papers NAACL 2021
Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA NAACL 2021
Random Feature Attention ICLR 2021
The Right Tool for the Job: Matching Model and Instance Complexities ACL 2020
A Mixture of h - 1 Heads is Better than h Heads ACL 2020
A Formal Hierarchy of RNN Architectures ACL 2020
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics EMNLP 2020
Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets NAACL 2019
Knowledge Enhanced Contextual Word Representations EMNLP 2019
RNN Architecture Learning with Sparse Regularization EMNLP 2019
Show Your Work: Improved Reporting of Experimental Results EMNLP 2019
PaLM: A Hybrid Parser and Language Model EMNLP 2019
Knowledge Enhanced Contextual Word Representations IJCNLP 2019
RNN Architecture Learning with Sparse Regularization IJCNLP 2019
Show Your Work: Improved Reporting of Experimental Results IJCNLP 2019
PaLM: A Hybrid Parser and Language Model IJCNLP 2019
A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications NAACL 2018
SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference EMNLP 2018
Rational Recurrences EMNLP 2018
LSTMs Exploit Linguistic Attributes of Data ACL 2018
Bridging CNNs, RNNs, and Weighted Finite-State Machines ACL 2018
Annotation Artifacts in Natural Language Inference Data NAACL 2018
Automatic Selection of Context Configurations for Improved Class-Specific Word Representations CONLL 2017
The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task CONLL 2017
Symmetric Patterns and Coordinations: Fast and Enhanced Representations of Verbs and Adjectives NAACL 2016
Symmetric Pattern Based Word Embeddings for Improved Word Similarity Prediction CONLL 2015
How Well Do Distributional Models Capture Different Types of Semantic Knowledge? ACL 2015
How Well Do Distributional Models Capture Different Types of Semantic Knowledge? IJCNLP 2015
Minimally Supervised Classification to Semantic Categories using Automatically Acquired Symmetric Patterns COLING 2014
Authorship Attribution of Micro-Messages EMNLP 2013
Learnability-Based Syntactic Annotation Design COLING 2012
Unsupervised SVMs: On the Complexity of the Furthest Hyperplane Problem COLT 2012
Neutralizing Linguistically Problematic Annotations in Unsupervised Dependency Parsing Evaluation ACL 2011