← Back to papers

2021 ACL ACL 2021

On the Distribution, Sparsity, and Inference-time Quantization of Attention Values in Transformers

Authors

Tianchu Ji , Shraddhan Jain , Michael Ferdman , Peter Milder , H. Andrew Schwartz , Niranjan Balasubramanian

Related papers

Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training 2021

A Non-Autoregressive Edit-Based Approach to Controllable Text Simplification 2021

How Did This Get Funded?! Automatically Identifying Quirky Scientific Achievements 2021

Exploring Discourse Structures for Argument Impact Classification 2021

Language Embeddings for Typology and Cross-lingual Transfer Learning 2021