Anirudh Ravula
5 papers
· 2020–2021
· 5 conferences
· across top CS/AI conferences
Achievements
π
Conference Polyglot
(5)
π
Interdisciplinary Bridge
πΊοΈ
Taxonomy Completionist
(10)
π§
Keyword Pioneer
π£
Hot Topic Early Bird
π
Cross-Pollinator
(15)
Conferences
ACL (1)
EACL (1)
EMNLP (1)
IJCNLP (1)
NIPS (1)
Top co-authors
Keywords
question answering
(2)
transformer architecture
(2)
text summarization
(1)
knowledge base completion
(1)
sparse attention
(1)
contrastive predictive coding
(1)
entity representation
(1)
sequence length
(1)
genomics datum
(1)
relative position encoding
(1)
ranked retrieval
(1)
extended transformer construction
(1)
global-local attention
(1)
long input
(1)
structured input
(1)
sparse attention mechanism
(1)
self-supervised learning
(1)
Papers
RealFormer: Transformer Likes Residual Attention
IJCNLP 2021