David So
7 papers
· 2019–2023
· 3 conferences
· across top CS/AI conferences
Achievements
π
Interdisciplinary Bridge
π
Conference Polyglot
(3)
π£
Hot Topic Early Bird
π
Cross-Pollinator
(13)
πΊοΈ
Taxonomy Completionist
(15)
π§
Keyword Pioneer
Conferences
ICML (3)
NIPS (3)
EMNLP (1)
Top co-authors
Keywords
neural architecture search
(4)
transformer architecture
(4)
evolutionary algorithm
(3)
language model
(2)
efficient computing
(2)
neural architecture
(1)
gradient descent
(1)
learning algorithm
(1)
scaling law
(1)
sequence model
(1)
weight averaging
(1)
feed-forward network
(1)
multilayer perceptron
(1)
evolutionary search
(1)
prompt tuning
(1)
model efficiency
(1)
algorithm discovery
(1)
layer normalization
(1)
gating mechanism
(1)
emergent abilities
(1)
Papers
Pay Attention to MLPs
NIPS 2021
The Evolved Transformer
ICML 2019