Xiao Sheng

3 papers · 2023–2024 · 3 conferences · across top CS/AI conferences

Achievements

🌉 Interdisciplinary Bridge 🧭 Keyword Pioneer 🌍 Conference Polyglot (3) 🐝 Cross-Pollinator (7)

Conferences

ICCV (1) ICML (1) NIPS (1)

Top co-authors

Yixing Xu (3) Dong Li (3) Fan Jiang (3) CHAO LI (3) Lu Tian (3) Emad Barsoum (2) Ashish Sirasao (2)

Keywords

vision transformer (2) self-attention mechanism (1) computational complexity (1) efficient computing (1) masked autoencoder (1) linear attention (1) quadratic taylor expansion (1) model efficiency (1) hierarchical architecture (1) computational cost reduction (1) flexible downsampling (1)

Papers

QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion NIPS 2024

Enhancing Vision Transformer: Amplifying Non-Linearity in Feedforward Network Module ICML 2024

FDViT: Improve the Hierarchical Architecture of Vision Transformer ICCV 2023