← Authors

Neil Houlsby

43 papers · 2012–2024 · 9 conferences · across top CS/AI conferences

Achievements

🌍 Conference Polyglot (9) 🌈 Renaissance Researcher (6) 🐝 Cross-Pollinator (15) πŸƒ Academic Marathon (12) πŸŒ‰ Interdisciplinary Bridge πŸ—ΊοΈ Taxonomy Completionist (11) 🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🌟 Keyword Trendsetter Combo (3) 🀝 Dynamic Duo (14) πŸ‘₯ Mega-Team (43) πŸ‘‘ Triple Crown 🧬 Topic Evolution πŸ† Keyword Champion (4) πŸ’Ž Century Club (43) πŸ“ˆ Trend Setter πŸš€ Conference Pioneer πŸ”₯ Unstoppable (7) πŸ—ƒοΈ Keyword Collector (138) ⚑ Prolific Year (7)

Conferences

NIPS (12) ICLR (10) CVPR (7) ICML (7) ECCV (2) WACV (2) AISTATS (1) EMNLP (1) JMLR (1)

Top co-authors

Xiaohua Zhai (14) Mario Lucic (11) Basil Mustafa (11) Mostafa Dehghani (10) Lucas Beyer (10) Joan Puigcerver (10) Matthias Minderer (9) Alexander Kolesnikov (9) Michael Tschannen (8) Sylvain Gelly (7)

Keywords

transfer learning (7) representation learning (6) image classification (6) vision transformer (5) few-shot learning (5) vision-language model (5) self-supervised learning (5) model scaling (4) active learning (3) multimodal learning (3) contrastive learning (3) image captioning (2) probabilistic matrix factorization (2) out-of-distribution generalization (2) zero-shot learning (2) distribution shift (2) collaborative filtering (2) visual question answering (2) variational inference (2) domain generalization (2)

Papers

SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretation NIPS 2024
Location-Aware Self-Supervised Transformers for Semantic Segmentation WACV 2024
On Scaling Up a Multilingual Vision and Language Model CVPR 2024
Frozen Feature Augmentation for Few-Shot Image Classification CVPR 2024
Scaling Laws for Sparsely-Connected Foundation Models ICLR 2024
From Sparse to Soft Mixtures of Experts ICLR 2024
PaLI: A Jointly-Scaled Multilingual Language-Image Model ICLR 2023
Massively Scaling Heteroscedastic Classifiers ICLR 2023
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints ICLR 2023
UL2: Unifying Language Learning Paradigms ICLR 2023
CLIPPO: Image-and-Language Understanding From Pixels Only CVPR 2023
Transcending Scaling Laws with 0.1% Extra Compute EMNLP 2023
Scaling Vision Transformers to 22 Billion Parameters ICML 2023
Adaptive Computation with Elastic Input Sequence ICML 2023
Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution NIPS 2023
Image Captioners Are Scalable Vision Learners Too NIPS 2023
Scaling Open-Vocabulary Object Detection NIPS 2023
Scaling Vision Transformers CVPR 2022
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts NIPS 2022
UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes NIPS 2022
Simple Open-Vocabulary Object Detection with Vision Transformers ECCV 2022
Underspecification Presents Challenges for Credibility in Modern Machine Learning JMLR 2022
Representation Learning From Videos In-the-Wild: An Object-Centric Approach WACV 2021
Scalable Transfer Learning with Expert Models ICLR 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale ICLR 2021
On Robustness and Transferability of Convolutional Neural Networks CVPR 2021
MLP-Mixer: An all-MLP Architecture for Vision NIPS 2021
Revisiting the Calibration of Modern Neural Networks NIPS 2021
Scaling Vision with Sparse Mixture of Experts NIPS 2021
Big Transfer (BiT): General Visual Representation Learning ECCV 2020
Self-Supervised Learning of Video-Induced Visual Invariances CVPR 2020
Automatic Shortcut Removal for Self-Supervised Representation Learning ICML 2020
Parameter-Efficient Transfer Learning for NLP ICML 2019
Self-Supervised GANs via Auxiliary Rotation Loss CVPR 2019
On Self Modulation for Generative Adversarial Networks ICLR 2019
Ask the Right Questions: Active Question Reformulation with Reinforcement Learning ICLR 2018
Transfer Learning with Neural AutoML NIPS 2018
Cold-start Active Learning with Robust Ordinal Matrix Factorization ICML 2014
Stochastic Inference for Scalable Probabilistic Modeling of Binary Matrices ICML 2014
Probabilistic Matrix Factorization with Non-random Missing Data ICML 2014
A Filtering Approach to Stochastic Variational Inference NIPS 2014
Active Learning for Interactive Visualization AISTATS 2013
Collaborative Gaussian Processes for Preference Learning NIPS 2012