← Authors

Barret Zoph

29 papers · 2015–2024 · 10 conferences · across top CS/AI conferences

Achievements

🐣 Hot Topic Early Bird πŸŒ‰ Interdisciplinary Bridge 🧭 Keyword Pioneer 🌍 Conference Polyglot (10) πŸƒ Academic Marathon (9) 🐝 Cross-Pollinator (11) 🌈 Renaissance Researcher (6) πŸ—ΊοΈ Taxonomy Completionist (39) πŸ‘₯ Mega-Team (67) 🀝 Dynamic Duo (12) 🌱 Topic Pioneer ❓ The Questioner ⚑ Prolific Year (6) πŸš€ Conference Pioneer πŸ“ˆ Trend Setter πŸ’Ž Century Club (29) πŸ—ƒοΈ Keyword Collector (67) πŸ”₯ Unstoppable (10)

Conferences

ICML (5) ECCV (4) NIPS (4) CVPR (3) JMLR (3) NAACL (3) EMNLP (2) ICCV (2) ICLR (2) INTERSPEECH (1)

Top co-authors

Quoc V. Le (12) Jonathon Shlens (7) Ekin D. Cubuk (6) Tsung-Yi Lin (5) Denny Zhou (5) Ekin Dogus Cubuk (5) Vijay Vasudevan (5) Jason Wei (5) Shayne Longpre (4) Kevin Robinson (4)

Keywords

image classification (5) neural architecture search (5) data augmentation (5) transfer learning (5) semi-supervised learning (3) language model (3) model scaling (3) few-shot learning (2) mixture of expert (2) object detection (2) parameter efficiency (2) large language model (2) semantic segmentation (2) sparse activation (2) convolutional neural network (2) automatic speech recognition (1) scene parsing (1) reinforcement learning (1) policy search (1) knowledge distillation (1)

Papers

A Pretrainer’s Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity NAACL 2024
Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models ICLR 2024
Scaling Instruction-Finetuned Language Models JMLR 2024
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning ICML 2023
PaLM: Scaling Language Modeling with Pathways JMLR 2023
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts ICML 2022
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity JMLR 2022
Multi-Task Self-Training for Learning General Representations ICCV 2021
Revisiting ResNets: Improved Training and Scaling Strategies NIPS 2021
Simple Copy-Paste Is a Strong Data Augmentation Method for Instance Segmentation CVPR 2021
Learning Data Augmentation Strategies for Object Detection ECCV 2020
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty ICLR 2020
Improving 3D Object Detection through Progressive Population Based Augmentation ECCV 2020
Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation ECCV 2020
RandAugment: Practical Automated Data Augmentation with a Reduced Search Space NIPS 2020
Rethinking Pre-training and Self-training NIPS 2020
AutoAugment: Learning Augmentation Strategies From Data CVPR 2019
Attention Augmented Convolutional Networks ICCV 2019
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition INTERSPEECH 2019
Progressive Neural Architecture Search ECCV 2018
Learning Transferable Architectures for Scalable Image Recognition CVPR 2018
Understanding and Simplifying One-Shot Architecture Search ICML 2018
Efficient Neural Architecture Search via Parameters Sharing ICML 2018
Searching for Efficient Multi-Scale Architectures for Dense Image Prediction NIPS 2018
Neural Optimizer Search with Reinforcement Learning ICML 2017
Transfer Learning for Low-Resource Neural Machine Translation EMNLP 2016
Simple, Fast Noise-Contrastive Estimation for Large RNN Vocabularies NAACL 2016
Multi-Source Neural Translation NAACL 2016
How Much Information Does a Human Translator Add to the Original? EMNLP 2015