Ryan Sepassi

5 papers · 2018–2023 · 3 conferences · across top CS/AI conferences

Achievements

🐝 Cross-Pollinator (15) 🌍 Conference Polyglot (3) 🏃 Academic Marathon (5) 🗺️ Taxonomy Completionist (13) 🐣 Hot Topic Early Bird 🌈 Renaissance Researcher (5) 🌉 Interdisciplinary Bridge 👥 Mega-Team (67) 🚀 Conference Pioneer

Conferences

ICLR (2) JMLR (2) NIPS (1)

Top co-authors

Noam Shazeer (4) Jacob Austin (2) James Bradbury (2) Gaurav Mishra (2) Mark Omernick (2) Noah Fiedel (2) Brennan Saeta (2) Adam Roberts (2) Aitor Lewkowycz (2) Afroz Mohiuddin (2)

Keywords

distributed computing (2) large language model (2) model parallelism (1) distributed training (1) model scaling (1) data parallelism (1) data pipeline (1) tensor computation (1) multi-step reasoning (1) transformer model (1) few-shot learning (1) neural network (1) deep learning (1)

Papers

PaLM: Scaling Language Modeling with Pathways JMLR 2023

Scaling Up Models and Data with t5x and seqio JMLR 2023

Model Based Reinforcement Learning for Atari ICLR 2020

Mesh-TensorFlow: Deep Learning for Supercomputers NIPS 2018

Generating Wikipedia by Summarizing Long Sequences ICLR 2018