← Back to papers

2025 ICML ICML 2025

DataDecide: How to Predict Best Pretraining Data with Small Experiments

Authors

Ian Magnusson , Nguyen Tai , Ben Bogin , David Heineman , Jena D. Hwang , Luca Soldaini , Akshita Bhagia , Jiacheng Liu , Dirk Groeneveld , Oyvind Tafjord , Noah A. Smith , Pang Wei Koh , Jesse Dodge

Related papers

Scaling Sparse Feature Circuits For Studying In-Context Learning 2025

Incremental Gradient Descent with Small Epoch Counts is Surprisingly Slow on Ill-Conditioned Problems 2025

SToFM: a Multi-scale Foundation Model for Spatial Transcriptomics 2025

Batch List-Decodable Linear Regression via Higher Moments 2025

GS-Bias: Global-Spatial Bias Learner for Single-Image Test-Time Adaptation of Vision-Language Models 2025