Nathan Paek

2 papers · 2024–2024 · 1 conference · across top CS/AI conferences

Achievements

🌉 Interdisciplinary Bridge 🐝 Cross-Pollinator (15) ❓ The Questioner

Conferences

CONLL (2)

Top co-authors

Hong Meng Yam (2)

Keywords

model compression (1) contrastive learning (1) adversarial learning (1) knowledge distillation (1) language model (1) pre-training datum (1) data composition (1) model capacity (1) small language model (1) sample-efficient training (1)

Papers

What should Baby Models read? Exploring Sample-Efficient Data Composition on Model Performance CONLL 2024

Teaching Tiny Minds: Exploring Methods to Enhance Knowledge Distillation for Small Language Models CONLL 2024