← Authors

Orhan Firat

55 papers · 2016–2025 · 12 conferences · across top CS/AI conferences

Achievements

🌍 Conference Polyglot (12) πŸƒ Academic Marathon (9) 🐝 Cross-Pollinator (11) πŸ—ΊοΈ Taxonomy Completionist (64) πŸŒ‰ Interdisciplinary Bridge 🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🌈 Renaissance Researcher (6) 🌟 Keyword Trendsetter Combo (4) 🀝 Dynamic Duo (19) πŸ‘‘ Triple Crown πŸ† Grand Slam πŸ‘₯ Mega-Team (67) 🌱 Topic Pioneer πŸ”¬ Deep Specialist (29) πŸ† Keyword Champion (2) πŸ—ƒοΈ Keyword Collector (165) πŸ“ˆ Trend Setter ⚑ Prolific Year (12) πŸ”₯ Unstoppable (10) ❓ The Questioner (2) πŸ’Ž Century Club (55)

Conferences

EMNLP (15) ICLR (7) NIPS (7) ACL (6) ICML (6) NAACL (6) IJCNLP (3) AAAI (1) AACL (1) EACL (1) INTERSPEECH (1) JMLR (1)

Top co-authors

Ankur Bapna (19) Xavier Garcia (11) Melvin Johnson (9) Behrooz Ghorbani (8) Biao Zhang (7) Aditya Siddhant (6) Sneha Kudugunta (6) Ankush Garg (6) Colin Cherry (6) Yuan Cao (5)

Keywords

neural machine translation (20) cross-lingual transfer (9) multilingual translation (9) low-resource language (8) machine translation (7) multilingual neural machine translation (6) transfer learning (6) domain adaptation (4) zero-shot translation (4) language model (4) large language model (4) model compression (3) representation learning (3) deep learning (2) parallel corpus (2) multilingual machine translation (2) transformer architecture (2) few-shot learning (2) multi-task learning (2) benchmark evaluation (2)

Papers

BIG-Bench Extra Hard ACL 2025
When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method ICLR 2024
Scaling Sign Language Translation NIPS 2024
Binarized Neural Machine Translation NIPS 2023
Order Matters in the Presence of Dataset Imbalance for Multilingual Learning NIPS 2023
MADLAD-400: A Multilingual And Document-Level Large Audited Dataset NIPS 2023
UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining ICLR 2023
Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction AACL 2023
Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction IJCNLP 2023
The Unreasonable Effectiveness of Few-shot Learning for Machine Translation ICML 2023
Scaling Laws for Multilingual Neural Machine Translation ICML 2023
Block-State Transformers NIPS 2023
PaLM: Scaling Language Modeling with Pathways JMLR 2023
The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation EMNLP 2023
GATITOS: Using a New Multilingual Lexicon for Low-resource Machine Translation EMNLP 2023
Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation ACL 2022
Do Current Multi-Task Optimization Methods in Deep Learning Even Help? NIPS 2022
Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents ACL 2022
A Loss Curvature Perspective on Training Instabilities of Deep Learning Models ICLR 2022
Scaling Laws for Neural Machine Translation ICLR 2022
Data Scaling Laws in NMT: The Effect of Noise and Architecture ICML 2022
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts ICML 2022
Examining Scaling and Transfer of Language Model Architectures for Machine Translation ICML 2022
XTREME-S: Evaluating Cross-lingual Speech Representations INTERSPEECH 2022
Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages NAACL 2021
A Large-Scale Study of Machine Translation in Turkic Languages EMNLP 2021
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation EMNLP 2021
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021
Evaluating Multiway Multilingual NMT in the Turkic Languages EMNLP 2021
Explicit Alignment Objectives for Multilingual Bidirectional Encoders NAACL 2021
Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution NAACL 2021
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding ICLR 2021
Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation ICLR 2021
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models ICLR 2021
Complete Multilingual Neural Machine Translation EMNLP 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation ICML 2020
Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation ACL 2020
Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation AAAI 2020
Towards End-to-End In-Image Neural Machine Translation EMNLP 2020
On the Discrepancy between Density Estimation and Sequence Generation EMNLP 2020
Investigating Multilingual NMT Representations at Scale EMNLP 2019
Non-Parametric Adaptation for Neural Machine Translation NAACL 2019
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism NIPS 2019
Findings of the First Shared Task on Machine Translation Robustness ACL 2019
Simple, Scalable Adaptation for Neural Machine Translation IJCNLP 2019
Investigating Multilingual NMT Representations at Scale IJCNLP 2019
Massively Multilingual Neural Machine Translation NAACL 2019
Simple, Scalable Adaptation for Neural Machine Translation EMNLP 2019
On the Importance of Word Boundaries in Character-level Neural Machine Translation EMNLP 2019
Training Deeper Neural Machine Translation Models with Transparent Attention EMNLP 2018
The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation ACL 2018
Revisiting Character-Based Neural Machine Translation with Capacity and Compression EMNLP 2018
Nematus: a Toolkit for Neural Machine Translation EACL 2017
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism NAACL 2016
Zero-Resource Translation with Multi-Lingual Neural Machine Translation EMNLP 2016