← Authors

Nitika Mathur

11 papers · 2015–2025 · 3 conferences · across top CS/AI conferences

Achievements

πŸ—ΊοΈ Taxonomy Completionist (25) 🧭 Keyword Pioneer 🌍 Conference Polyglot (3) 🐣 Hot Topic Early Bird 🐝 Cross-Pollinator (15) 🌈 Renaissance Researcher (6) πŸŒ‰ Interdisciplinary Bridge πŸƒ Academic Marathon (10) 🧬 Topic Evolution πŸ“ˆ Trend Setter πŸ’Ž Century Club (11) πŸ”₯ Unstoppable (7) ❓ The Questioner πŸ—ƒοΈ Keyword Collector (50)

Conferences

EMNLP (8) ACL (2) NAACL (1)

Top co-authors

Markus Freitag (5) Chi-kiu Lo (4) Alon Lavie (4) Ricardo Rei (4) Timothy Baldwin (4) Tom Kocmi (3) Eleftherios Avramidis (3) Trevor Cohn (3) Brian Thompson (3) Craig Stewart (3)

Keywords

human evaluation (6) machine translation (5) bleu score (3) automatic metric (3) evaluation metric (3) neural metric (2) correlation analysis (2) metric correlation (2) translation evaluation (2) quality assessment (2) statistical significance (1) text classification (1) contextual embedding (1) annotation quality (1) quality estimation (1) reference translation (1) machine translation evaluation (1) automatic evaluation (1) translation quality (1) crowdsourced annotation (1)

Papers

Taming the Real-world Complexities in CPT E/M Coding with Large Language Models EMNLP 2025
Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy EMNLP 2024
Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task EMNLP 2024
Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent EMNLP 2023
Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust EMNLP 2022
Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain EMNLP 2021
Results of the WMT20 Metrics Shared Task EMNLP 2020
Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics ACL 2020
Putting Evaluation in Context: Contextual Embeddings Improve Machine Translation Evaluation ACL 2019
Sequence Effects in Crowdsourced Annotations EMNLP 2017
Accurate Evaluation of Segment-level Machine Translation Metrics NAACL 2015