← Optimization & Theory
Machine Learning › Optimization & Theory ›

Evaluation

515 directly classified papers

Papers per year

Papers

Identifying Open Challenges in Language Identification ACL 2025
LSC-Eval: A General Framework to Evaluate Methods for Assessing Dimensions of Lexical Semantic Change Using LLM-Generated Synthetic Data ACL 2025
Random Splitting Negatively Impacts NER Evaluation: Quantifying and Eliminating the Overestimation of NER Performance ACL 2025
Trade-offs in Image Generation: How Do Different Dimensions Interact? ICCV 2025
SEA-HELM: Southeast Asian Holistic Evaluation of Language Models ACL 2025
Standard Quality Criteria Derived from Current NLP Evaluations for Guiding Evaluation Design and Grounding Comparability and AI Compliance Assessments ACL 2025
Theory of Mind in Large Language Models: Assessment and Enhancement ACL 2025
Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectives IJCAI 2025
HalluLens: LLM Hallucination Benchmark ACL 2025
A Pipeline to Assess Merging Methods via Behavior and Internals EMNLP 2025
Language Model Probabilities are Not Calibrated in Numeric Contexts ACL 2025
SocialEval: Evaluating Social Intelligence of Large Language Models ACL 2025
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation ACL 2025
Towards Evaluation of Language Models with Skill Dimensions: A Case Study on Narrative Question Answering EMNLP 2025
Rubrik’s Cube: Testing a New Rubric for Evaluating Explanations on the CUBE dataset ACL 2025
Readability Reconsidered A Cross-Dataset Analysis of Reference-Free Metrics EMNLP 2025
BIG-Bench Extra Hard ACL 2025
A Statistical and Multi-Perspective Revisiting of the Membership Inference Attack in Large Language Models ACL 2025
On Many-Shot In-Context Learning for Long-Context Evaluation ACL 2025
Using Next Sentence Prediction to Test ChatGPT’s Text Comprehension (Student Abstract) AAAI 2025
PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models ACL 2025
PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning ACL 2025
Logical forms complement probability in understanding language model (and human) performance ACL 2025
Can’t See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs ACL 2025
Lost in Transcription, Found in Distribution Shift: Demystifying Hallucination in Speech Foundation Models ACL 2025