← Application Areas

Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

PVeRA: Probabilistic Vector-Based Random Matrix Adaptation WACV 2026

Beyond Real Weights: Hypercomplex Representations for Stable Quantization WACV 2026

SIRAJ: Diverse and Efficient Red-Teaming for LLM Agents via Distilled Structured Reasoning EACL 2026

iCD: An Implicit Clustering Distillation Method for Structural Information Mining (Student Abstract) AAAI 2026

KETCHUP: K-Step Return Estimation for Sequential Knowledge Distillation EACL 2026

Stratos: An End-to-End Distillation Pipeline for Customized LLMs Under Distributed Cloud Environments AAAI 2026

Error Correction in Radiology Reports: A Knowledge Distillation-Based Multi-Stage Framework AAAI 2026

Democratizing LLM Efficiency: From Hyperscale Optimizations to Universal Deployability AAAI 2026

Deep Model Reuse: Paving the Way for Efficient and Generalizable AI Systems AAAI 2026

Motion Planning Diffusion: Learning and Adapting Robot Motion Planning with Diffusion Models (Abstract Reprint) AAAI 2026

CTPD: Cross Tokenizer Preference Distillation AAAI 2026

BeDKD: Backdoor Defense Based on Directional Mapping Module and Adversarial Knowledge Distillation AAAI 2026

HealSplit: Towards Self-Healing Through Adversarial Distillation in Split Federated Learning AAAI 2026

Language Model Distillation: A Temporal Difference Imitation Learning Perspective AAAI 2026

MetaGDPO: Alleviating Catastrophic Forgetting with Metacognitive Knowledge Through Group Direct Preference Optimization AAAI 2026

ASKD: Reinforcement Learning-Style Knowledge Distillation with Quality-Adaptive Skewness AAAI 2026

ProFuser: Progressive Fusion of Large Language Models AAAI 2026

Listen like a Teacher: Mitigating Whisper Hallucinations Using Adaptive Layer Attention and Knowledge Distillation AAAI 2026

Incoherence as Oracle-less Measure of Error in LLM-Based Code Generation AAAI 2026

Bridging the Tokenizer Gap: Semantics and Distribution-aware Knowledge Transfer for Unbiased Cross-Tokenizer Distillation AAAI 2026

LoKI: Low-Damage Knowledge Implanting of Large Language Models AAAI 2026

LLM-Oriented Token-Adaptive Knowledge Distillation AAAI 2026

OPLoRA: Orthogonal Projection LoRA Prevents Catastrophic Forgetting During Parameter-Efficient Fine-Tuning AAAI 2026

ShieldRAG: Safeguarding Retrieval-Augmented Generation from Untrusted Knowledge Bases AAAI 2026

GrayKD: Distilling Better Knowledge from Black-box LLM via Multi-rationale Injection AAAI 2026