2025
ICML
ICML 2025
EPIC: Efficient Position-Independent Caching for Serving Large Language Models
Authors
Junhao Hu
,
Wenrui Huang
,
Weidong Wang
,
Haoyi Wang
,
Tiancheng Hu
,
Zhang Qin
,
Hao Feng
,
Xusheng Chen
,
Yizhou Shan
,
Tao Xie