2024
ICML
ICML 2024
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
Authors
Yihua Zhang
,
Pingzhi Li
,
Junyuan Hong
,
Jiaxiang Li
,
Yimeng Zhang
,
Wenqing Zheng
,
Pin-Yu Chen
,
Jason D. Lee
,
Wotao Yin
,
Mingyi Hong
,
Zhangyang Wang
,
Sijia Liu
,
Tianlong Chen