2024
IJCAI
IJCAI 2024
FasterVD: On Acceleration of Video Diffusion Models
Abstract
Equipped with Denoising Diffusion Probabilistic Models, video content generation has gained significant research interest recently. However, diffusion pipelines call for intensive computation and model storage, which poses challenges for their wide and efficient deployment. In this work, we address this issue by integrating LCM-LoRA to reduce the denoising steps and escalating the video generation process by frame skipping and interpolation. Our framework achieves an approximately 10Γ inference acceleration for high-quality realistic video generation on commonly available GPUs.
π
Interdisciplinary Bridge
β Deep Learning and Machine Learning
π§
Keyword Pioneer
β denoising step
π
Cross-Pollinator
β Artificial Intelligence, Computer Vision, Deep Learning, Machine Learning, Natural Language Processing, Speech & Audio
π£
Hot Topic Early Bird
β video diffusion
Authors
Pinrui Yu
,
Dan Luo
,
Timothy Rupprecht
,
LEI LU
,
Zhenglun Kong
,
Pu Zhao
,
Yanyu Li
,
Octavia Camps
,
Xue Lin
,
Yanzhi Wang