Free Reads
Sign in to view your remaining parses.
Tag Filter
Acceleration of Diffusion Models
Radial Attention: $O(n\log n)$ Sparse Attention with Energy Decay for Long Video Generation
Published:6/25/2025
Video Generation MechanismSparse Attention MechanismAcceleration of Diffusion ModelsLong Video GenerationEnergy Decay Phenomenon
This paper introduces Radial Attention, a sparse attention mechanism with complexity, addressing high computational costs in long video generation. It leverages spatiotemporal energy decay to enhance efficiency and maintain performance during extended generation.
03
Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity
Published:2/4/2025
Acceleration of Diffusion ModelsVideo Generation TransformerSpatial-Temporal SparsityEfficient Inference FrameworkDynamic Sparse Patterns
Sparse VideoGen (SVG) enhances video generation efficiency by leveraging the inherent sparsity of 3D attention, classifying attention heads into spatial and temporal types. It achieves up to 2.33x acceleration while maintaining generation quality, with opensource code available.
05