Arxiv paper - DanceGRPO: Unleashing GRPO on Visual Generation

In this episode, we discuss DanceGRPO: Unleashing GRPO on Visual Generation by Zeyue Xue, Jie Wu, Yu Gao, Fangyuan Kong, Lingting Zhu, Mengzhao Chen, Zhiheng Liu, Wei Liu, Qiushan Guo, Weilin Huang, Ping Luo. The paper presents DanceGRPO, a unified reinforcement learning framework that adapts Group Relative Policy Optimization to various generative paradigms, including diffusion models and rectified flows, across multiple visual generation tasks. It effectively addresses challenges in stability, compatibility with ODE-based sampling, and video generation, demonstrating significant performance improvements over existing methods. DanceGRPO enables scalable and versatile RL-based alignment of model outputs with human preferences in visual content creation.