Arxiv paper - MatAnyone: Stable Video Matting with Consistent Memory Propagation

In this episode, we discuss MatAnyone: Stable Video Matting with Consistent Memory Propagation by Peiqing Yang, Shangchen Zhou, Jixin Zhao, Qingyi Tao, Chen Change Loy. The paper introduces **MatAnyone**, a robust framework for target-assigned video matting that overcomes challenges posed by complex or ambiguous backgrounds without relying on auxiliary inputs. It employs a memory-based approach with a consistent memory propagation module and region-adaptive memory fusion to maintain semantic stability and preserve detailed object boundaries across frames. Additionally, the authors present a large, high-quality dataset and a novel training strategy leveraging extensive segmentation data to enhance matting stability and performance.