Arxiv paper - Align3R: Aligned Monocular Depth Estimation for Dynamic Videos

In this episode, we discuss Align3R: Aligned Monocular Depth Estimation for Dynamic Videos by Jiahao Lu, Tianyu Huang, Peng Li, Zhiyang Dou, Cheng Lin, Zhiming Cui, Zhen Dong, Sai-Kit Yeung, Wenping Wang, Yuan Liu. Align3R is introduced as a method for achieving temporally consistent depth maps in videos using monocular inputs, addressing the challenge of maintaining consistency across frames. It leverages the DUSt3R model, enhanced with fine-tuning and optimization of depth maps and camera poses, particularly for dynamic scenes. The effectiveness of Align3R is supported by extensive experiments demonstrating its superiority over baseline methods in delivering consistent video depth and camera pose estimations.