CVPR 2023, highlight paper - Normal-guided Garment UV Prediction for Human Re-texturing

In this episode we discuss Normal-guided Garment UV Prediction for Human Re-texturing by Yasamin Jafarian, Tuanfeng Y. Wang, Duygu Ceylan, Jimei Yang, Nathan Carr, Yi Zhou, Hyun Soo Park. The paper presents a method to edit dressed human images and videos without the need for 3D reconstruction of dynamic clothing. The approach estimates a geometry aware texture map between the garment region in an image and the texture space, using 3D surface normals predicted from the image. The method captures the underlying geometry of the garment in a self-supervised way and outperforms state-of-the-art human UV map estimation approaches on both real and synthetic data.