CVPR 2023 - Tracking through Containers and Occluders in the Wild

In this episode we discuss Tracking through Containers and Occluders in the Wild by Authors: - Basile Van Hoorick - Pavel Tokmakov - Simon Stent - Jie Li - Carl Vondrick Affiliations: - Basile Van Hoorick and Carl Vondrick: Columbia University - Pavel Tokmakov and Jie Li: Toyota Research Institute - Simon Stent: Woven Planet. The paper introduces a benchmark and model called TCOW for visual tracking in cluttered and dynamic environments, which is a difficult challenge for computer vision. The goal is to segment both the projected extent of the target object and the surrounding container or occluder in a given video sequence. The authors create a mixture of synthetic and annotated real datasets to support both supervised learning and structured evaluation of model performance and evaluate two transformer-based video models, finding a considerable performance gap in achieving object permanence.