CVPR 2023, highlight paper - Real-Time Evaluation in Online Continual Learning: A New Hope

In this episode we discuss Real-Time Evaluation in Online Continual Learning: A New Hope by Yasir Ghunaim, Adel Bibi, Kumail Alhamoud, Motasem Alfarra, Hasan Abed Al Kader Hammoud, Ameya Prabhu, Philip H. S. Torr, Bernard Ghanem. The paper proposes a practical real-time evaluation of Continual Learning (CL) methods, which takes into account computational costs and does not assume unlimited training time. The evaluation was conducted on a large-scale dataset called CLOC, containing 39 million time-stamped images with geolocation labels. The results show that a simple baseline outperforms state-of-the-art CL methods, suggesting that existing methods may not be applicable in realistic settings. The authors recommend considering computational cost in the development of online continual learning methods.