Continual Learning from Pretrained Models
Abstract: Continual Learning (CL) is a paradigm where an agent learns over time from a stream of data. In this talk, we will discuss how to exploit pretrained models in CL. First, we will talk about “continual pretraining”, a scenario where a large pretrained model is updated over time. The results show that continual pretraining … Read more