- This event has passed.
Speaker: Mengye Ren – ARNI Continual Learning Working Group Meeting
April 9 @ 3:00 pm - 4:00 pm
Mengye will also be giving a talk on continual learning at the Zemel group meeting an hour prior (at 2pm) that working group attendees are welcome to join if interested. Here’s the abstract of his talk:
Today’s AI models primarily acquire knowledge through offline, i.i.d. learning. While in-context learning offers some capacity for online adaptation, enabling models to continue learning at deployment or even from scratch through experiential streams remains a crucial question. In this talk, I will introduce approaches toward always-learning machines, beginning with video streams. We find that event segmentation—clustering event concepts in lifelong video—enables effective visual representation learning and grouping from scratch. We also show that pretrained VLMs can introspect over past memory and form event clusters through attention, building hierarchical episodic memory for video question answering. Lastly, I will discuss my recent theory linking continual learning and world modeling to self-consciousness.