Self-supervised pre-training for the embodied Turing test

PI: Jianbo Shi
Co-PI: Carl Vondrick and Nikolaus Kriegeskorte 

Abstract

Natural intelligence is much more energy efficient than artificial intelligence. Our aim is to make ML models more efficient. We introduce compute and memory constraints to the model. On the resource-constrained model, we test its alignment with human behavior and neural response data. We aim to find critical model design or resource constraints that lead to better alignment with human vision.

Publications

H. Yang, J. Gee, and J. Shi. Brain decodes deep nets. CVPR, Spotlight, 2024. arXiv.2312.01280

Resources

In progress