Self-supervised pre-training for the embodied Turing test
PI: Jianbo Shi
Co-PI: Carl Vondrick and Nikolaus Kriegeskorte
Abstract
Natural intelligence is much more energy efficient than artificial intelligence. Our aim is to make ML models more efficient. We introduce compute and memory constraints to the model. On the resource-constrained model, we test its alignment with human behavior and neural response data. We aim to find critical model design or resource constraints that lead to better alignment with human vision.
Publications
H. Yang, J. Gee, and J. Shi. Brain decodes deep nets. CVPR, Spotlight, 2024. arXiv.2312.01280
Resources
In progress