Models and mechanisms of abstraction

PI: John Lafferty
Co-PI: Stefano Fusi

Abstract

In progress

Publications

A. Altabaa, T. W. Webb, J. D. Cohen, and J. Lafferty. “Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in transformers”. International Conference on Learning Representations, 2024. (https://doi.org/10.48550/arXiv.2304.00195)

A. Altabaa and J. Lafferty. “Learning hierarchical relational representations through relational convolutions”, 2024a. arXiv:2310.03240. Under review.
(https://doi.org/10.48550/arXiv.2310.03240)

A. Altabaa and J. Lafferty. “Approximation of relation functions and attention mechanisms”, 2024b. arXiv:2402.08856. (https://doi.org/10.48550/arXiv.2402.08856)

T. W. Webb, S. M. Frankland, A. Altabaa, K. Krishnamurthy, D. Campbell, J. Russin, R. O’Reilly, J. Lafferty, and J. D. Cohen. “The relational bottleneck as an inductive bias for efficient abstraction”. Trends in Cognitive Science, 2024.
(https://doi.org/10.48550/arXiv.2309.06629)

Resources

In progress