How do Transformers reason? First principles via automata, semigroups, and circuits

CMSA Room G10 CMSA, 20 Garden Street, Cambridge

https://youtu.be/g8zdumOAWzw New Technologies in Mathematics Seminar Speaker: Cyril Zhang, Microsoft Research Title: How do Transformers reason? First principles via automata, semigroups, and circuits Abstract: The current "Transformer era" of deep […]