Loading Events

« All Events

  • This event has passed.

Transformers for maths, and maths for transformers

September 27, 2023 @ 2:00 pm - 3:00 pm

New Technologies in Mathematics Seminar

Speaker: François Charton, Meta AI

Title:  Transformers for maths, and maths for transformers

Abstract: Transformers can be trained to solve problems of mathematics. I present two recent applications, in mathematics and physics: predicting integer sequences, and discovering the properties of scattering amplitudes in a close relative of Quantum ChromoDynamics.

Problems of mathematics can also help understand transformers. Using two examples from linear algebra and integer arithmetic, I show that model predictions can be explained, that trained models do not confabulate, and that carefully choosing the training distributions can help achieve better, and more robust, performance.





September 27, 2023
2:00 pm - 3:00 pm
Event Category:


Michael Douglas


CMSA Room G10
CMSA, 20 Garden Street
Cambridge, MA 02138 United States
+ Google Map