Loading Events

« All Events

  • This event has passed.

Transformers for maths, and maths for transformers

September 27, 2023 @ 2:00 pm - 3:00 pm

New Technologies in Mathematics Seminar

Speaker: François Charton, Meta AI

Title:  Transformers for maths, and maths for transformers

Abstract: Transformers can be trained to solve problems of mathematics. I present two recent applications, in mathematics and physics: predicting integer sequences, and discovering the properties of scattering amplitudes in a close relative of Quantum ChromoDynamics.

Problems of mathematics can also help understand transformers. Using two examples from linear algebra and integer arithmetic, I show that model predictions can be explained, that trained models do not confabulate, and that carefully choosing the training distributions can help achieve better, and more robust, performance.

 

 

 

Details

Date:
September 27, 2023
Time:
2:00 pm - 3:00 pm
Event Category:

Organizer

Michael Douglas

Venue

CMSA Room G10
CMSA, 20 Garden Street
Cambridge, MA 02138 United States
+ Google Map
Phone:
6174967132