![Loading Events](https://cmsa.fas.harvard.edu/wp-content/plugins/the-events-calendar/src/resources/images/tribe-loading.gif)
- This event has passed.
Language Modeling for Mathematical Reasoning
January 20, 2021 @ 3:00 pm - 4:00 pm
![1/20/2021 New Tech in Math](https://cmsa.fas.harvard.edu/media/CMSA-New-Technologies-in-Mathematics-01.20.21.png)
Speaker: Christian Szegedy
Title: Language Modeling for Mathematical Reasoning
Abstract: In this talk, I will summarize the current state of the art of transformer based language models and give examples on non-trivial reasoning task language models can solve in higher order logic reasoning. I will also discuss how to inject injective bias into transformer networks via pretraining on very simple synthetic tasks and representing graph structures for transformer networks.