Loading Events

« All Events

  • This event has passed.

Minerva: Solving Quantitative Reasoning Problems with Language Models

October 5, 2022 @ 2:00 pm - 4:00 pm

10.05.2022

New Technologies in Mathematics Seminar

Speaker: Guy Gur-Ari, Google Research

Title: Minerva: Solving Quantitative Reasoning Problems with Language Models

Abstract: Quantitative reasoning tasks which can involveĀ mathematics, science, and programming are often challenging for machine learning models in general and for language models in particular. We show that transformer-based language models obtain significantly better performance on math and science questions when trained in an unsupervised way on a large, math-focused dataset. Performance can be further improved using prompting and sampling techniques including chain-of-thought and majority voting. Minerva, a model that combines these techniques, achieves SOTA on several math and science benchmarks. I will describe the model, its capabilities and limitations.

Details

Date:
October 5, 2022
Time:
2:00 pm - 4:00 pm
Event Category:

Organizer

Michael Douglas

Venue

CMSA Room G10
CMSA, 20 Garden Street
Cambridge, MA 02138 United States
+ Google Map
Phone:
6174967132