Loading Events

« All Events

  • This event has passed.

Towards Faithful Reasoning Using Language Models

October 19, 2022 @ 2:00 pm - 3:00 pm


New Technologies in Mathematics Seminar

Speaker: Antonia Creswell, DeepMind

Title: Towards Faithful Reasoning Using Language Models

Abstract: Language models are showing impressive performance on many natural language tasks, including question-answering. However, language models – like most deep learning models – are black boxes. We cannot be sure how they obtain their answers. Do they reason over relevant knowledge to construct an answer or do they rely on prior knowledge – baked into their weights – which may be biased? An alternative approach is to develop models whose output is a human interpretable, faithful reasoning trace leading to an answer. In this talk we will characterise faithful reasoning in terms of logically valid reasoning and demonstrate where current reasoning models fall short. Following this, we will introduce Selection-Inference, a faithful reasoning model, whose causal structure mirrors the requirements for valid reasoning. We will show that our model not only produces more accurate reasoning traces but also improves final answer accuracy.




October 19, 2022
2:00 pm - 3:00 pm
Event Category:


Michael Douglas


CMSA Room G10
CMSA, 20 Garden Street
Cambridge, MA 02138 United States
+ Google Map