New Technologies in Mathematics Seminar

Speaker: Emmanuel Abbé, EPFL, Institute of Mathematics and School of Computer and Communication Sciences

Title: Dynamic reasoning

Abstract: In the current AI landscape, reasoning is frequently equated with the generation of intermediate “thinking traces”. However, these traces are merely a mechanism, not the ultimate objective.
Relying solely on the presence of a trace can be deceptive, as models often learn to mimic the format of reasoning while effectively overfitting to specific training distributions.
To build more robust and versatile reasoners, we shift our focus to more specific structural properties of the thinking process, in particular compositionality (inductive CoT, AdaBack) and abstraction (AbstRaL).