Infinite Limits and Scaling Laws for Deep Neural Networks

CMSA Room G10 CMSA, 20 Garden Street, Cambridge, MA, United States

https://youtu.be/0998FJhPdj8 New Technologies in Mathematics Seminar Speaker: Blake Bordelon Title: Infinite Limits and Scaling Laws for Deep Neural Networks Abstract: Scaling up the size and training horizon of deep learning models has enabled breakthroughs in computer vision and natural language processing. Empirical evidence suggests that these neural network models are described by regular scaling laws where performance of […]

Hierarchical data structures through the lenses of diffusion models

CMSA Room G10 CMSA, 20 Garden Street, Cambridge, MA, United States

https://youtu.be/x7LPDDYZn94 New Technologies in Mathematics Seminar Speaker: Antonio Sclocchi, EPFL Title: Hierarchical data structures through the lenses of diffusion models Abstract: The success of deep learning with high-dimensional data relies on the fact that natural data are highly structured. A key aspect of this structure is hierarchical compositionality, yet quantifying it remains a challenge. In […]