Understanding Optimization in Deep Learning with Central Flows
Hybrid - G10https://youtu.be/04E8r76TetQ New Technologies in Mathematics Seminar Speaker: Alex Damian, Harvard Title: Understanding Optimization in Deep Learning with Central Flows Abstract: Traditional theories of optimization cannot describe the dynamics of optimization in deep learning, even in the simple setting of deterministic training. The challenge is that optimizers typically operate in a complex, oscillatory regime called the "edge of […]