BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//CMSA - ECPv6.17.1//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://cmsa.fas.harvard.edu
X-WR-CALDESC:Events for CMSA
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20200308T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20201101T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20210314T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20211107T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20220313T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20221106T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20210416T130000
DTEND;TZID=America/New_York:20210416T143000
DTSTAMP:20250328T201348Z
CREATED:20230707T171834Z
LAST-MODIFIED:20250328T201348Z
UID:10000910-1618578000-1618583400@cmsa.fas.harvard.edu
SUMMARY:CMSA Math-Science Literature Lecture: Deep Networks from First Principles
DESCRIPTION:Yi MaPhoto Copyright Noah Berger / 2019\n  \nYi Ma (University of California\, Berkeley) \nTitle: Deep Networks from First Principles \nAbstract: In this talk\, we offer an entirely “white box’’ interpretation of deep (convolution) networks from the perspective of data compression (and group invariance). In particular\, we show how modern deep layered architectures\, linear (convolution) operators and nonlinear activations\, and even all parameters can be derived from the principle of maximizing rate reduction (with group invariance). All layers\, operators\, and parameters of the network are explicitly constructed via forward propagation\, instead of learned via back propagation. All components of so-obtained network\, called ReduNet\, have precise optimization\, geometric\, and statistical interpretation. There are also several nice surprises from this principled approach: it reveals a fundamental tradeoff between invariance and sparsity for class separability; it reveals a fundamental connection between deep networks and Fourier transform for group invariance – the computational advantage in the spectral domain (why spiking neurons?); this approach also clarifies the mathematical role of forward propagation (optimization) and backward propagation (variation). In particular\, the so-obtained ReduNet is amenable to fine-tuning via both forward and backward (stochastic) propagation\, both for optimizing the same objective. This is joint work with students Yaodong Yu\, Ryan Chan\, Haozhi Qi of Berkeley\, Dr. Chong You now at Google Research\, and Professor John Wright of Columbia University. \nTalk chair: Harry Shum \nSlides | Video
URL:https://cmsa.fas.harvard.edu/event/cmsa-math-science-literature-lecture_ma/
LOCATION:Virtual
CATEGORIES:Event,Math Science Literature Lecture Series,Public Lecture,Special Lectures
ATTACH;FMTTYPE=image/jpeg:https://cmsa.fas.harvard.edu/media/Lecture_Ma-1-pdf.jpeg
END:VEVENT
END:VCALENDAR