Loading Events

« All Events

  • This event has passed.

Scaling Laws and Their Implications for Coding AI

March 2, 2022 @ 2:00 pm - 3:00 pm

03.2.2022-1553x2048-1

Speaker: Jared Kaplan, Johns Hopkins Dept. of Physics & Astronomy

Title: Scaling Laws and Their Implications for Coding AI

Abstract:  Scaling laws and associated downstream trends can be used as an organizing principle when thinking about current and future ML progress.  I will briefly review scaling laws for generative models in a number of domains, emphasizing language modeling.  Then I will discuss scaling results for transfer from natural language to code, and results on python programming performance from “codex” and other models.  If there’s time I’ll discuss prospects for the future — limitations from dataset sizes, and prospects for RL and other techniques.

Details

Date:
March 2, 2022
Time:
2:00 pm - 3:00 pm
Event Category:

Venue

Virtual