Previous Special Year Seminar

Jun
16
2020

Theoretical Machine Learning Seminar

On learning in the presence of biased data and strategic behavior
Avrim Blum
3:00pm|Remote Access Only - see link below

In this talk I will discuss two lines of work involving learning in the presence of biased data and strategic behavior. In the first, we ask whether fairness constraints on learning algorithms can actually improve the accuracy of the classifier...

Jun
11
2020

Theoretical Machine Learning Seminar

On Langevin Dynamics in Machine Learning
Michael I. Jordan
3:00pm|Remote Access Only - see link below

Langevin diffusions are continuous-time stochastic processes that are based on the gradient of a potential function. As such they have many connections---some known and many still to be explored---to gradient-based machine learning. I'll discuss...

Jun
09
2020

Theoretical Machine Learning Seminar

What Do Our Models Learn?
Aleksander Madry
12:30pm|Remote Access Only - see link below

Large-scale vision benchmarks have driven---and often even defined---progress in machine learning. However, these benchmarks are merely proxies for the real-world tasks we actually care about. How well do our benchmarks capture such tasks?

In this...

May
21
2020

Theoretical Machine Learning Seminar

Forecasting Epidemics and Pandemics
Roni Rosenfeld
3:00pm|Remote Access Only - see link below

Epidemiological forecasting is critically needed for decision making by national and local governments, public health officials, healthcare institutions and the general public. The Delphi group at Carnegie Mellon University was founded in 2012 to...

May
19
2020

Theoretical Machine Learning Seminar

Neural SDEs: Deep Generative Models in the Diffusion Limit
Maxim Raginsky
12:00pm|Remote Access Only - see link below

In deep generative models, the latent variable is generated by a time-inhomogeneous Markov chain, where at each time step we pass the current state through a parametric nonlinear map, such as a feedforward neural net, and add a small independent...

May
14
2020

Theoretical Machine Learning Seminar

MathZero, The Classification Problem, and Set-Theoretic Type Theory
David McAllester
3:00pm|Remote Access Only - see link below

AlphaZero learns to play go, chess and shogi at a superhuman level through self play given only the rules of the game. This raises the question of whether a similar thing could be done for mathematics --- a MathZero. MathZero would require a formal...

May
12
2020

Theoretical Machine Learning Seminar

Generative Modeling by Estimating Gradients of the Data Distribution
Stefano Ermon
12:00pm|Remote Access Only - see link below

Existing generative models are typically based on explicit representations of probability distributions (e.g., autoregressive or VAEs) or implicit sampling procedures (e.g., GANs). We propose an alternative approach based on modeling directly the...

May
07
2020

Theoretical Machine Learning Seminar

Learning probability distributions; What can, What can't be done
Shai Ben-David
3:00pm|Remote Access Only - see link below

A possible high level description of statistical learning is that it aims to learn about some unknown probability distribution ("environment”) from samples it generates ("training data”). In its most general form, assuming no prior knowledge and...

May
05
2020

Theoretical Machine Learning Seminar

Boosting Simple Learners
12:00pm|Remote Access Only - see link below

We study boosting algorithms under the assumption that the given weak learner outputs hypotheses from a class of bounded capacity. This assumption is inspired by the common convention that weak hypotheses are “rules-of-thumbs” from an “easy-to-learn...

Apr
30
2020

Theoretical Machine Learning Seminar

Latent Stochastic Differential Equations for Irregularly-Sampled Time Series
David Duvenaud
3:00pm|Remote Access Only - see link below

Much real-world data is sampled at irregular intervals, but most time series models require regularly-sampled data. Continuous-time models address this problem, but until now only deterministic (ODE) models or linear-Gaussian models were efficiently...