Previous Special Year Seminar

Apr
23
2020

Theoretical Machine Learning Seminar

Deep Generative models and Inverse Problems
Alexandros Dimakis
3:00pm|https://theias.zoom.us/j/384099138

Modern deep generative models like GANs, VAEs and invertible flows are showing amazing results on modeling high-dimensional distributions, especially for images. We will show how they can be used to solve inverse problems by generalizing compressed...

Apr
21
2020

Theoretical Machine Learning Seminar

Assumption-free prediction intervals for black-box regression algorithms
Aaditya Ramdas
12:00pm|https://theias.zoom.us/j/384099138

There has been tremendous progress in designing accurate black-box prediction methods (boosting, random forests, bagging, neural nets, etc.) but for deployment in the real world, it is useful to quantify uncertainty beyond making point-predictions...

Apr
09
2020

Theoretical Machine Learning Seminar

Meta-Learning: Why It’s Hard and What We Can Do
3:00pm|https://theias.zoom.us/j/384099138

Meta-learning (or learning to learn) studies how to use machine learning to design machine learning methods themselves. We consider an optimization-based formulation of meta-learning that learns to design an optimization algorithm automatically...

Apr
07
2020

Theoretical Machine Learning Seminar

Interpolation in learning: steps towards understanding when overparameterization is harmless, when it helps, and when it causes harm
Anant Sahai
12:00pm|https://theias.zoom.us/j/384099138

A continuing mystery in understanding the empirical success of deep neural networks has been in their ability to achieve zero training error and yet generalize well, even when the training data is noisy and there are many more parameters than data...

Apr
02
2020

Theoretical Machine Learning Seminar

Learning Controllable Representations
12:00pm|https://theias.zoom.us/j/384099138

As deep learning systems become more prevalent in real-world applications it is essential to allow users to exert more control over the system. Exerting some structure over the learned representations enables users to manipulate, interpret, and even...

Mar
31
2020

Theoretical Machine Learning Seminar

Some Recent Insights on Transfer Learning
12:00pm|https://theias.zoom.us/j/384099138

A common situation in Machine Learning is one where training data is not fully representative of a target population due to bias in the sampling mechanism or high costs in sampling the target population; in such situations, we aim to ’transfer’...

Mar
26
2020

Theoretical Machine Learning Seminar

Margins, perceptrons, and deep networks
Matus Telgarsky
12:00pm|https://illinois.zoom.us/j/741628827

This talk surveys the role of margins in the analysis of deep networks. As a concrete highlight, it sketches a perceptron-based analysis establishing that shallow ReLU networks can achieve small test error even when they are quite narrow, sometimes...

Mar
11
2020

Theoretical Machine Learning Seminar

Improved Bounds on Minimax Regret under Logarithmic Loss via Self-Concordance
Blair Bilodaeu
4:00pm|Simonyi 101

We study sequential probabilistic prediction on data sequences which are not i.i.d., and even potentially generated by an adversary. At each round, the player assigns a probability distribution to possible outcomes and incurs the log-likelihood of...