I’ll discuss the Noisy Quadratic Model, the toy problem of
minimizing a convex quadratic function with noisy gradient
observations. While the NQM is simple enough to have closed-form
dynamics for a variety of optimizers, it gives a surprising
amount...