Inference in Stochastic Optimization with Heavy Tailed Input
Abstract
We will start the talk by discussing empirical evidence from a wide range of areas (including insurance, health care, machine learning, among others) suggesting that often infinite variance models are well-suited for inference, particularly in online data-driven decision making. We will argue that infinite variance estimators can be considered appropriate depending on easy-to-monitor features of historical data and on the spatial and temporal scales over which an online algorithm will be deployed (even if the underlying dynamics have finite variance gradients "in theory"). We will then discuss inference tools that can be applied to monitor the quality of solutions of infinite-variance stochastic gradient descent (SGD) based on several asymptotic statistics. Our results extend classical finite-variance weak-convergence analysis of SGD and state-of-the-art infinite variance asymptotic statistics derived under homogeneity conditions which limit the applicability of SGD in typical online optimization tasks. Based on joint work with Aleks Mijatovic, Wenhao Yang.
Watch recording ↗About the speaker
Jose Blanchet is a faculty member in the Management Science and Engineering Department at Stanford University – where he earned his Ph.D. in 2004. Prior to joining the Stanford faculty, Jose was a professor in the IEOR and Statistics Departments at Columbia University (2008-2017) and before that he was faculty member in the Statistics Department at Harvard University (2004-2008). Jose is a recipient of the 2009 Best Publication Award given by the INFORMS Applied Probability Society and of the 2010 Erlang Prize. He also received a PECASE award given by NSF in 2010. He worked as an analyst in Protego Financial Advisors, a leading investment bank in Mexico. He has research interests in applied probability and Monte Carlo methods. He serves in the editorial board of ALEA, Advances in Applied Probability, Extremes, Insurance: Mathematics and Economics, Journal of Applied Probability, Mathematics of Operations Research, and Stochastic Systems.