SMS scnews item created by Andrew Mathas at Sat 7 Sep 2013 1617
Type: Seminar
Distribution: World
Expiry: 27 Sep 2013
Calendar1: 27 Sep 2013 1100-1200
CalLoc1: AGR Seminar
CalTitle1: AGR Seminar: Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers
Auth: mathas@114.88.broadband5.iol.cz in SMS-auth

AGR Seminar -- Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers

Host venue
University of Newcastle

Abstract

Joint work with N. Parikh, E. Chu, B. Peleato, and J. Eckstein Many problems of recent interest in statistics and machine learning can be posed in the framework of convex optimization. Due to the explosion in size and complexity of modern datasets, it is increasingly important to be able to solve problems with a very large number of features, training examples, or both. As a result, both the decentralized collection or storage of these datasets as well as accompanying distributed solution methods are either necessary or at least highly desirable. We argue that the alternating direction method of multipliers is well suited to distributed convex optimization, and in particular to large-scale problems arising in statistics, machine learning, and related areas. The method was developed in the 1970s, with roots in the 1950s, and is equivalent or closely related to many other algorithms, such as dual decomposition, the method of multipliers, Douglas-Rachford splitting, Spingarn's method of partial inverses, Dykstra's alternating projections, Bregman iterative algorithms for problems, proximal methods, and others. After briefly surveying the theory and history of the algorithm, we discuss applications to a wide variety of statistical and machine learning problems of recent interest, including the lasso, sparse logistic regression, basis pursuit, covariance selection, and support vector machines.

If you want to participate in this seminar:

--

If you would like to attend this seminar in our access grid room then please check to see if the grid is already booked at this time and send an email to accessgridroom@maths.usyd.edu.au to let the CSOs know that you would like to attend.


If you are registered you may mark the scnews item as read.
School members may try to .