CFE 2015: Start Registration
View Submission - CFE
A1164
Title: The spike-and-slab LASSO Authors:  Veronika Rockova - University of Chicago (United States) [presenting]
Edward George - University of Pennsylvania (United States)
Abstract: Despite the wide adoption of spike-and-slab methodology for Bayesian variable selection, its potential for penalized likelihood estimation has largely been overlooked. We bridge this gap by cross-fertilizing these two paradigms with the Spike-and-Slab LASSO procedure for variable selection and parameter estimation in linear regression. We introduce a new class of self-adaptive penalty functions that arise from a fully Bayes spike-and-slab formulation, ultimately moving beyond the separable penalty framework. A virtue of these non-separable penalties is their ability to borrow strength across coordinates, adapt to en- semble sparsity information and exert multiplicity adjustment. The Spike-and-Slab LASSO procedure harvests efficient Bayesian EM and coordinate-wise implementations with a path- following scheme for dynamic posterior exploration. We show on simulated data that the fully Bayes penalty mimics oracle performance, providing a viable alternative to cross-validation. We develop theory for the separable and non-separable variants of the penalty, showing rate- optimality of the global mode as well as optimal posterior concentration when $p > n$. Thus, the modal estimates can be supplemented with meaningful uncertainty assessments.