EcoSta 2024: Start Registration
View Submission - EcoSta 2025
A0971
Title: Theoretical guarantees for sparse principal component analysis based on the elastic net Authors:  Teng Zhang - University of Central Florida (United States) [presenting]
Abstract: Sparse principal component analysis (SPCA) is widely used for dimensionality reduction and feature extraction in high-dimensional data analysis. Despite many methodological and theoretical developments in the past two decades, the theoretical guarantees of the popular SPCA algorithm proposed in a prior study are still unknown. The aim is to address this critical gap. The SPCA algorithm of the prior study is first revisited, and the implementation is presented. A computationally more efficient variant of the SPCA algorithm is also studied, which can be considered as the limiting case of SPCA. The guarantees of convergence to a stationary point are provided for both algorithms, and it is proven that, under a sparse spiked covariance model, both algorithms can recover the principal subspace consistently under mild regularity conditions. It is shown that their estimation error bounds match the best available bounds of existing works or the minimax rates up to some logarithmic factors. Moreover, the competitive numerical performance of both algorithms is demonstrated in numerical studies.