CMStatistics 2021: Start Registration
View Submission - CMStatistics
B1744
Title: Transfer learning for empirical bayes estimation: A nonparametric integrative Tweedie approach Authors:  Wenguang Sun - University of Southern California (United States) [presenting]
Abstract: Compound estimation of normal means with auxiliary data collected from related source domains is considered. The empirical Bayes framework provides an elegant interface to pool information across different samples and construct efficient shrinkage estimators. We propose a nonparametric integrative Tweedie (NIT) approach to transferring structural knowledge encoded in the auxiliary data from related source domains to assist the simultaneous estimation of multiple parameters in the target domain. Our transfer learning algorithm uses convex optimization tools to directly estimate the gradient of the log-density through an embedding in the reproducing kernel Hilbert space (RKHS), which is induced by the Steins discrepancy metric. Most popular structural constraints can be easily incorporated into our estimation framework. We characterize the asymptotic $L_p$ risk of NIT by first rigorously analyzing its connections to the RKHS risk, and second establishing the rate at which NIT converges to the oracle estimator. The improvements in the estimation risk and the deteriorations in the learning rate are precisely tabulated as the dimension of side information increases. The numerical performance of NIT and its superiority over existing methods are illustrated through the analysis of both simulated and real data.